LAISHA
Open Laisha

CSIR-UGC NET Statistical Inference I: Estimation: practice questions

CSIR-UGC NET - Mathematical Sciences (statistics option) · India · National Testing Agency for CSIR

Original practice questions written to the published syllabus · not past papers
10worked here, free
36written to this exam in this subject
10syllabus units

What this subject covers

How to estimate well and know it: sufficiency and completeness, unbiasedness and minimum variance, the Cramer-Rao bound, the Rao-Blackwell and Lehmann-Scheffe theorems, the methods of moments, maximum likelihood and minimum chi-square, and confidence intervals.

In the exams: AICE-JRF Ag Stat Unit 1 (heavy: each theorem named); GATE ST 'Estimation' (heavy); IIT JAM MS (heavy); UPSC ISS Statistics I (heavy); ISI and CSIR-NET (present)

Where the 36 questions fall

How our questions for CSIR-UGC NET spread across the units of Statistical Inference I: Estimation. Difficulty: 3 easy, 15 medium, 18 hard.

Completeness, ancillarity and Basu's theorem7
Iterative maximum likelihood: Newton-Raphson and Fisher scoring6
Cramer-Rao inequality and Fisher information4
Maximum likelihood: properties, invariance and asymptotic normality4
Sufficiency, the factorisation theorem and minimal sufficiency3
Minimum variance unbiased estimation; Rao-Blackwell and Lehmann-Scheffe theorems3
Minimum chi-square and other methods3
Point estimation: unbiasedness, consistency and efficiency2
Interval estimation: pivotal quantities and coverage2
Large-sample confidence intervals2

10 practice questions, worked

Choose an answer, then open the working. Each explanation says why the right answer is right and why the others are not.

1 · Completeness, ancillarity and Basu's theorem · hard

X₁, ..., X₅ are iid uniform on (0, θ). Using Basu's theorem (X₍ₙ₎ is complete sufficient and X₍₁₎/X₍ₙ₎ is ancillary), what is E(X₍₁₎/X₍₅₎)?

  1. 0.8333
  2. 0.50
  3. 0.1667
  4. 0.20
Answer and working

D. 0.20

Independence gives E(X₍₁₎) = E(X₍₁₎/X₍₅₎) E(X₍₅₎), so E(X₍₁₎/X₍₅₎) = [θ/(n + 1)]/[nθ/(n + 1)] = 1/n = 0.20. 1/6 = 0.1667 is E(X₍₁₎)/θ, and 5/6 is E(X₍₅₎)/θ.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

2 · Minimum variance unbiased estimation; Rao-Blackwell and Lehmann-Scheffe theorems · easy

What does the Lehmann-Scheffé theorem state?

  1. An estimator attaining the Cramér-Rao bound is a function of a complete statistic, and hence unique
  2. An unbiased estimator that is a function of a complete sufficient statistic is the unique UMVUE
  3. The MLE is the UMVUE whenever a complete sufficient statistic exists
  4. Any function of a sufficient statistic is the UMVUE of its own expectation
Answer and working

B. An unbiased estimator that is a function of a complete sufficient statistic is the unique UMVUE

Completeness ensures uniqueness of the unbiased function of T, and Rao-Blackwell ensures it beats every other unbiased estimator. Sufficiency without completeness is not enough, and the MLE is often biased (uniform maximum, normal σ̂²).

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

3 · Cramer-Rao inequality and Fisher information · hard

Counts are iid Poisson(λ). What is the Cramér-Rao lower bound for an unbiased estimator of ψ(λ) = e^(−λ), at λ = 2 with n = 10?

  1. 0.0009
  2. 0.2000
  3. 0.0271
  4. 0.0037
Answer and working

D. 0.0037

Bound = [ψ′(λ)]²/[nI(λ)] = e^(−2λ)/(n/λ) = λe^(−2λ)/n = 2e^(−4)/10 = 0.0037. 0.2000 is the bound for λ itself; omitting the square of ψ′ gives 0.0271; dividing by λ instead of multiplying gives 0.0009.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

4 · Maximum likelihood: properties, invariance and asymptotic normality · medium

For a random sample from the Laplace (double exponential) density (1/2)e^(−|x − θ|), what is the MLE of θ?

  1. The sample mode
  2. The midrange (X₍₁₎ + X₍ₙ₎)/2
  3. The sample mean
  4. The sample median
Answer and working

D. The sample median

Maximising L means minimising Σ|xᵢ − θ|, which is achieved by the median. The mean minimises squared deviations (normal case); the midrange is relevant for uniform location.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

5 · Maximum likelihood: properties, invariance and asymptotic normality · hard

X₁, ..., Xₙ are iid uniform on (θ − 1/2, θ + 1/2). Which statement about the MLE of θ is correct?

  1. It is unique and equals the sample maximum X₍ₙ₎
  2. It is not unique: any value in [X₍ₙ₎ − 1/2, X₍₁₎ + 1/2] maximises L
  3. It does not exist, because the likelihood is unbounded near the sample extremes
  4. It is unique and equals the sample mean X̄
Answer and working

B. It is not unique: any value in [X₍ₙ₎ − 1/2, X₍₁₎ + 1/2] maximises L

L(θ) = 1 when X₍ₙ₎ − 1/2 ≤ θ ≤ X₍₁₎ + 1/2 and 0 otherwise: a flat maximum over an interval. The midrange is one natural choice within it.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

6 · Minimum chi-square and other methods · medium

For multinomial data, minimising the likelihood-ratio statistic G² = 2ΣOⱼ log(Oⱼ/Eⱼ(θ)) over θ is equivalent to which estimation method?

  1. Least squares on the frequencies
  2. The method of moments
  3. Maximum likelihood
  4. Minimum Pearson chi-square
Answer and working

C. Maximum likelihood

G² = 2[ΣOⱼ log Oⱼ − ΣOⱼ log Eⱼ(θ)], and the first term does not involve θ, so minimising G² maximises ΣOⱼ log pⱼ(θ), the multinomial log-likelihood.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

7 · Iterative maximum likelihood: Newton-Raphson and Fisher scoring · easy

What is the Newton-Raphson update for maximising a log-likelihood ℓ(θ) of one parameter?

  1. θ₍ₖ₊₁₎ = θ₍ₖ₎ − ℓ(θ₍ₖ₎)/ℓ′(θ₍ₖ₎)
  2. θ₍ₖ₊₁₎ = θ₍ₖ₎ + ℓ″(θ₍ₖ₎)/ℓ′(θ₍ₖ₎)
  3. θ₍ₖ₊₁₎ = θ₍ₖ₎ − ℓ′(θ₍ₖ₎) / ℓ″(θ₍ₖ₎)
  4. θ₍ₖ₊₁₎ = θ₍ₖ₎ + ℓ′(θ₍ₖ₎)/ℓ″(θ₍ₖ₎)
Answer and working

C. θ₍ₖ₊₁₎ = θ₍ₖ₎ − ℓ′(θ₍ₖ₎) / ℓ″(θ₍ₖ₎)

Expanding ℓ′(θ) ≈ ℓ′(θₖ) + (θ − θₖ)ℓ″(θₖ) = 0 gives the update with a minus sign; near a maximum ℓ″ < 0, so the step moves in the direction of the score. θ − ℓ/ℓ′ solves ℓ = 0, the wrong equation.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

8 · Iterative maximum likelihood: Newton-Raphson and Fisher scoring · hard

For a generalised linear model with canonical link, such as logistic regression for germination data, which statement is correct?

  1. Fisher scoring converges but Newton-Raphson diverges, because the observed Hessian is random
  2. Neither method applies; the EM algorithm must be used for every GLM
  3. Fisher scoring and Newton-Raphson coincide, each step being a weighted least-squares fit
  4. Newton-Raphson needs no starting values, because the likelihood is quadratic
Answer and working

C. Fisher scoring and Newton-Raphson coincide, each step being a weighted least-squares fit

With the canonical link the observed and expected information are equal, so the two algorithms are the same and take the iteratively reweighted least squares form. Starting values are still needed (usually from the data themselves).

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

9 · Iterative maximum likelihood: Newton-Raphson and Fisher scoring · hard

θ̃ is a √n-consistent estimator of θ. What can be said of the one-step estimator θ̃ + ℓ′(θ̃)/[nI(θ̃)]?

  1. It is no better asymptotically than θ̃ itself
  2. It is unbiased for θ in samples of every size
  3. It is asymptotically efficient, with the same limiting distribution as the MLE
  4. It is exactly equal to the MLE whenever n is large enough for the central limit theorem to apply
Answer and working

C. It is asymptotically efficient, with the same limiting distribution as the MLE

A single scoring (or Newton) step from a √n-consistent start yields an estimator with √n(θ₁ − θ) → N(0, 1/I(θ)), the MLE's limit. It is not exactly the MLE, and not unbiased in finite samples.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

10 · Iterative maximum likelihood: Newton-Raphson and Fisher scoring · medium

Newton-Raphson for the Cauchy location MLE, started far from the data, converges to a value that is not the global maximum. What is the reason and the standard remedy?

  1. Newton-Raphson always converges globally for this model, so the error must lie in the data entry
  2. The score equation has multiple roots; restart from the median and compare log-likelihoods
  3. The Cauchy MLE does not exist; use the sample mean instead
  4. The information is zero; switch to the method of moments
Answer and working

B. The score equation has multiple roots; restart from the median and compare log-likelihoods

The Cauchy log-likelihood is not concave and can have several local maxima. A consistent start (the median) plus a comparison of log-likelihoods at the roots finds the global maximum. The sample mean is useless for the Cauchy, and no moment estimator exists.

Further reading: Casella and Berger, Statistical Inference; Lehmann and Casella, Theory of Point Estimation; Rohatgi and Saleh, An Introduction to Probability and Statistics

Ten here, 36 in the app. The Laisha app has every practice question we have written to CSIR-UGC NET in this subject, marked as you go, with timed papers, a jump-to-unanswered list and a certificate when you pass at 70 per cent.

Free for ten days, then one subscription of US$10 a month. We would rather say so here than have you find it later.

Practise the full set in Laisha →

Read the subject

Statistical Inference I: EstimationThe full study manual, free CSIR-UGC NETFormat, sections and how it has changed

More CSIR-UGC NET practice

Bayesian InferenceCategorical Data Analysis & Generalized Linear ModelsProbability TheoryMultivariate AnalysisStochastic ProcessesNonparametric & Rank-Based MethodsBioassay, Survival & Epidemiological StatisticsProbability Distributions & Sampling DistributionsOptimization Techniques for StatisticiansStatistical Inference II: Testing of Hypotheses & Sequential Analysis

Statistical Inference I: Estimation for other exams

GATE · IndiaIIT JAM · IndiaCUET-PG · IndiaIndian Statistical Institute admission tests · IndiaICAR AICE-JRF/SRF · IndiaState statistical services · IndiaASRB NET · IndiaIndian Statistical Service Examination · India

Ask Laisha about this

Opens Laisha's chat with your question ready to send. Sign in or start free.