LAISHA
Open Laisha

CSIR-UGC NET Stochastic Processes: practice questions

CSIR-UGC NET - Mathematical Sciences (statistics option) · India · National Testing Agency for CSIR

Original practice questions written to the published syllabus · not past papers
10worked here, free
38written to this exam in this subject
11syllabus units

What this subject covers

Random processes in time: Markov chains and their classification and limits, Poisson and birth-death processes, branching processes and Brownian motion, applied to population growth, epidemics, queues and weather sequences such as wet- and dry-day chains.

In the exams: GATE ST 'Stochastic Processes' (heavy); UPSC ISS Statistics I (present); ISI admission (present); CSIR-NET Unit 4 (present); light in AICE-JRF Ag Stat

Where the 38 questions fall

How our questions for CSIR-UGC NET spread across the units of Stochastic Processes. Difficulty: 0 easy, 16 medium, 22 hard.

Definition and classification of stochastic processes5
Classification of states and periodicity5
Brownian motion and its basic properties5
Renewal processes (introduction)5
Limiting and stationary distributions4
Branching processes and extinction probability4
Pure birth, pure death and birth-death processes3
Markov chains: transition matrices and Chapman-Kolmogorov equations2
Poisson process and its properties2
Markov-chain models of rainfall and crop sequences2
Queueing models M/M/1 and M/M/c1

10 practice questions, worked

Choose an answer, then open the working. Each explanation says why the right answer is right and why the others are not.

1 · Definition and classification of stochastic processes · medium

Which statement about independent increments and the Markov property is correct?

  1. The two properties are equivalent
  2. The Markov property implies independent increments
  3. Neither implies the other in any case
  4. Independent increments imply the Markov property, but not conversely
Answer and working

D. Independent increments imply the Markov property, but not conversely

If increments are independent, the future increment ignores the past, so the process is Markov. A wet/dry rainfall chain is Markov but its 'increments' are not independent.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

2 · Definition and classification of stochastic processes · medium

How is a process whose next value depends on its last two values made into a Markov chain?

  1. It cannot be made Markov
  2. Enlarge the state
  3. By differencing the series
  4. By ignoring the earlier value
Answer and working

B. Enlarge the state

Enlarging the state to the last two values gives a first-order Markov chain on pairs; this is how second-order rainfall chains are handled.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

3 · Markov chains: transition matrices and Chapman-Kolmogorov equations · hard

For a two-state chain with p₀₁ = 0.3 and p₁₀ = 0.4, at what geometric rate do the rows of Pⁿ approach their limit?

  1. 0.3ⁿ
  2. 0.4ⁿ
  3. 0.12ⁿ
  4. 0.7ⁿ
Answer and working

A. 0.3ⁿ

The second eigenvalue of P is 1 − a − b = 0.3, and Pⁿ = limit + (1 − a − b)ⁿ × (fixed matrix). 0.7 = a + b and 0.4 = p₁₀ are not eigenvalues of P.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

4 · Classification of states and periodicity · medium

Which criterion characterises a recurrent state i?

  1. Σₙ pᵢᵢ⁽ⁿ⁾ = ∞
  2. Σₙ pᵢᵢ⁽ⁿ⁾ < ∞
  3. pᵢᵢ⁽ⁿ⁾ → 1
  4. pᵢᵢ = 1
Answer and working

A. Σₙ pᵢᵢ⁽ⁿ⁾ = ∞

The expected number of returns, Σₙ pᵢᵢ⁽ⁿ⁾, is infinite for recurrent and finite for transient states. pᵢᵢ = 1 defines an absorbing state, a special recurrent case.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

5 · Classification of states and periodicity · hard

According to Pólya's theorem, in which dimensions is the symmetric simple random walk recurrent?

  1. All dimensions
  2. One dimension only
  3. Three or more only
  4. One and two dimensions only
Answer and working

D. One and two dimensions only

The return probability is 1 in dimensions 1 and 2 and below 1 in dimensions 3 and higher.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

6 · Classification of states and periodicity · hard

A random walk on 0, ..., 6 steps up with probability 0.6 and down with 0.4, starting at 3 and absorbed at 0 and 6. What is the probability of reaching 6 first?

  1. 0.6000
  2. 0.5000
  3. 0.7714
  4. 0.2286
Answer and working

C. 0.7714

[1 − (q/p)ⁱ]/[1 − (q/p)ᴺ] with q/p = 2/3: [1 − (2/3)³]/[1 − (2/3)⁶] = 0.7714. 0.5 would hold only for p = 1/2.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

7 · Limiting and stationary distributions · hard

A periodic irreducible positive-recurrent chain has stationary distribution π. Which statement is correct?

  1. No stationary distribution exists for periodic chains
  2. π depends on the starting state
  3. Long-run time fractions equal π, though pᵢⱼ⁽ⁿ⁾ itself does not converge
  4. pᵢⱼ⁽ⁿ⁾ converges to πⱼ as in the aperiodic case
Answer and working

C. Long-run time fractions equal π, though pᵢⱼ⁽ⁿ⁾ itself does not converge

Periodicity prevents convergence of n-step probabilities, but averages over time still converge to π (the ergodic theorem needs no aperiodicity).

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

8 · Poisson process and its properties · medium

Insect emergence follows a non-homogeneous Poisson process with rate λ(t) = 2t per day for 0 ≤ t ≤ 3. What is the expected number of emergences in the first 3 days?

  1. 18
  2. 9
  3. 3
  4. 6
Answer and working

B. 9

Mean = ∫₀³ 2t dt = t² evaluated at 3 = 9. Using λ(3) × 3 = 18 overstates it; 6 is λ(3).

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

9 · Renewal processes (introduction) · hard

What does the renewal-reward theorem give?

  1. Long-run reward = E(reward per cycle) × E(cycle length)
  2. Long-run reward per unit time = E(reward per cycle)/E(cycle length)
  3. Reward per cycle is always constant
  4. Mean cycle length = 1/E(reward)
Answer and working

B. Long-run reward per unit time = E(reward per cycle)/E(cycle length)

With iid cycles, total reward up to t divided by t converges almost surely to E(R)/E(X).

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

10 · Renewal processes (introduction) · medium

Field surveys estimate infectious periods by measuring animals that are infected on the survey day. What bias results?

  1. Short periods are over-represented
  2. The bias cancels if the survey is large
  3. No bias, since sampling is random
  4. Long periods are over-sampled
Answer and working

D. Long periods are over-sampled

Units sampled at a fixed time are more likely to be in long intervals (the inspection paradox), so naive averages overestimate the mean duration.

Further reading: Karlin and Taylor, A First Course in Stochastic Processes; Ross, Introduction to Probability Models; Medhi, Stochastic Processes

Ten here, 38 in the app. The Laisha app has every practice question we have written to CSIR-UGC NET in this subject, marked as you go, with timed papers, a jump-to-unanswered list and a certificate when you pass at 70 per cent.

Free for ten days, then one subscription of US$10 a month. We would rather say so here than have you find it later.

Practise the full set in Laisha →

Read the subject

Stochastic ProcessesThe full study manual, free CSIR-UGC NETFormat, sections and how it has changed

More CSIR-UGC NET practice

Bayesian InferenceCategorical Data Analysis & Generalized Linear ModelsProbability TheoryMultivariate AnalysisNonparametric & Rank-Based MethodsStatistical Inference I: EstimationBioassay, Survival & Epidemiological StatisticsProbability Distributions & Sampling DistributionsOptimization Techniques for StatisticiansStatistical Inference II: Testing of Hypotheses & Sequential Analysis

Stochastic Processes for other exams

GATE · IndiaIIT JAM · IndiaChina national postgraduate entrance exam · ChinaICAR AICE-JRF/SRF · IndiaASRB Agricultural Research Service · IndiaASRB NET · IndiaCUET-PG · IndiaIndian Statistical Institute admission tests · India

Ask Laisha about this

Opens Laisha's chat with your question ready to send. Sign in or start free.