The GATE Grind

GATE 2026 ST – Question 18

Stochastic Processes · Markov Chains · 1 mark · Multiple choice

A homogeneous Markov chain on {1,…,7} has transition matrix $P=\begin{pmatrix}1/3&0&2/3&0&0&0&0\\0&1/3&0&1/3&0&1/3&0\\1/2&0&1/2&0&0&0&0\\0&1/2&0&1/4&0&1/4&0\\1/2&0&0&0&1/4&1/4&0\\0&2/3&0&1/6&0&1/6&0\\1/3&1/3&0&0&0&0&1/3\end{pmatrix}$. Which state is transient?

  1. 2
  2. 3
  3. 4
  4. 5

Practise this question in The GATE Grind →

Show answer and explanation

Correct answer: (D) 5

Explanation

The sets {1,3} and {2,4,6} are closed finite communicating classes, so all their states are recurrent. From 5 the chain can enter either closed class and cannot return to 5. Thus **5, D**, is transient. State 7 is also transient but is not listed.

More Markov Chains questions

All Markov Chains questions →