This is a two-state transient Markov chain. The transition matrix is $$P = \left[\matrix{3/4 & 1/4\cr 1/3 & 2/3}\right] $$ Can you find a fixed probability vector for this matrix?
This is a two-state transient Markov chain. The transition matrix is $$P = \left[\matrix{3/4 & 1/4\cr 1/3 & 2/3}\right] $$ Can you find a fixed probability vector for this matrix?