Reaching Probability

Definition

$$ f_{ij}=P_i(T_j<\infty)=P(T_j<\infty\mid X_0=i) $$

the probability of reaching state $j$ for at least once in finite steps.

Related

• STA447
• Hitting Time
• Discrete-Time Markov Chain