Steady State Vector Markov Chain