Nonstationary Markov Analysis