Large Language Models As Markov Chains