Can someone tell me how to use markov chains to solve this?