Pages • 3
Markov Chains Markov Chains 1 Discrete time Markov chainsExample: A drunk is walking home from the pub. There are n lampposts between the pub and his home, at each of which he stops to steady himself. After every such stop, he may change his mind about whether to walk home or turn back towards the.