[Mathematical modeling] Markov chain model (i) Basic introduction

Markov chain is a random process

The probability of moving from part m of the state I of part N to state J is irrelevant to the probability before N, which we call the Markov chain.

If the N-part probability is independent of time, then it becomes the Markov chain of the homogeneous

A simple Markov chain application is given, A is an e belonging to the 0,1 space of the Markov chain,

Our one-step transfer matrix can be used to find out:

[Mathematical modeling] Markov chain model (i) Basic introduction