Lecture Introduction to Stochastic Processes: Lesson 9 provide students with knowledge about discrete parameter Markov chain on a countable state space, simple random walk on integers, mathematical description, transition probabilities, define a stochastic process with initial distribution, . |