Lecture Introduction to Stochastic Processes: Lesson 12 provide students with knowledge about Chapman-Kolmogorov equation, decomposition of state space, hitting time, a very useful criterion for accessibility, deterministically monotone Markov chain, . |