DENUMERABLE MARKOV CHAINS

his textbook provides a systematic treatment of denumerable Markov chains, covering both the foundations of the subject and some in topics in potential theory and boundary theory. It is a discussion of relations among what might be called the descriptive quantities associated with Markov chains-probabilities of events and means of random variables that give insight into the behavior of the chains. The approach, by means of infinite matrices, simplifies the notation, shortens statements and proofs of theorems, and often suggests new results. This second edition includes the new chapter, 'Introduction to Random Fields', written by David Griffeath.