Um estudo sobre modelos Markovianos

Abstract

Markov chains have a range of applications within modeling, and due to their importance, are greatly studied in the literature. Herein, the objective of this paper is to study first-order Markov chains, presenting the principal concepts and properties related to them, with special attention given to their interpretation. In particular, we will define and explore several aspects associated with the stationary distribution.