Markov PMarkov: First-order Markov chain generator. MarkovLearner: Learn a Markovian sequence by sequentially registering new values MarkovGrapher: Helper class to graph the structure of a Markov object.