Markov

Markov is a program created to assist the design and solution of Markov chains and processes.

Simply put, a Markov process is a system composed of states and a set of rules for transition between states. This program allows you to define the states and the probability of transition for one state to another. At least one state should be designated as a "terminal" state from which transition does not happen.

You can verify a model (this checks to be sure the probabilities from each state add to 1) and solve a model, entering the number of times to try the model. The output is the time spent in each state.

Program is supplied with source code. A logical addition would be the ability to save and load multiple processes, but I have only worked with one at a time so did not find this necessary.

Download Markov