Browse Definitions :
Definition

Markov model

Contributor(s): Matthew Haughn

A Markov model is a stochastic method for randomly changing systems where it is assumed that future states do not depend on past states. These models show all possible states as well as the transitions, rate of transitions and probabilities between them. 

Markov models are often used to model the probabilities of different states and the rates of transitions among them.  The method is generally used to model systems. Markov models can also be used to recognize patterns, make predictions and to learn the statistics of sequential data.

There are four types of Markov models that are used situationally:

  • Markov chain - used by systems that are autonomous and have fully observable states
  • Hidden Markov model - used by systems that are autonomous where the state is partially observable. 
  • Markov decision processes - used by controlled systems with a fully observable state.
  • Partially observable Markov decision processes - used by controlled systems where the state is partially observable.

Markov models can be expressed in equations or in graphical models. Graphic Markov models typically use circles (each containing states) and directional arrows to indicate possible transitional changes between them. The directional arrows are labeled with the rate or the variable one for the rate. Applications of Markov modeling include modeling languages, natural language processing (NLP), image processing, bioinformatics, speech recognition and modeling computer hardware and software systems.

Markov models are named after their creator, Andrey Markov, a Russian mathematician in the late 1800s to early 1900s.

An introduction to Markov models:

This was last updated in July 2017

Continue Reading About Markov model

Join the conversation

1 comment

Send me notifications when other members comment.

Please create a username to comment.

What mathematical concept do you wish you'd paid more attention to in high school?
Cancel

-ADS BY GOOGLE

File Extensions and File Formats

Powered by:

SearchCompliance

  • compliance audit

    A compliance audit is a comprehensive review of an organization's adherence to regulatory guidelines.

  • regulatory compliance

    Regulatory compliance is an organization's adherence to laws, regulations, guidelines and specifications relevant to its business...

  • Whistleblower Protection Act

    The Whistleblower Protection Act of 1989 is a law that protects federal government employees in the United States from ...

SearchSecurity

  • payload (computing)

    In computing, a payload is the carrying capacity of a packet or other transmission data unit. The term has its roots in the ...

  • passphrase

    A passphrase is a string of characters longer than the usual password (which is typically from four to 16 characters long) that ...

  • Web application firewall (WAF)

    A Web application firewall (WAF) is a firewall that monitors, filters or blocks traffic to and from a Web application. WAFs are ...

SearchHealthIT

SearchDisasterRecovery

SearchStorage

  • computational storage

    Computational storage is defined as an architecture that couples compute with storage in order to reduce data movement. In doing ...

  • data deduplication

    Data deduplication -- often called intelligent compression or single-instance storage -- is a process that eliminates redundant ...

  • public cloud storage

    Public cloud storage, also called storage-as-a-service or online storage is a service model that provides data storage on a ...

Close