POMDP — Partially Observable Markov Decision Process

Fact

A math model for making step-by-step choices when you cannot see everything.

In Plain Words

POMDP is like playing a racing game while someone blocks half the TV. You guess the track from tiny clues, then steer anyway.

Robots use it. So do self-driving cars and chat agents. It helps them watch a bit, act, then watch again.

Related Concepts

• Markov Decision Process
• Belief State
• Reinforcement Learning
• Hidden Markov Model

MDP
A POMDP is an MDP with part of the world hidden.

Belief State
A POMDP uses a Belief State when the real state is unclear.

RL
Many real RL tasks fit a POMDP better than a fully visible world.

HMM
A POMDP uses the hidden-state idea from an HMM, then adds actions.