Please enable JavaScript.
Coggle requires JavaScript to display documents.
Uncertainty, Probability, and Markov Chains - Coggle Diagram
Uncertainty, Probability, and Markov Chains
Uncertainty in AI
Types of Uncertainty
Ambiguity
Imprecision
Incomplete Information
Dealing with Uncertainty in AI
Probability Theory in AI
Basic Probability Concepts
Sample Space
Events
Conditional Probability
Bayesian Inference
Probabilistic Models in AI
Decision Theory
Markov Chains
Basic Definition of Markov Chains
Markov Property (Memorylessness)
Transition Matrix
Absorbing Markov Chains
Applications of Markov Chains
Markov Decision Processes (MDPs)
Components of MDPs
States (S)
Actions (A)
Transition Function (P):
Reward Function (R)
Value Iteration and Policy Iteration
Applications of MDPs
Hidden Markov Models (HMMs)
Components of HMMs
States:
Observations:
Transition Probabilities
Emission Probabilities
Applications of HMMs
Applications of Probability and Markov Chains in AI
Natural Language Processing
Robotics and Autonomous Systems
Reinforcement Learning