Bellman Expectation Equation

The Bellman expectation equation is the cornerstone of policy evaluation in reinforcement learning.