TensorTonic
Problems

Expected SARSA

Apply Expected SARSA updates using the epsilon-greedy expectation over next-state action values.