Thompson sampling for a Bernoulli multi-armed bandit keeps a Beta posterior over each arm's success probability.
