LinUCB extends the UCB algorithm to contextual bandits by assuming the expected reward of each arm is a linear function of the context.
