Exploration vs Exploitation
Bandit problems:
Algorithms:
Action value:
Either have to remember all the rewards in history, or we can do it incrementally.
Greedy Policy: