Recently, I’ve been interested in learning more about reinforcement learning. The impetus for this presentation is this paper, Revisiting Rainbow, that came out at ICML this year, 2021. In it, the authors build on some earlier breakthroughs, so I decided that this would be a good time to review those earlier breakthroughs in more depth, so I could understand this paper better.