2 min read

A concise RL book now ships with PyTorch code

The Little Book of Reinforcement Learning pairs a short intro to RL with PyTorch implementations from MC to PPO.

Image: Hacker News

The Little Book of Reinforcement Learning is a short introduction to reinforcement learning, covering the field from core concepts to applied algorithms, with a companion GitHub repository that also includes supporting material.

According to the project page, the repo contains:

  • the book itself
  • PyTorch-based implementations in the algos/ folder for the algorithms covered in the book, ranging from MC to PPO
  • additional material in supplementary/, including detailed explanations and rigorous proofs for the dynamic programming algorithms only briefly covered in the book

The author says the document was originally written in 2021, and that more material may be added to the repository over time. The page also links to a printable version of the book.

The listed version is V1 (June 2026), and the book is distributed under the CC BY-SA 4.0 non-commercial Creative Commons license.

Recommended reading

Hassabis says STEM makes you 10x better at AI

Ava Chen

AI Editor

Ava covers the rapidly evolving world of artificial intelligence, from foundational models and research labs to the real-world economics of intelligence. With a background in computational linguistics, she cuts through the hype to find out what actually works. She firmly believes that benchmarks are just marketing until reproduced in the wild.

via Hacker News

// Keep reading