AI papers, in pictures.
Each paper is a handful of short animations with one line under each. Read them in order, from how words become numbers to how assistants are taught to behave.
All papers, in reading order
- Paper 01
Papersword2vec, in five pictures
The 2013 paper that turned words into numbers a computer can compare, shown as five short animations.
- Paper 02
PapersAttention Is All You Need, in eight pictures
The 2017 paper behind today's AI chat models, shown as eight short animations you can watch and poke.
- Paper 03
PapersBERT, in five pictures
The 2018 paper that taught a model language by hiding words and making it guess them, shown as five short animations.
- Paper 04
PapersGPT-3, in five pictures
The 2020 paper that showed a big enough model can learn a task from a few examples in the prompt, shown as five short animations.
- Paper 05
PapersThe RAG paper, in five pictures
The 2020 paper that let a model look things up before answering, shown as five short animations.
- Paper 06
PapersLoRA, in five pictures
The 2021 paper that made it cheap to customise a huge model by training a tiny add-on, shown as five short animations.
- Paper 07
PapersChain-of-Thought, in five pictures
The 2022 paper that showed models answer better when the examples show their working, in five short animations.
- Paper 08
PapersInstructGPT, in six pictures
The 2022 paper that used human feedback to turn a text predictor into an assistant that follows instructions, in six short animations.
- Paper 09
PapersReAct, in five pictures
The 2022 paper that let a model think, use a tool, read the result and think again, shown as five short animations.
- Paper 10
PapersConstitutional AI, in five pictures
The 2022 paper where a model learns to behave from a written list of principles, critiquing and rewriting its own answers, in five short animations.