Resources
Papers
- Attention is All You Need (opens in a new tab)
- Formal Algorithms for Transformers (opens in a new tab)
Lectures
- Sebastian Raschka's Lecture on Transformers (opens in a new tab)
- Lets build GPT by Andrej Karpathy (opens in a new tab)
- Transformers - Advanced NLP Lecture (opens in a new tab)
Blog Posts
- Self Attention from Scratch - Sebastian Raschka (opens in a new tab)
- Transformer Code Walkthrough - Mark Riedl (opens in a new tab)