Resources
This page helps capture reusable resources for the various recipes and topics covered in this 400-level series. This can also include roadmaps to help provide more structured navigation of topics by top-level categories.
Books To Read
This is my list of books to read to build depth of understanding in this space. Keep in mind that the field is evolving rapidly, so content may get outdated if not refreshed.
Videos To Watch
| Title | Year | Notes |
|---|---|---|
| Let’s Build GPT From Scratch (2hr) | 2023 | ▫️ |
| Intro to Large Language Models (1hr) | 2024 | ▫️ |
| Let’s Build the GPT Tokenizer (2hr+) | 2024 | ▫️ |
| But what is a GPT? Visual intro to transformers (30m) | 2024 | ▫️ |
| Attention in Transformers, visually explained (30m) | 2024 | ▫️ |
Courses To Take
1. Deep Learning.AI
I recommend the Deep Learning Short Courses for fast, actionable learning of core concepts from industry experts. Each course takes 1 hour, ranging from 100-level (beginner) to 300-level (advanced). Most require only basic Python knowledge - some need advanced experience with libraries like PyTorch that you can pick up as you go. Courses are listed from oldest to newest - older courses may have deprecated content.
Roadmaps To Learn
This is a list of roadmaps that I find useful to track, to understand the landscape of generative AI and curated paths to follow for structured self-paced learning.
| Roadmap | Description | Notes |
|---|---|---|
| Prompt Engineering Roadmap | Last visited 04/24 | ▫️ |