Generation, Reinforcement, Pretraining, and Engineering
- Generative Models: Taxonomy & History
- Autoencoders & VAE
- GANs: Generator vs Discriminator
- Conditional GANs & Pix2Pix
- StyleGAN
- Diffusion Models — DDPM from Scratch
- Latent Diffusion & Stable Diffusion
- ControlNet, LoRA & Conditioning
- Inpainting, Outpainting & Editing
- Video Generation
- Audio Generation
- 3D Generation
- Flow Matching & Rectified Flows
- Evaluation: FID, CLIP Score
- Visual Autoregressive Modeling (VAR): Next-Scale Prediction
- MDPs, States, Actions & Rewards
- Dynamic Programming
- Monte Carlo Methods
- Q-Learning, SARSA
- Deep Q-Networks (DQN)
- Policy Gradients — REINFORCE
- Actor-Critic — A2C, A3C
- PPO
- Reward Modeling & RLHF
- Multi-Agent RL
- Sim-to-Real Transfer
- RL for Games
- Tokenizers: BPE, WordPiece, SentencePiece
- Building a Tokenizer from Scratch
- Data Pipelines for Pre-Training
- Pre-Training a Mini GPT (124M)
- Distributed Training, FSDP, DeepSpeed
- Instruction Tuning — SFT
- RLHF — Reward Model + PPO
- DPO — Direct Preference Optimization
- Constitutional AI & Self-Improvement
- Evaluation — Benchmarks, Evals
- Quantization: INT8, GPTQ, AWQ, GGUF
- Inference Optimization
- Building a Complete LLM Pipeline
- Open Models: Architecture Walkthroughs
- Speculative Decoding and EAGLE-3
- Differential Attention (V2)
- Native Sparse Attention (DeepSeek NSA)
- Multi-Token Prediction (MTP)
- DualPipe Parallelism
- DeepSeek-V3 Architecture Walkthrough
- Jamba — Hybrid SSM-Transformer
- Async and Hogwild! Inference
- Speculative Decoding and EAGLE
- Gradient Checkpointing and Activation Recomputation
- Prompt Engineering: Techniques & Patterns
- Few-Shot, CoT, Tree-of-Thought
- Structured Outputs
- Embeddings & Vector Representations
- Context Engineering
- RAG: Retrieval-Augmented Generation
- Advanced RAG: Chunking, Reranking
- Fine-Tuning with LoRA & QLoRA
- Function Calling & Tool Use
- Evaluation & Testing
- Caching, Rate Limiting & Cost
- Guardrails & Safety
- Building a Production LLM App
- Model Context Protocol (MCP)
- Prompt Caching & Context Caching
- Agent State Machines — Graphs, Nodes, Checkpoints
- Agent Framework Tradeoffs