Models that see, hear, read, and reason across modalities.
Start this phase on GitHub
Prerequisites: Phase 7 Transformers and Phase 4 Computer Vision.
First lesson: Vision Transformer Patch Tokens
Run this command from the repository root:
bash
python3 phases/12-multimodal-ai/01-vision-transformer-patch-tokens/code/main.pyKeep the command, exit code, patch grid and sequence lengths, parameter counts, and one sentence explaining why higher resolution creates more visual tokens.
Next action: Change one image or patch size, predict the sequence length, then continue to CLIP and Contrastive Pretraining.
Browse the full Phase 12 lesson list or the cross-phase roadmap.