Thomas Piacentini
← Workshop

05 · NLP Foundations

NLP Foundations

Original text · English

Language is the interface to intelligence. Master every layer.

Start this phase on GitHub

Prerequisites: Phase 2 Lesson 14, Naive Bayes. Python 3.11+ is enough for the first lesson.

First lesson: Text Processing

Run this command from the repository root:

bash
python3 phases/05-nlp-foundations-to-advanced/01-text-processing/code/main.py

Keep the command, exit code, token list, stems, lemmas, and one example where stemming loses meaning but lemmatization preserves it.

Next action: Add one sentence with punctuation and an irregular verb, inspect the result, then continue to Bag of Words and TF-IDF.

Browse the full Phase 5 lesson list or the cross-phase roadmap.

Continue step by step.

Code and artifacts 1
What you take away

Saved in your notebook on this device.

Sources and limits

Reading checkpoints are self-reported. Test results are recorded separately and apply to the executed cases.

AI Engineering from Scratch · 3f9715c · MIT

Download this file ↓