Full-access lesson
Pretraining
> A tiny count-based language model reaches training perplexity 2.48 and still loops under greedy decoding. The result separates an in-sample next-token metric from generation behavior; it does not make 2.48 a universal quality threshold.
The complete curriculum
All 12 volumes, companion resources, interviews, and architecture reviews.
Executable engineering practice
Subscriber-only Python, Java, TypeScript, and SQL labs in the isolated runner.