Volume 2

Volume 2 - Mathematics for AI Engineers

Volume 2 teaches the mathematics AI engineers compute with, on real models and real data: GPT-2 small and Llama 3.1 8B for shapes, costs and gradients, and scikit-learn's bundled digits, breast cancer and diabetes datasets for measurements that run offline. Section 1 covers numbers, vectors and matrices, Section 2 the calculus of training, and Section 3 the probability and statistics behind sampling and evaluation. Each chapter works one mechanism through a real case and a failure story, and the closing Review chapter runs a single training step of a 100-parameter attention head from its forward pass to an interval on the evaluation that judges it.