Section 1

RAG Foundations

Before the knowledge assistant can answer anything, its 150,000 documents have to become an index. This section decides to retrieve rather than read the whole corpus, trains retrieval embeddings, cuts the documents into about a million 400-token chunks and stores their vectors in an approximate index, measuring at each step what is lost without an error being raised.