Andrej Karpathy recently shared a fascinating concept called the "LLM Wiki"—a brilliant shift from how most of us currently interact with our documents.
Right now, the standard approach is RAG (Retrieval-Augmented Generation). You upload files, ask a question, and the LLM retrieves chunks to generate an answer. It works, but there's a catch: the LLM is rediscovering knowledge from scratch every single time. Nothing compounds.
Enter the LLM Wiki approach: 🧠
Instead of raw retrieval at query time, the LLM acts as a dedicated maintainer of a persistent, structured, and interlinked markdown wiki.
Here is how it changes the game:
