The Problem with Forgetting
Every time you start a new conversation with an LLM, it forgets everything. No memory of your preferences, your codebase, your past mistakes, or your project context. You end up repeating yourself — pasting long system prompts, re-explaining your stack, re-establishing constraints.
This isn't a bug. It's a fundamental architectural choice: stateless inference is cheap and parallelizable. But it's increasingly at odds with how developers actually want to use AI tools.
What's Emerging in 2026
A few different approaches are gaining traction to solve this:
