What if the secret to making AI smarter wasn’t retraining it at enormous expense, but simply letting it remember what worked and what didn’t? A new research paper from ByteDance Seed and UC Santa Cruz introduces a technique called Chain-of-Experience (CoE) that does exactly that, delivering a 5.6% average accuracy improvement and a 19% reduction in API costs across eight major language models.
The paper, titled “Chain-of-Experience for Continual LLM Improvement” and submitted on August 18, 2026, describes a system where models accumulate experiential data from their own interactions, including self-generated and environmental feedback, and then reuse that data contextually during inference. No weight updates required.
How CoE actually works
Traditional approaches to improving large language model performance generally fall into two camps: fine-tuning the model’s weights (expensive, slow, and sometimes destabilizing) or prompt engineering (cheap but limited). CoE carves out a third path by preserving earlier attempts and feedback signals within the model’s context window, letting it draw on accumulated experience without any architectural changes.
The researchers tested CoE across eight prominent LLMs, including GPT-5, Gemini-2.5 Pro, and Claude-4.5 Sonnet. Tasks spanned math, coding, and general knowledge, covering the kinds of reasoning challenges where models most frequently stumble.
