Home
Storia in 1 fonti
Memory beats full context on LongMemEval — and the wins we don't get
Our first official benchmark runs — +14.2 points over a full-context baseline on LongMemEval at ~39× fewer tokens, plus the LoCoMo case where full context still wins.
Raccontata da
dev.to
Timeline cronologica
- ·
Memory beats full context on LongMemEval — and the wins we don't get
Our first official benchmark runs — +14.2 points over a full-context baseline on LongMemEval at ~39× fewer tokens, plus the LoCoMo case where full context still wins.
- ·
79% on LongMemEval: How We Beat Full-Context GPT-4 with a Local SQLite Database
A benchmark result that changes what we thought was possible for local persistent agent vector...