How deterministic context batching reduced approximate token usage by ~81.7% while building...
How deterministic context batching reduced approximate token usage by ~81.7% while building an agentic API testing prototype
See It in Action
I also recorded a short demo showing the complete workflow, from loading the OpenAPI specification to generating and executing tests, and auto healing:
Watch the demo on YouTube
I originally built this as part of my GSoC 2026 proposal for foss42.
Author(s): Garvit Agarwal Originally published on Towards AI. Optimizing LLM Token Costs in Production: A Practical Engineering…
Every developer building with Large Language Models eventually hits the same painful reality: the API...
Every AI agent ships mountains of context to the model on every request, and most of it is noise. You...
Over the last year, large language models shifted from experimental prototypes to core backend...
Stop Burning Your AI Limits: A Token Diet for Long Coding Days A 3-tier framework for...
As someone who is constantly exploring ways to make AI applications faster and cheaper, I found...
