Hello, I'm Shrijith Venkatramana. I'm building git-lrc, an AI code reviewer that runs on every commit. Star Us to help devs discover the project. Do give it a try and share your feedback for improving the product.
Every few months, a new LLM appears claiming to be 2× faster, 3× cheaper, or capable of serving millions more tokens per second.
Many developers assume the gains come from better GPUs or smaller models.
Often, the real answer is far less glamorous:
Someone removed a few trips to memory.
