I built an LLM cost tracker on my laptop at Hyderabad airport
We had a layover in Hyderabad. Long one. Like six hours. I had my laptop and an idea I'd been sitting on.
The problem
I build stuff with LLMs. Chatbots, summarizers, agents that check if my homework makes sense. But you never know what it costs until the bill comes. You call GPT-4o, it works, you call it again, it works again, you ship it, and then your dad asks about the credit card.
I wanted cost to show up in real-time. In the terminal. Without changing my code. Two lines:






