Cut LLM prompt tokens on structured data — losslessly
A small, dependency-free tool for shrinking logs, JSON, and CSV in prompts — without dropping a single byte.
Logs, JSON, and CSV are some of the bulkiest, most repetitive things we feed into LLMs. They're also where prompt-token costs quietly pile up.
The trouble with lossy compression
The usual fix is semantic compression: have a model summarize the input and drop "low-information" tokens. It works — until the question needs the data that got dropped.
