OpenAI has found a way to cut inference costs by half, easing the financial burden of running large language models as compute spending threatens billions

We closely track efforts by Anthropic, Google and OpenAI to get access to more server chips to run their models. But we don’t talk enough about the work these companies are doing…

OpenAI has found a way to cut inference costs by half, easing the financial burden of running large language models as compute spending threatens billions