Ora Computing, an Austrian startup, has secured €3.5M in seed funding to bring to market software that can shrink large AI models by up to 80% without much loss of accuracy.
The company managed to compress a 70-billion-parameter model for less than $1,000. This process usually costs hundreds of thousands of dollars, showing a clear cost advantage over current tools.
With AI inference costs reaching tens of millions of dollars per month for large-scale use, Ora’s technology could help reduce both energy use and computing costs.
Running large AI models is expensive. For companies operating at scale, compute costs can reach tens of millions of euros per month and continue to rise as models get larger.
Two quantum computing researchers at a top European science institute think the answer is to use smaller models rather than build more infrastructure. Their startup, Ora Computing, raised €3.5M in seed funding from Constructor Capital and Greencode Ventures to prove this idea.
