Average prices for AI inference have fallen to a low for the year to date, driven by the release of low-cost open-weight Chinese models as well as an increased focus on price-efficiency by US developers, according to research by investment bank Jeffries.
Inference prices per million tokens ranged from $1.16 (£0.86)to $1.18 from 6 to 8 August, the lowest level so far this year, Jeffries said, citing analysis from Silicon Data.
That’s significantly below the $2.04 average on 31 May and the $1.45 average of late July.
Image credit: Microsoft
Downward trend
