SynopsisOpenAI has reportedly halved its AI inference costs through significant optimizations, a crucial development amid rising AI development expenses. While details remain scarce, the company's new custom AI chip, Jalapeño, aims to boost efficiency and affordability. This move is vital for businesses grappling with escalating AI budgets, with Indian firms also exploring cost-saving strategies like smaller models and specialized inference services.Bengaluru: ChatGPT maker OpenAI has reportedly cut its inference cost by half through optimisation mechanisms, at a time when increasing expenses on developing AI models is a pressing concern for their makers and its users.Inference cost is the computational and financial expense of running an AI model to generate output. According to a report from online media platform the Information, the company has applied optimisation to ChatGPT users whoNow Playing
ETtech Explainer: OpenAI is halving inference cost and what this means - The Economic Times
OpenAI has reportedly halved its AI inference costs through significant optimizations, a crucial development amid rising AI development expenses. While details remain scarce, the company's new custom AI chip, Jalapeño, aims to boost efficiency and affordability. This move is vital for businesses grappling with escalating AI budgets, with Indian firms also exploring cost-saving strategies like smaller models and specialized inference services.
130 words~1 min read
