The computational wall AI can't climb

Today's AI term is "complexity ceiling". This is the term that indicates AI agents will never be able to reach the goals that marketing has set for the technology. This derives from a paper by Vishal Sikka, former CEO of Infosys, board member at Oracle and BMW, who studied under the father of AI John McCarthy. Essentially, Large Language Models (LLMs) can only perform a certain number of computations per response. That number is fixed. If a task requires more computational resources than that ceiling allows, the model will either fail or hallucinate. This isn't some theory but it's part of the maths.

Raccontata dabangkokpost.com