Overview of the Program-as-Weights paradigm. Credit: arXiv (2026). DOI: 10.48550/arxiv.2607.02512
Developers are increasingly relying on large language models (LLMs) for everyday computing tasks such as fixing bugs, explaining code and automating text-processing tasks like filtering logs.
However, it's not as simple as entering or submitting a question and relying on the model to give you the answer. While humans easily understand these tasks and know exactly what they want, it is difficult to translate them into rigid computer code.
The cloud dilemma
As standard programming is often not up to the task, developers often use AI to handle jobs that are difficult to express as traditional rules. However, many powerful AI models are too massive to sit inside a laptop or a phone, so developers have to send data over the internet to paid cloud services. But doing this risks exposing private data, can break software if the AI provider updates the model and is expensive.
