Local AI has a comforting story: the model runs on your machine, the prompt does not go to a cloud vendor, the code stays nearby, and the demo works on an airplane.
I like local AI.
I also think we are underpricing what it adds to the developer machine.
Docker's security announcements this year include a small cluster of fixes around Docker Model Runner: container-to-host code execution in two inference backends, SSRF in the OCI registry client, and runtime flag injection. Model Runner is the kind of feature developers are going to want. It can pull models from Docker Hub, OCI registries, and Hugging Face, serve them through OpenAI and Ollama-compatible APIs, package model files as OCI artifacts, and connect to coding tools.
That is useful. It is also a lot of trust crossing one laptop.
