Last year Apple gave us an on-device LLM through the Foundation Models framework. This year that on-device model gets better, and Apple adds something many of us asked for: a larger server model you can call directly from your app, running on Private Cloud Compute (PCC).

TL;DR

A new server-class model is now reachable from the same Foundation Models API you already use.

Switching from on-device to server is a one-line change.

You get a 32K context window (vs 4K on-device), reasoning support, and image input.