As foundation models continue to improve, I think AI engineering is starting to look far more like distributed systems engineering.

The difficult part usually is not the model itself - it is everything around it:

Orchestration

Retries

Queues