Async LLM inference in CI: stop build workers blocking on slow jobs

TL;DR: Async inference through an AI gateway lets CI build workers submit a long LLM job, get an id...

Raccontata dadev.to