As a backend developer, I have build hundreds of endpoints, so the typical endpoint flow is deeply ingrained in how I think about web applications. But when I started building AI-powered endpoints, I noticed an interesting shift.

At first, AI endpoints looked like simple proxy endpoints with some configuration for connecting to a model:

API receives request

send prompt to model