A few months ago the ask landed on my desk that a lot of infra people are getting right now: "The XYZ (Non Tech) teams want to build on our LLMs. Can you give them access to Bedrock?"

Simple enough on paper. AWS Bedrock was already in our account, the models were enabled, IAM can hand out permissions. Ten minutes of work.

Except it isn't ten minutes of work, and if you treat it like it is, you'll regret it in about three weeks.

The two obvious ways to do this

There are basically two, and neither is good once you think past the first user.