With access to the latest generative AI models and high-performance accelerated compute in high global demand, AWS customers need tools to take advantage of model availability and capacity across multiple AWS Regions, while still meeting their security and privacy requirements. cross-Region Inference (CRIS) on Amazon Bedrock meets these needs by automatically routing requests across multiple AWS Regions within predefined geographic boundaries. This allows generative AI applications to consume broad capacity in the geography, helping customers to build more resilient applications that reflect their geographic intricacies.

In this post, we dive deeper into cross-Region Inference (CRIS) and explain how customers in Europe can benefit. We highlight features, services, and resources that AWS offers customers to help them align with the local data protection and processing requirements. This includes the General Data Protection Regulation (GDPR) that might apply to their activities while using CRIS.

Cross-Region inference profiles

Cross-Region Inference (CRIS) is a managed capability in Amazon Bedrock that routes model inference requests within supported AWS Regions. Inference profiles are a resource in Amazon Bedrock that define the Regions where the requests can be routed to. These profiles route requests within certain sets of Regions. CRIS routing is designed to optimize model throughput at lowest possible latency overhead.