By Syam Bandi - Assistant Director of AI Engineering

The Generative AI revolution is here, but for many enterprises in Singapore and Southeast Asia, adoption has hit a hard wall. The barrier isn’t a lack of use cases—it is Data Security and Hallucination Control.

When dealing with highly sensitive domains (like Healthcare, Insurance, or Financial Data), passing raw payloads to external Large Language Models (LLMs) without strict guardrails is a compliance nightmare. Over the last few weeks, I set out to solve this exact problem by architecting a secure, multi-agent conversational platform on Google Cloud.

Today, I’m open-sourcing the reference architecture and the codebase.

The Architecture: Defense-in-Depth for LLMs