RAG Powered Apps with Amazon Bedrock, Part 2: Automating the RAG Pipeline with Terraform

Before you start: This picks up where Part 1 left off. From part 1, you would've learned how to setup a Bedrock Knowledge Base in the console. In addition to that, you should have a general understanding of how the ingestion and query pipeline works.

Introduction & Motivation

I started this project with a singular goal: to build a comprehensive Terraform module that allows developers to deploy the entire infrastructure for a "Chat with PDF" application faster.

When Amazon Bedrock was first unveiled in April 2023, I jumped in immediately. Like many of you, I built several proof-of-concepts (PoCs) through the AWS Console. The UI is amazing for building quick pocs, but once I moved into experimentation, I realized it would be best to quickly setup and tear down the infra.

An example use case was testing if there were any cost savings in using S3 Vectors vs OpenSearch and how much cost savings exactly.

RAG Powered Apps with Amazon Bedrock, Part 2: Automating the RAG Pipeline with Terraform

Other newsrooms on this story

Related reading

A Real RAG Pipeline on AWS: Internal Docs Q&A with Terraform (Model-Agnostic) 🔍

A Real RAG Pipeline on GCP: Internal Docs Q&A with Terraform (Model-Agnostic) 🔍

Build a Production RAG System on AWS Bedrock from Scratch

Anatomy of a Full RAG Application: Every Concept, One Self-Hosted Stack

[Databricks on AWS #6] How We Structure the Terraform: Terragrunt, YAML-Driven…

Terraform for AI generated code