I Pointed Chrome's Prompt API at a 1.25 Million Character Memoir, and It Got Interesting Fast

Hello, I'm Shrijith Venkatramana. I'm building git-lrc, an AI code reviewer that runs on every commit. Star Us to help devs discover the project. Do give it a try and share your feedback for improving the product.

A straightforward engineering question: what happens when you feed a long book to an on-device language model in Chrome and start adjusting the parameters?

To explore this, I built a small experiment called Gemini Nano Book Lab: a Chrome extension sidepanel that uses Chrome’s built-in Prompt API to answer questions about Richard Wagner’s My Life, while also exposing some of the underlying mechanics.

The response is only part of it. The experiment also captures:

Model download behavior