A complete walkthrough of speech transcription, LLM inference, tokenization, and 4-bit quantization....
A complete walkthrough of speech transcription, LLM inference, tokenization, and 4-bit quantization. Built with Whisper, Llama 3.2, and the HuggingFace ecosystem.
Skill level: Intermediate | Runtime: Google Colab T4 GPU | Models: Whisper-medium, Llama-3.2-3B
Table of Contents
The Two-Step Pipeline
Tokenization
For my 4rd-year Software Engineering final project at university, I’m building an AI Meeting...
I built a real-time Voice AI assistant that listens, thinks, and talks back — using entirely...
Together AI built the fastest speech-to-text stack on Artificial Analysis by treating ASR as a full-path systems problem, not…
Eighteen months ago, we thought we were building a simple voice memo app. We were wrong about the...
In April 2026 Google shipped Gemma 4, a multimodal model with a native audio path. I wanted to add it...
A complete breakdown of Hoovik: WebRTC signaling, distributed Node.js with Redis, real-time emotion...
