The call comes from a number you don’t recognise, but the voice you do. It’s your daughter, or your father, or your boss, and they’re in trouble — a crash, an arrest, a locked account — and they need money now, and please don’t tell anyone. Every instinct you have is built to respond to that voice. And increasingly, that voice is software.
Answer first, because this is a topic where the useful information is simple and the panic is not. AI voice cloning has taken a very old confidence trick — the impostor pretending to be a loved one in a crisis — and removed its two big limitations: the need to sound like the person, and the need to do it one call at a time. A short clip of someone’s voice, scraped from a video or a voicemail, is now enough to generate a convincing imitation, and the tools to do it are cheap, fast and barely gated. The good news is that the defence hasn’t changed and doesn’t depend on any clever technology: you verify through a second channel you already trust, and you treat urgency plus secrecy plus money as the tell it has always been.
This is a piece about a downside that isn’t really the fault of the person being scammed, and mostly isn’t the fault of any single AI company either — but it is a downside the industry helped build, by shipping a genuinely dangerous capability with a consent check you could defeat by clicking “yes.” We’ll be fair about the legitimate uses. We’ll also be clear about who made it this easy.
