What you need to know about “AI-generated voices.”
Debbie Shelton Moore picked up the phone and heard the sound of her frightened 22-year-old daughter’s voice calling for help. Then a man took the phone and demanded ransom.
“The man had said, ‘Your daughter’s been kidnapped and we want $50,000,'” the Georgia mother told 11Alive, an Atlanta NBC affiliate. “Then they had her crying, like, ‘Mom, mom’ in the background.”
“It was her voice and that’s why I was totally freaking out,” Shelton Moore continued.
But it wasn’t her daughter on the phone. It was an AI-generated clone of her voice made to scam the worried mother.
As AI has grown in popularity, criminals around the country have been using the technology to create fake voices in blackmail scams. One in four people have experienced a scam involving a voice cloned through AI or know somebody that has, according to a May McAfee survey of 7,000 people.
In March, scammers in two incidents in Arizona demanded ransom after using AI-generated voices of family members.
In Shelton Moore’s case, the number that appeared on her phone was from the same area code where her daughter, Lauren, lived. The panicked Georgia mother believed her daughter had just gotten in a car accident.
“My heart is beating and I’m shaking,” Shelton Moore said of the moment when she received the ransom call. The voice of her daughter “was 100% believable,” she continued, “enough to almost give me a heart attack from sheer panic.”