Viral Sam Altman deepfakes point to growing AI risks and regulatory needs

This video is uploaded from Frame.io.

Transcript

00:00Just days after the launch of OpenAI's new social app Sora, a flood of deepfake videos featuring

00:04none other than CEO Sam Altman has gone viral, and it's sparking a heated debate about the future

00:10of AI. According to the official website, Sora's signature feature, Cameo, lets users create a

00:16lifelike AI double from the biometric data, with full control over who can use it, whether just

00:22themselves, a few friends, or no one at all. But in a highly unusual move, TechCrunch reports Sam

00:27Altman made his own cameo fully public, allowing anyone on the app to generate videos starring his

00:33likeness. Which is kind of terrifying, but also exciting to see what people come up with. The

00:39results? A wave of surreal and sometimes hilarious deepfakes. Please, I really need this for Sora

00:49inference. This video is too good. But beneath the humor lies something more serious. For starters,

00:54these videos were powered by OpenAI's advanced Sora 2 model, Altman's very own creation,

01:00and their hyper-realism has raised alarms about just how convincing deepfakes have become.

01:04Altman himself has reportedly warned about the dangers of AI deepfakes, especially voice fraud,

01:10which he says has already fully defeated phone-based security. And Forbes warns that the social app and

01:15features of Sora 2 are raising concerns. Even with friend-only safeguards, this isn't like normal

01:20social media where you simply restrict who interacts with your content. Instead, Sora users

01:25are essentially handing someone control over their digital double, which Forbes warns is inherently

01:30risky. OpenAI has responded with safeguards like watermarks, but critics argue the viral Sam Altman

01:36memes highlight the urgent need for stronger AI regulations. And beyond scams, TechCrunch warns

01:42with a looming threat of political deepfakes, which are manipulated videos that could sway public opinion

01:46in an election year. For now, Sora 2 may be entertaining, but it also highlights real risks.

01:52Share your thoughts and follow us everywhere at What's Trending.