AI-powered dubbing is making its way to YouTube. (Photo by Alexander Shatov on Unsplash)
YouTube is rolling out a new feature that allows creators to easily copy their videos into other languages using artificial intelligence.
YouTube is rolling out a new feature that allows creators to easily copy their videos into other languages using artificial intelligence.
As reported by The Verge, at VidCon, the video giant said it is integrating the team at Aloud, an AI-powered dubbing tool created in Google’s Area 120 incubator.
YouTube, as a platform that prioritizes content creators, is very diverse. However, the inability to connect with a certain demographic because they can’t speak a certain language can limit a creator’s reach. This tool can prove to be quite useful for a wide range of creators.
How does YouTube’s new dubbing tool work?
Aloud first transcribes the video, then creators get a transcript they can review and edit later. Later, the tool finally translates the edit and generates a dub.
Amjad Hanif, VP of Creator Products at YouTube, claims the company is already testing Aloud’s tool with “hundreds” of creators.
More support expected soon
YouTube notes that the service currently only supports a few languages, but support for more is on the way.
Currently, the tool only supports English, Spanish, and Portuguese.
YouTube is also working to make the dubbed videos “sound like the creator’s voice, with more expression and lip syncing,” Hanif said.
In related news, OpenAI, the creator of ChatGPT, may have used YouTube to train its large language models like GPT to generate better responses, according to a report from The Information.