YouTube's New AI-Powered Tool Can Automatically Dub Videos

by Kay Lee

YouTube is taking a step towards making video content more accessible globally with its new AI-powered dubbing tool developed by Aloud, an AI-powered dubbing service from Google's Area 120 incubator. The tool aims to help creators automatically dub their videos into different languages.

The tool works by first transcribing the video, providing a transcription that can be reviewed and edited by the creator. It then translates and generates the dub for the video. The company is testing the tool with hundreds of creators, according to YouTube's VP of Creator Products, Amjad Hanif.

Currently, Aloud supports a few languages including English, Spanish, and Portuguese, with more languages planned for the future. The tool is expected to significantly expand the audience reach for channels, and YouTube is working to improve the dubbing experience by making the translated audio tracks sound more like the original creator's voice, with better expression and lip sync. These enhancements are targeted for release in 2024.

Gmail AI Can Now Help You Write Emails on Your Phone
For users who are short on time and need assistance in writing a complete email, they can provide a prompt, and the AI algorithm will generate a detailed message based on that prompt.
The Internet ProtocolKay Lee

Previously, creators had to rely on third-party dubbing providers, which could be time-consuming and costly. Aloud offers a cost-effective solution within the YouTube platform, allowing creators to reach international viewers by providing dubbed versions of their content.

You can check out the example of Aloud's results in this video.