YouTube is taking a step towards making video content more accessible globally with its new AI-powered dubbing tool developed by Aloud, an AI-powered dubbing service from Google's Area 120 incubator. The tool aims to help creators automatically dub their videos into different languages.
The tool works by first transcribing the video, providing a transcription that can be reviewed and edited by the creator. It then translates and generates the dub for the video. The company is testing the tool with hundreds of creators, according to YouTube's VP of Creator Products, Amjad Hanif.
Currently, Aloud supports a few languages including English, Spanish, and Portuguese, with more languages planned for the future. The tool is expected to significantly expand the audience reach for channels, and YouTube is working to improve the dubbing experience by making the translated audio tracks sound more like the original creator's voice, with better expression and lip sync. These enhancements are targeted for release in 2024.
Kay Lee
Previously, creators had to rely on third-party dubbing providers, which could be time-consuming and costly. Aloud offers a cost-effective solution within the YouTube platform, allowing creators to reach international viewers by providing dubbed versions of their content.
You can check out the example of Aloud's results in this video.
