Meta revolutionizes content creation with its recent innovation in audio translation using artificial intelligence. This advancement allows for sophisticated lip synchronization in Reels, thereby enriching the user experience. Adding manual audio tracks to broaden the audience is now within reach of creators, offering them unprecedented control over their productions. The Meta AI Translations tool aims to set a new standard in the realm of video multilingualism.
Meta AI Translations: a major advancement in content creation
Meta is rolling out a new feature, Meta AI Translations, that revolutionizes how creators make Reels on Facebook and Instagram. This innovation enables automatic audio translation using artificial intelligence. Users will have the option to publish videos in one language, with lip synchronization to give the impression that the voice belongs to the author.
Automated audio translation and lip synchronization
Creators have the opportunity to publish a Reel in one language, such as English or Spanish, and benefit from instant translation in the other language. The AI preserves the tone and timbre of the original voice for a more natural and authentic output. A lip synchronization feature complements this set, aligning lip movements with the translated voice, allowing for a more immersive experience.
To activate this feature, a simple press of the “Translate your voice with Meta AI” button is sufficient before publishing. This option relies on the advanced technology developed by Meta, ensuring that users share translated content dynamically. Viewers automatically see the adapted version according to their language preferences.
Option to add up to 20 manual audio tracks
Additionally, Meta also offers the option to manually add up to 20 translated audio tracks to a Reel. This classic option allows creators to upload voice-overs done by professionals or external services. Although lip synchronization is not integrated into this approach, creators have full control over the final rendering of the broadcasted content.
Audio tracks can be added, replaced, or deleted at any time, allowing for maximum flexibility. Facebook Page managers, as well as creators who have opted for professional mode, are the only ones who can benefit from this feature. It remains inaccessible for personal accounts or creators limited to Instagram.
Access and availability of the feature
Currently, Meta AI Translations is available to all public accounts on Instagram and to Facebook creators with more than 1,000 followers. However, this feature has not yet been rolled out within the European Union, which is sought after for that purpose. The initial deployment focuses on English and Spanish, with future plans to include more languages.
Detailed statistics by language are available in the Insights tab, allowing creators to measure the impact of these translations on new audiences. This initiative shows Meta’s commitment to addressing the diverse linguistic needs of its community.
Increased competition in the short video market
This innovation falls within a competitive context, as social platforms compete to attract creators. TikTok has begun testing automatic subtitle translations, without including voice dubbing. YouTube, for its part, offers multi-language audio tracks but without automatic synchronization.
Meta stands out with its combination of automated and manual solutions, thus enhancing the attractiveness of Reels against competitors such as TikTok or YouTube Shorts. Through its innovations, Meta aims to remain at the forefront of translation and the distribution of multilingual content.
Frequently asked questions about Meta’s AI audio translation feature
What is Meta’s new AI audio translation feature?
This is a tool that allows content creators to automatically translate their voice in Reels while maintaining lip synchronization, to provide an immersive experience for Facebook and Instagram users.
How does lip synchronization work in translated Reels?
Meta’s technology aligns the creator’s mouth movements with the translated audio, giving the impression that the person is actually speaking the destination language for a more natural appearance.
In which languages will automatic audio translation first be available?
Initially, the feature will be available for English and Spanish, with the promise to add other languages in the future.
Can I use manually created audio tracks in addition to the automatic translation?
Yes, creators can add up to 20 manually translated audio tracks per Reel to customize their content, although this does not include lip synchronization.
What is the procedure to activate the audio translation feature before publishing a Reel?
Before sharing a Reel, a button titled “Translate your voice with Meta AI” will trigger the translation, with the option for lip synchronization enabled or not.
Who will have access to the audio translation and manual track functionality?
The feature will be available to all public Instagram accounts and some creators on Facebook with at least 1,000 followers, but not in the European Union for the moment.
Can users check or decline the translation proposed by Meta?
Yes, creators can review and approve the translation before publication, without affecting the original version of their video.
Can AI audio translations affect the reach of my Reels?
Language-specific statistics available in the Insights tab will allow creators to measure the impact of these translations on engagement and the reach of their content.
Does Meta plan to add other features related to audio translation?
Although Meta has not provided a specific timeline for future updates, the company has indicated that it plans to integrate more languages and improvements into its AI-based content creation tools.
