Meta is introducing AI tools that translate, dub, and lip-sync Reels on Facebook and Instagram in English, Spanish, Hindi, and Portuguese, opening up rapid access for creators to other markets.
Meta is introducing AI tools that translate, dub, and lip-sync Reels on Facebook and Instagram in English, Spanish, Hindi, and Portuguese, opening up rapid access for creators to other markets.
Meta has deployed a system that automatically translates and narrates short videos, and if necessary, adjusts the articulation to fit the new track, as TechRadar reports. The algorithms preserve the creator’s timbre and manner of speaking, so videos in another language sound as close to the original as possible. The translation is marked with a «Translated with Meta AI» badge, and the viewer can turn off the dubbing, lip sync, or return to the original audio track.
Access is free to creators with Facebook pages with 1,000 or more followers and all public Instagram profiles in countries where Meta AI is available. This is a «pure» production without studio costs: you can repost archive videos in different languages, as long as they comply with the platform’s rules. The goal of the feature is to simplify cross-language distribution of educational, musical, and entertainment formats and increase engagement through natural voice and synchronous articulation.
The competitive context is clear. YouTube has long had auto-subtitles and interface translations, but it has not yet offered full-fledged voice dubbing with lip-syncing on a mass scale. TikTok is experimenting with text overlays, but not with voice cloning and lip-syncing. If Meta quickly expands the list of languages and geography of access, Reels could become the standard for cross-language short video.
Meta has been expanding the language capabilities of short formats in recent years: auto-captions and subtitle translation have provided basic accessibility, but it is voice synthesis with voice imitation and optional lip-sync that creates the effect of «local» filming. The platform declares transparency through translation labeling and access control, which should reduce the risks of abuse and confusion between the original and the voiceover. Four languages are supported at launch, and further scaling will determine whether the tool will become an industry standard for content to transcend language barriers.
Previously, dev.ua wrote about how Meta introduced Vibes, a new feed in the Meta AI app and on the meta.ai website. It’s something like TikTok or Instagram Reels, but for sharing and creating short videos generated by artificial intelligence.
