Facebook and Instagram: AI Voice Translation for Everyone

Meta has announced the global availability of the feature demonstrated at its Connect conference in late September 2024. Using artificial intelligence, it will enable automatic voice translation for reels on Facebook and Instagram. The Menlo Park-based company also confirmed The Information 's report about a restructuring of its AI division.

Voice translation with lip syncing

The feature allows content creators to automatically dub and sync reels into another language. This will help them reach more people and increase their follower count. Meta AI Translations , available for reels on Facebook and Instagram, uses the original sound and tone of voice.

Content creators can also enable lip syncing . The translated audio synchronizes with lip movements, resulting in greater realism because it sounds like the original language. AI translation is initially available from English to Spanish and vice versa. More languages will be added in the coming months. Adam Mosseri, head of Instagram, posted an English video and a corresponding Spanish version on Threads.

You can choose the relevant options that appear before publishing a reel. You can also preview the result. Followers can switch to the original language version. To use the feature on Facebook, you need at least 1,000 followers, while on Instagram, it is accessible to all users with a public account.

The Menlo Park-based company has divided Meta Superintelligence Labs (MSL) into four groups. According to internal communications seen by Bloomberg, these are their names and their respective roles:

• TBD Lab (led by Chief AI Officer Alexandr Wang): will oversee Meta's large language models, including the Llama tools used by the AI assistant.
• FAIR (Fundamental AI Research) : an artificial intelligence research laboratory that has been operating within the company for over a decade and works on long-term projects.
• Products and Applied Research : A team led by former GitHub CEO Nat Friedman will apply modeling and research to consumer products.
• MSL Infra : Developing the infrastructure needed to support AI projects.

According to the New York Times , Meta may reduce its headcount and use third-party “closed source” models.