Meta's Voice Revolution: AI Translations and Celebrity Tones

Imagine having a conversation with AI that sounds like your favorite celebrity or even translates languages in real-time. Meta has taken a huge leap forward in artificial intelligence by introducing voice-activated interactions with its AI assistant. At the Meta Connect 2024 conference, the company revealed that Meta AI can now respond to questions out loud across various platforms, including Instagram, Messenger, WhatsApp, and Facebook. When you engage with Meta AI, you'll have the option to choose from a range of voices, including those of renowned celebrities like Awkwafina, Dame Judi Dench, John Cena, Keegan-Michael Key, and Kristen Bell. This new feature is not like OpenAI's Advanced Voice Mode, which can detect emotion and tone in a person's voice. Instead, it's more similar to Google's Gemini Live, which transcribes speech and then reads out answers using a synthesized voice.

Meta's decision to use high-profile talent might be a gamble, but it's clear they're willing to invest in making their AI assistant stand out. The company reportedly paid millions for the use of celebrity likenesses, so it will be interesting to see if this investment pays off. In other exciting updates, Meta AI can now analyze images thanks to upgraded AI models. This means you can share a picture of a flower and ask Meta AI to identify it, or upload a photo of a dish and get cooking instructions. Keep in mind that you might occasionally get incorrect answers, but it's still a significant improvement. Meta is also piloting a translation tool that automatically translates voices in Instagram Reels. This feature dubs a creator's speech and auto-lip-syncs it, simulating the voice in another language and ensuring that the lip movements match. The company is starting with small tests on Instagram and Facebook, initially focusing on creators' videos from Latin America.

Actions