The 4 Must-Know Creator Updates from Meta Connect 2024: AI Photo Editing, Video Dubbing, & More
Meta / Meta Connect 2024
Meta held its annual developer event, Meta Connect 2024, this week, announcing several updates across AI, VR, and AR. Along with unveiling new devices like Meta Quest 3S, upgrades to Ray-Ban Meta Glasses, and the advanced (though not yet ready for consumers) augmented reality glasses, Orion, the company also shared updates that will be relevant to creators of all sizes, primarily around Meta AI.
Here’s a look at four of the most notable updates, why they matter, and what they mean for creators:
Photos in Meta AI
Meta / Photos in Meta AI
A new feature within the AI assistant allows creators to share photos and ask questions, such as identifying what’s in the photo. Additionally, creators can edit images by instructing the AI to add, change, or remove components. There is also a background feature that will automatically generate backgrounds when creators share a feed post to their Stories.
Why It Matters: This will help creators in several ways, from managing everyday tasks that save time to providing creative support for content creation. The ability to quickly edit photos with prompts gives creators greater flexibility and efficiency when it comes to bringing both new and existing content to life.
Meta AI Translations
Meta / Meta AI Translations
The company is currently testing a translation tool that will automatically translate the audio of Reels into other languages, starting with English and Spanish. It includes dubbing and lip-syncing technology that mimics the speaker’s voice in another language while syncing their lips to match.
Why It Matters: In a move similar to YouTube, creators will be able to overcome language barriers, enabling them to reach larger global audiences without extensive time and effort in translation and production. This feature benefits viewers as well, allowing them to discover and engage with content creators who speak different languages.
Meta Creator AI Video Avatars
Meta / Creator AI Video Avatars
The ability for creators to generate AI-driven digital avatars of themselves is also in development. At the event, the company demoed an AI version of Don Allen Stevenson III, a digital avatar that not only looked like him but also responded and interacted like him. This is expected to be available next year in the US.
Why It Matters: Following the path of TikTok and other AI-driven startups, Meta aims to help creators scale their presence through AI. Building on the launch of its AI chatbots for creators, the company is advancing with lifelike digital avatars that mimic their human counterparts. Although there has been considerable buzz around digital avatars, large-scale adoption hasn’t yet taken off—especially among long-tail creators. With Meta’s massive user base, it could help more creators take advantage of this technology.
Redesigned Facebook & Instagram Apps for Quest
Meta / Instagram & Facebook Quest Apps
The Facebook and Instagram apps for the Meta Quest headsets have been redesigned, introducing a more immersive interface. The updates include improved navigation and the addition of dynamic spartial audio for panels displaying 2D content.
Why It Matters: Meta is now upgrading the overall experience of its core apps for mixed reality. While the company hasn’t prioritized bringing its platforms to TV screens like YouTube and TikTok, it is shifting towards larger screens in mixed reality via its VR headsets. Users will be able to consume creator content in a more immersive way. This also connects the company’s family of apps and operating systems, creating a more integrated ecosystem.
The Bigger Picture
With these new features, creators will be able to scale their businesses and maximize their creativity. They gain new ways to streamline content creation with AI-powered editing while reaching broader audiences through improved accessibility via language dubbing and emerging technologies like realistic avatars.
