On the 10th anniversary of Connect, Mark Zuckerberg, Meta CEO & Founder, shared how the rise of AI and metaverse technologies, are reshaping the way experience the world around them and digital space.
Zuckerberg emphasized that while the physical world around us is amazing —and it’s the combination of our physical and digital worlds that defines our reality.
Yet too often, we rely on screens to tap into virtual spaces and content—and that can pull us away from the moment and the people we’re physically with.
Imagine replacing your TV with a fully customizable home theater you can take with you anywhere. Or sitting around a table with friends, some of whom are in the same physical room while others are avatars of those who live miles away—and yet still feeling fully present in the same space and experience.
Or a meeting where some of the avatars are embodied AIs that can help you accomplish a variety of tasks. All of that could be possible when our physical and virtual worlds come together seamlessly.
Many of the foundational technologies needed to make that vision a reality are either already here or on the way. Mixed reality lets us bring digital objects into the physical world or create fully immersive experiences to explore. Advances in AI let us create unique characters that we can interact with in different ways. And future AR glasses will eventually bring these technologies together in a stylish form factor.
So, during his keynote at Meta Connect 2023, Zuckerberg shared the company’s progress on all three fronts.
1. Mixed Reality Goes Mainstream with Meta Quest 3
Zuckerberg was all smiles as he bragged about Meta Quest 3ibeing the world’s first mainstream headset built for mixed reality—and the company’s most powerful headset yet.
With double the graphic processing power of Quest 2, Meta Quest 3 is also the world’s first device to feature the new Snapdragon XR2 Gen 2 platform we helped develop in collaboration with Qualcomm Technologies.
“And it’s completely standalone: no PC, no console, no battery packs—nothing to break the feeling of presence. It understands your physical space, so you can play with the world around you.
“With mixed reality, the limits of your physical space can expand, and you can be part of a much larger world—like opening a portal to the Upside Down from your living room in Stranger Things VR.
“With Quest 3, you can immerse yourself in an expansive content library with games and experiences to suit every taste and mood. More than 100 new and upgraded titles are coming to Quest 3 this year, and many of them will incorporate mixed reality. Because Quest 3 is backwards-compatible, you get access to a vast library of 500+ VR and MR experiences on day one.
And with Xbox Cloud Gaming coming to Quest in December, you’ll be able to play Halo Infinite, Minecraft Legends, Forza Horizon 5, and hundreds of other high-quality Xbox games—all on a massive 2D screen you can take with you anywhere.”
Starting at $499.99 USD, Quest 3 ships October 10, and pre-orders are open now.
2. Advances in Artificial Intelligence
Zuckerberg also said while it’s been an amazing year for AI, most people today still haven’t experienced this new technology firsthand—and Meta has an opportunity to change that by building state-of-the-art AI into apps that billions of people already use.
“We’ve talked about the Llama ecosystem of large language models, and today we unveiled our image generation model. Emu (short for Expressive Media Universe) uses your text prompts to generate high-quality, photorealistic images in just seconds. And thanks to Emu and technology from Llama 2, you can create your own custom AI stickers in chat to liven up conversations on the fly”, the CEO communities who joined the streaming.
Meta also introduced restyle and backdrop—two new features coming soon to Instagram that use the technology from Emu to let you transform your photos or even co-create AI-generated images with friends. Isn’t that going to be interesting?
Restyle lets you reimagine your images by applying the visual styles you describe (you might type out “watercolor” or “collage from magazines and newspapers, torn edges,” for example), while backdrop leverages learnings from the Segment Anything Model so you can change your image’s scene or background.
Images created with restyle and backdrop will indicate the use of AI to help reduce the odds of people mistaking them for human-generated content.
“We’re also experimenting with forms of visible and invisible markers to help people distinguish AI-generated content.“
Unlike most others in the industry, we don’t believe there will be one single super-intelligent AI that everyone uses. Rather, we think you’ll want different AIs for different things, like finding information, communicating, being entertained, playing games, helping you get work done, and more. You might even want to create your own AI that’s aligned with your goals, whether you’re a small business, a creator, or anyone really.
“That’s why we’re building AI studio—a new platform for creating AIs that can help you get things done and just have fun. People will be able to interact with these AIs across the whole Meta universe of products. They’ll have profiles on Instagram and Facebook, and you’ll be able to chat with them in WhatsApp, Messenger, and Instagram. Eventually, they’ll be embodied as avatars in the metaverse too.
“We’ve created some AIs of our own using AI studio that we’ll start rolling out in the US in beta today.
Meta AI is a new assistant you can interact with like a person. It uses a custom model based on Llama 2 technology and has access to real-time information through a partnership with Bing search. And Emul is built into Meta AI, so you can generate high-quality photorealistic images for free in seconds.
“We’ve also been creating AIs that have more personality, opinions, and interests, and are a bit more fun to interact with. There’s Victor, a motivational coach who encourages you to hit your goals. The Dungeon Master can take you on an old-school text-based adventure. And our sous chef Max can take the random assortment of ingredients in your pantry and come up with a delicious recipe on the fly.
“Those are just a few of the AIs we’ve trained so far, and there are several more coming over the next few weeks across a range of interests, from gaming and philosophy to sports, fashion, and beyond.
Generative AI, Zuckerberg said, will bring with it new challenges, “so we’re putting in the time and effort to make sure we get this right. That includes training and fine-tuning models to fit our safety and responsibility guidelines, red-teaming with external experts and internal teams to help ensure our models are safer and more inclusive, programming in guardrails around inappropriate conversations, and sharing system cards publicly so people better understand how these models work.
“This next generation of artificial intelligence will enable a wide range of experiences and interactions, which will transform how people, businesses, and creators use all of our products. And we’ll continue innovating to ensure everyone has a chance to participate in the upside. Click here to learn more.
3. Introducing the Ray-Ban | Meta Smart Glasses Collection
Built in partnership with EssilorLuxottica, our next generation of smart glasses are designed so you can stay connected and capture the moment without having to stop and take out your phone—and easily share your experiences with friends, family, or the world.
“We’ve upgraded them from the first generation in basically every way, and for the first time, you’ll be able to livestream directly from your smart glasses to your friends and followers on Facebook and Instagram.
Continuing, Smart glasses will be an important platform in the future not only because they’re a natural way to see digital holograms in the physical world, but also because soon you’ll be able to let your AI see what you see and hear what you hear—which will make your smart glasses more useful over time.
“Starting at $299 USD, the Ray-Ban Meta smart glasses collection will launch on October 17, and they’re available for pre-order today on meta.com and ray-ban.com.
