Meta Muse AI Agent Expands With Smart Glasses, Email, Shopping and Desktop Features

6 min read

Meta is moving quickly to expand Muse, its new personal AI agent, just weeks after introducing the service. At the company’s annual Connect event in Menlo Park on Wednesday, CEO Mark Zuckerberg outlined a much broader vision for the technology, positioning Muse as a central part of Meta’s long-term consumer AI strategy.

Muse is designed to perform everyday tasks on a user’s behalf by connecting with services such as email, calendars and other apps. Meta announced a series of new features and partnerships at Connect that could make the assistant a more persistent presence across a user’s digital life.

The company also plans to bring Muse to its smart glasses, allowing people to interact with the AI through voice commands while going about their day.

According to Zuckerberg, the long-term goal is much bigger than simply creating another chatbot. He described Muse as a potential personal AI system that could eventually be used by billions of people to help them accomplish tasks and pursue their goals.

Meta Wants Muse to Become a Personal AI Assistant

Muse launched in early September and is designed to work across a user’s devices and digital accounts. The system is powered by Muse Spark, Meta’s multimodal AI model built for tasks that require an AI agent to take action rather than simply respond to questions.

The company has presented Muse as an accessible alternative to more specialized AI agents, with an emphasis on handling routine digital work for users.

Zuckerberg said Meta expects the service to remain free for a large amount of usage initially. The company could eventually generate revenue by taking a small fee from transactions completed through the assistant.

That approach would give Meta a potential business model beyond traditional advertising, particularly if Muse becomes involved in shopping, bookings and other online transactions.

Muse Avatars Will Give the AI a Face

One of the more unusual announcements at Connect was the introduction of personalized digital avatars for Muse.

Users will eventually be able to create a distinct avatar representing their AI agent and interact with it through real-time video conversations. Meta says a new model called Muse Realtime Avatar will power the experience.

The move gives Meta’s previously screen-based AI a more recognizable face and voice. During the Connect demonstration, the avatar was shown having live conversations with a user, answering questions and receiving instructions.

The feature also fits with Meta’s broader interest in digital avatars and virtual experiences, areas that have been central to the company’s long-term metaverse strategy.

Muse Is Coming to Meta’s Smart Glasses

Meta is also bringing Muse to its smart glasses, allowing users to communicate with the AI without reaching for a phone or computer.

The assistant will be activated using a wake word and is expected to handle a variety of practical requests. Meta demonstrated examples including personalized workout guidance, meal logging, appointment booking and helping users purchase products they encounter.

The company says Muse will also be able to continue working in the background. Instead of requiring users to remain engaged with the assistant, it can carry out a task and return later with an update when the job is finished.

Meta has not provided an exact launch date for the glasses integration, saying only that the feature is expected to arrive in the coming months.

Muse Will Be Able to Operate a Mac

Meta is also expanding Muse beyond phones and other mobile devices.

The company confirmed that computer-use capabilities are coming to Mac. Once available, Muse will be able to interact with applications on a user’s desktop and carry out tasks on their behalf.

Alexandr Wang, Meta’s chief AI officer, said the feature could be useful for everything from running a small business to completing everyday work.

The idea is that users will be able to assign several jobs to Muse, walk away from their computer and allow the agent to continue working without constant supervision.

That puts Muse in competition with a growing class of AI systems designed to operate computers rather than simply generate text or answer questions.

Muse Is Getting Its Own Email Address

Meta also revealed that Muse will eventually have its own email address.

The company says the feature is being developed and will arrive soon, although it did not give a specific launch date.

Having a dedicated email address could make it easier for Muse to participate in digital workflows. Users will be able to add the AI to email conversations or forward messages to it so the agent can handle tasks on their behalf.

The addition is another indication that Meta wants Muse to function as an ongoing digital assistant rather than an AI tool that users open only when they have a question.

Meta Expands Muse Into Online Shopping

Shopping is another major part of Meta’s plans for Muse.

The company has established partnerships with payment and commerce companies including Stripe and Shopify. According to Wang, Muse can access Shopify’s product catalog and assist with purchases through supported payment systems, including Shop Pay. Meta also said it has expanded payment support through PayPal.

The company announced additional retail partnerships with Best Buy, Gap, Sephora, Walmart and Wayfair.

Muse will also be able to connect with retail applications and services such as Expedia, with support for Instacart planned for the future.

The broader goal is to allow users to ask Muse to find products, make purchases and complete other transactions without manually navigating multiple websites and applications.

Developers Can Build Connections for Muse

Meta is also opening Muse to third-party developers through what it calls connectors.

These integrations are intended to allow Muse to work with a wider range of services and applications. Among the companies and platforms mentioned by Meta are GitHub, Granola and Notion.

The company says it received more than 1,500 applications from developers within less than a week of opening the platform.

Wang described the developer response as a major opportunity to establish a new software platform around AI agents.

For Meta, the strategy is clear: rather than limiting Muse to the company’s own services, the company wants the assistant to become a layer that can interact with a much wider digital ecosystem.

Meta’s Bigger Bet on Consumer AI

The announcements at Connect show that Meta is treating Muse as much more than another AI chatbot.

The company is building the assistant into multiple parts of the digital experience, from email and desktop applications to online shopping and smart glasses. Personalized avatars could add another layer by giving users a more human-like way to interact with their AI.

Meta is also building the commercial infrastructure around Muse, with payment providers, retailers and third-party developers becoming part of the ecosystem.

The technology is still relatively new, and several of the features announced at Connect have yet to receive specific release dates. But Meta’s direction is becoming increasingly clear: it wants Muse to move beyond answering questions and become an AI agent capable of taking action across the services people use every day.

If Meta succeeds in connecting those pieces, Muse could become one of the company’s most ambitious consumer AI projects yet.

Leave a Comment