Mission Astra started as an formidable analysis venture designed to bolster Google’s AI efforts when it was first introduced final yr. Now, it is a product you possibly can truly use as Gemini Reside on hundreds of thousands of smartphones — each iOS and Android units. Nevertheless, there’s much more to Mission Astra than the reside video and display sharing capabilities that not too long ago turned out there for Gemini customers.
Targeted initially on bringing versatile, multimodal AI capabilities to Android, Mission Astra has developed right into a far-reaching analysis venture aimed toward attaining Google’s imaginative and prescient for a common AI assistant. Which means Mission Astra is engaged on key AI options like agentic intelligence, native audio, reminiscence, accessibility, instrument use, and rather more.
In different phrases, the upgraded Gemini Reside expertise is not the end line for Mission Astra — it is just the start. Should you’re inquisitive about all Mission Astra encompasses and the way it’ll have an effect on platforms like Android and Android XR, you are in the fitting place. Let’s break down all the pieces you could find out about Mission Astra and how one can attempt it now.
Mission Astra: What’s it?
Mission Astra is understood for just a few high-profile purposes already, however Google’s definition of the venture is easy. It is a “analysis prototype exploring breakthrough capabilities for Google merchandise — on the way in which to constructing a common AI assistant,” in accordance with the Project Astra website.
That is a imprecise rationalization of Mission Astra, and it is most likely on function. Whereas the venture started as a vector for testing multimodal Gemini assist for reside audio and video, it is expanded to grow to be rather more. Now, elements of Project Astra are operating under the Gemini app arm at Google, like those engaged on Gemini Reside. Others are nonetheless engaged on experimental prototypes and purposes for Google DeepMind.
Listed here are just a few Mission Astra options and purposes we at present find out about:
- Multimodal reside video and display sharing assist (Gemini Reside)
- Native audio dialogue
- Proactive responses with out lag or interruption
- Context-aware dialogue
- Agent highlighting that understands the context of your gadget display
- Instrument use and interface management to finish actions in your behalf
- Personalised reasoning particular to the consumer
- Content material retrieval from the online or previous interactions
- Multimodal reminiscence
- Visible Interpreter to assist the blind and low-vision group
- Integration with prototype Android XR glasses
Presently, many of those options are nonetheless within the prototype stage and are solely out there to pick testers. The large exception is Gemini Live, which we’ll speak about intimately later.
Mission Astra: The way it works
Mission Astra is a tweaked model of Gemini with enhanced multimodal and agentic capabilities. For trusted testers, Mission Astra is accessible as a standalone app. It really works by using a number of data sources and superior reasoning to offer extra complete help than a typical search engine or AI chatbot. This might embody Gemini fashions, info discovered on the net, visible or auditory cues, knowledge that is in your display, or personalised data out of your Google exercise or previous interactions.
It really works by rapidly processing all these knowledge factors directly, and the result’s Mission Astra with the ability to talk with a consumer in pure language with correct context. That is achieved by utilizing native audio dialogue that may perceive completely different accents and feelings in 24 languages.
Newly introduced at Google I/O 2025 are Mission Astra’s agentic capabilities. In different phrases, the prototype AI assistant will quickly be capable to take actions in your behalf. It will probably perceive what’s in your display within the context of your dialog, utilizing visible cues to point out you the place to look. It will probably additionally make the most of Google options akin to Search, Gmail, Calendar, Maps, and extra to finish duties in your behalf.
You’ll be able to see this in motion within the I/O demo video for Mission Astra, which demonstrates how a consumer can management their telephone and resolve day by day issues hands-free.
We see the particular person within the video asking Mission Astra to search out manuals, spotlight key factors in PDF information, and name companies on their behalf. This can be a good, real-world instance of Google’s imaginative and prescient for Mission Astra. Ultimately, this universal AI assistant ought to be capable to management your telephone — and maybe your laptop or sensible glasses — with out you needing to carry a finger.
Mission Astra: Options and platforms
The long-term aim is for Mission Astra to develop to a number of platforms, and for now, Google has its sights on smartphones and sensible glasses. The corporate says that this prototype “integrates seamlessly with prototype glasses to see the world as you see it — for an much more immersive and useful expertise.”
After making an attempt the expertise on prototype Android XR glasses at Google I/O, it is clear Astra goals to carry all the pieces we have already coated — together with multimodality, reminiscence, visible evaluation, and agentic management — to a wearable type issue. This can be a great distance out from reaching shoppers, as Google’s sensible glasses aren’t anticipated to hit cabinets till 2026 on the earliest.
Obtainable now’s the Mission Astra expertise for Android and iOS smartphones, also called Gemini Live. With the upgraded Gemini Reside performance, you should utilize your telephone’s digital camera to have a dialog about what you see. You can even share your display to speak about what’s at present in your smartphone. In each conditions, Gemini can leverage data saved in its fashions and the online for context.
Mission Astra: Availability
Mission Astra’s Gemini Reside options are at present out there for all Android and iOS units that may set up the Gemini app. They’re free for everybody to attempt now.
You’ll be able to signal as much as attempt the unreleased Mission Astra app and its options for your self by becoming a member of the Trusted Tester Program Waitlist.
