Gemini Live’s background mode and app extensions could blow Apple Intelligence away
During Google I/O 2024, the tech giant gave a sneak peek Gemini Livea unique version of AI on mobile that is capable of “natural conversations.” Think of it as Siri, as you can have a two-way conversation with Gemini and have the AI respond succinctly.
Since its initial announcement, we haven’t heard much more about the technology, until recently when strings of code referencing Gemini Live were found in a beta version of a Google app. The code mentions a “background mode” that would allow users to continue conversations “while using other apps or while (their) screen is locked.” 9to5Google points out that this effectively turns the Gemini Live experience into a sort of phone call.
The AI will continue to accept vocal input and respond while you do other things. For example, a user could open Chrome on their Android phone, search for something in the search engine, and seamlessly send that information back to Gemini. Again, the goal is to make talking to the AI natural.
According to 9To5Google, interactions can be ended by “looking for a persistent notification” or saying “Stop” out loud to Gemini Live.
Possible functions
However, more than just the background mode was revealed in the beta.
Google is apparently working on a way to give users quick access to Gemini when their phone is locked. Judging from the report’s screenshot, you can use four extensions for first-party services: Google Maps, Google Flights, Google Hotels, and YouTube.
It’s not known what exactly you’ll be able to do with these extensions, as details are scarce. But based on what was shown, users could ask Gemini for directions, play music from YouTube, or book a flight.
Those four will be enabled by default, and Google apparently has plans to add support for more extensions; there’s a small catch, though. According to the screenshot, “extensions that don’t require user credentials or don’t have access to private data will be enabled by default.” Everything else would presumably require manual activation.
Additionally, users can toggle three additional features for Gemini on the lock screen, expanding the level of control the AI provides. Messages lets you text friends and family, while Workspace can find and summarize emails or documents. And then there’s Home Automation, which is perhaps the most interesting of all, as it allows homeowners to control smart home devices from the lock screen.
Surpass Apple
It is unknown when Gemini Live will launch. The May announcement said the software would arrive within the next few months to Gemini Advanced subscribers. Google has been quiet so far. Maybe we’ll see it before the end of the summer or later in the fall.
When it does come out, the background mode and interactivity of the lock screen could make it a notable upgrade over Apple Intelligence. Apple’s tech is also very capable, offering a variety of tools for organization, content creation and more. However, from what we’ve seen, it requires constant interaction. Gemini Live is less restrictive, which could make it easier to use.
As always, take these leaks with a grain of salt. Things can always change at the last minute.
If you’re interested in what the best AI chatbot is, read our Versus article where we compare the three biggest ones: Meta AI, ChatGPT, and Google Gemini.