- Google Gemini publishes a Pixel 9 functionality which allows it to discuss what is on a real -time screen
- Gemini Live can discuss youtube images, files and videos
- The functionality makes gemini live more aware of the context of discussions
Google gives its assistant Gemini a new perspective, your view of what is on a smartphone screen. More specifically, the series of Pixel 9 devices, where Gemini Live is now able to “speak live” and discuss in real time on images, files and YouTube videos such as you see them, as first of all spotted by 9TO5GOOGLE. It is ideal if you want to ask questions about a kitchen tutorial in mid-regime or require an explanation on a meme that you are not connected enough to understand.
Until now, the role of Gemini Live has been a bit like any standard AI vocal assistant, powered by more conversational models in the Chatgpt mold. But now he can take a look at specific content on your screen and add it to his discussions. Pixel 9 owners can access the functionality by launching the superposition of floating Gemini, where a suggestion will seem to suggest that AI “Talk Live of Video” on YouTube, “Talk Live About PDF” in Google files, and ” Talk live “for images on the screen. This gives the context of Gemini without you having to explain what is. It is much faster than having to manually download an image of your gallery.
Once you have activated the functionality, Gemini Live opens with an overview of everything on the screen you may want to discuss. The AI could offer destination ideas based on a YouTube travel video, summarize a contractual PDF or explain the allegory of a renaissance art work that you examine on your phone. If you find it all a little intrusive, you can prevent Gemini live from automatically what you are looking at. If you don’t have a pixel 9, don’t worry. Google said it would soon publish the functionality of Samsung Galaxy S24 and S25 smartphones, followed by other Android devices.
Living gemini
The functionality is perfectly part of Google’s Gemini strategy. In case you have not noticed, Google dreams of cementing the place of Gemini at the center of people’s life, especially on mobile devices, as evidenced by its continuous integration with Android. And this feature will not be the end of gemini live upgrades. Google is preparing for Project Astra, an always evolving toolbox that should allow users to share their screen and broadcast videos in real time while conversing with Gemini Live.
Google relies hard on real -time assistance and in context. Rather than simply generating responses based on abstract requests, Gemini Live wants to be part of the moment, reacting to everything that is on your screen with (hopefully) useful information. To keep an advance on Apple’s plans for Apple Intelligence and whatever the Openai and Microsoft plan, Google wants Gemini to be as omnipresent as possible.
