- Google Gemini Live now provides visual advice with real -time indices on your screen when you share your camera
- The functionality is designed to help users solve the tasks visually and identify objects by view
- Gemini Live has also expanded his application integrations and introduces expressive voice upgrades
Google continues its quest to bring people to use its assistant Gemini AI at any time and in all places with a new set of upgrades launched alongside the series of smartphones Pixel 10. The centerpiece of the new and improved Gemini Live is a set of AI eyes, a feature called Visual Guidance.
Basically, you can give Gemini live access to your camera, and he will examine the same things you look at and help you understand things like the right tool to use, the best choices to coordinate an outfit or other tasks. The solutions will be directly on the screen, with arrows or circles around the right answer. For the moment, the feature will only be available on the Pixel 10, but other Android phones and even iOS devices will be able to use the functionality in the near future.
Visual advice may look like a party turn, but it could be a major draw for Gemini Live. Instead of receiving a flat and spoken response when you ask Gemini to help assemble a new piece of furniture, you can now show the parts to your camera and visually ask the assistant who goes where. It does not require special equipment; It’s like showing a friend who is good at DIY what you have and ask for help.
Google clearly sees it as a way to fill the clumsiness that sometimes occurs when you ask for an AI help and you give vague or too generic responses. “Use the blue sleeve pliers”, may not help you if your toolbox has three tools with blue handles. A shiny circle on the right one is much more useful. As a person who tried to follow a YouTube tutorial while simultaneously brandishing a screwdriver, I receive the call.
Sweet Talk and Multitasking
Gemini Live will also sound better when he will show you things, thanks to new models of discourse capable of adjusting the tone, and even the character of the voice. Thus, Gemini could use a particularly calm voice to talk about a stressful subject, accelerate when you are in a hurry, or perhaps tell you a story about pirates in the accent of stereotypical pirates.
Gemini Live will also be better in multitasking thanks to new links to applications like Google Calendar, Messages and Maps. So when you chat with Gemini, you can make it take over your personal appointments and send SMS to your friends with instructions.
The redesign of Gemini Live adapts to the wider approach of Google to AI, positioning it as an ambient platform, always on an autonomous functionality. AIA assistance which is flexible enough for any event, while the use of the context is specifically precious for individuals, is Google and other AI developers have promised for a while. And although visual advice and other tools are not perfect, adaptability could compensate for this. You don’t need to learn a new system or speak in orders. You just show Gemini what you see, ask him what you need and get an answer that is set on the subject.