- Google AI mode now allows users to download images and photos to go with text requests
- The functionality combines Google Gemini and Lens
- AI mode can understand whole scenes, not just objects
Google adds a new dimension to its experimental AI mode by connecting the visual capabilities of Google Lens to Gemini.
The AI mode is part of Google research which can decompose complex subjects, compare the options and suggest monitoring. Now this search includes downloaded images and photos taken on your smartphone.
The result is a way to search through images as you would send a text, but with much more complex and detailed answers than simply put an image in the reverse image search.
You can literally take a photo of a strange-looking kitchen tool and ask: “What is it, and how to use it?” And get a useful response, with business links and YouTube demos.
AILS AI
If you take a photo of a library, a plate of food or the chaotic interior of your unwanted drawer, the AI will not only recognize individual objects; This will also explain their relationship between them.
You could get a suggestion of other dishes that you can do with the same ingredients, whether your old phone charger is in the drawer or what order you should read these books on the shelf. You can see how it works above.
Essentially, the functionality draws several related questions in the background throughout the scene and each individual object. So when you download a photo from your living room and ask how to redecorate it, you don’t just get a generic response. You get a group of mini-agent responses asking for everything in the room.
Google is not unique in this pursuit. Chatgpt includes image recognition, for example. However, Google’s advantage is decades of research, visual indexing and other storage and data organizations.
If you are a Google One AI Premium subscriber or if you are approved to test it via search laboratories, you can test the functionality on the Google Mobile application.
