- Microsoft extends Copilot’s vision capabilities
- Soon he can display and interact with Windows as a whole and the applications
- You can even use it to learn a Photoshop skill
It’s a big day for Microsoft – it’s the 50th anniversary of one of the most impactful companies of all time, and it is the day when Copilot is made to the higher level. The AI assistant from Microsoft, Copilot, becomes more personalized and has a series of new features.
However, the expansion of Copilot Vision deserves attention because it will provide one of the most significant smart boosts for Windows. We have already seen that Copilot can browse the web by your side, sharing what you see with certain partners and lending a helping hand.
With the kind authorization of the new Copilot for the Windows application, you can let the AI display your screen when you are in the basic operating system and in selected applications. As with the web, it mixes multimodal AI with agency capabilities, and thanks to its ability to display and understand your screen, it can also interact with applications.
Screen aid
This is in the form of highlighting options on your screen, and even adding an additional cursor, but also to guide you through the stages required by speech. It’s pretty cool.
In a shared demo, we saw Copilot provide instructions for a modification in Photoshop, guiding you essentially through the way to use the tool. It could be a big game changer because it is not only an AI for fast facts; You can integrate Copilot into your workflow and really use it as good.
Of course, we will have to see exactly how much it works, but alongside a more personalized co -pilot, adding Windows vision is a big step. It will be opt for launch, and Microsoft adopts a slow and regular approach.
The vision in the Copilot application for Windows will start to deploy for Windows Insiders next week, and Microsoft says it will be available “more widely after”. It is not super specific, so it could make some time before you can really try, if you are not an initiate of Windows.
For Android and iOS too
In addition to “deep research” capacities and a new “shopping” function for Copilot, its vision capacities also develop on your Android or iOS phone. Via the Copilot application, you can pull your camera and essentially let AI have this view for these devices. This means that you can point it to a dog and ask for the breed or even a store and ask for advice. You can also download photos from your camera bread.
This improved vision capacity for Copilot on Mobile is also available at the moment, just make sure to update the application.
This change on mobile also brings Copilot to the same playgrounds as Google’s capabilities with Astra on Android. The changes made to the windows represent a great intelligence jump that could change the way you use applications on the operating system.
I can’t wait to give vision a complex task that I try to understand how to accomplish in Photoshop or when I need to create a complex formula in Excel.
All these changes, however, show Microsoft’s ambition with AI, especially to bring more people to use Copilot. Is none of these elements in itself, but they certainly make the co -pilot much more convincing alongside Google Gemini or Chatgpt – after all, it has the brain, so why not more features?
