- The new “Computer Use” feature for Copilot Studio gives agents AI more tools
- Agents can now interact directly with applications or websites
- This can help data entry, analysis, research and much more
Microsoft gives more autonomy to its Copilot Studio AI platform in accessing websites and applications – without any human interaction.
The company has revealed a new “computer use” feature for Copilot Studio, which will allow the platform to interact directly with applications and desktop websites, such as clicking on buttons, select the menus and even type in screen fields.
This means that companies will be able to build AI agents with a much better understanding of these systems (essentially everything that with a graphic user interface), treating them as if they were tools, allowing an improvement in functionalities at all levels.
“Computer use”
“Copilot Studio is the end-to-end agent platform designed to help organizations achieve their AI and their operational objectives,” wrote Charles Lamanna, company vice-president of Microsoft Business & Industry Copilot, in a blog article announcing the news.
“We want to allow you to rationalize processes, improve productivity and stimulate innovation.”
The use of the computer will allow agents to manage tasks even when there is no API available to connect directly to the system and can adapt automatically to any modification of the application or website.
Developers can use the tool to build agents on desktop and browser applications, with Edge, Chrome and Firefox all inclusive launch.
It works in real time, using integrated reasoning tools to develop solutions to problems independently, so that development can continue without interruption.
Lamanna presented several possible scenarios where the use of the computer could be particularly practical for developers, in particular the automation of the contribution of large volumes of data from various sources in a centralized system, carrying out generalized market studies coming from various online sources and the treatment of invoices much more quickly and more precisely than before.
Given that the tool operates on the infrastructure hosted by Microsoft, users do not need to manage their own servers, and it includes the existing safety measures and governance executives of Copilot Studio to ensure compliance with industry standards.
The launch, which will see more attention to Microsoft Build in May 2025, recently followed a similar announcement of “actions” in the commercial version of Copilot. This system makes it possible to complete the tasks such as the completion of restaurant reservations, the booking of event tickets and the purchase of items in online stores.
