Microsoft announced today a new Windows 11 Copilot feature called Copilot Actions that enables AI agents to perform real tasks on local files and applications.
The feature will be rolling out soon to Windows Insiders in Copilot Labs, expanding the earlier web-based Copilot Actions introduced in May and taking us one step closer to Microsoft's vision of integrating AI directly in the Windows desktop environment.
"Copilot Actions is an AI agent that completes tasks for you by interacting with your apps and files, using vision and advanced reasoning to click, type and scroll like a human would," explains Microsoft.
"This transforms agents from passive assistants into active digital collaborators that can carry out complex tasks for you to enhance efficiency and productivity – like updating documents, organizing files, booking tickets or sending emails."
Microsoft Copilot Actions working on a local video
Source: Microsoft
Each agentic app will manage its own Agent Workspace, providing an isolated environment where the agent operates independently from the user's desktop. This ensures that agents acting on behalf of different apps remain isolated from one another.
Microsoft told BleepingComputer that there will be no change to the Windows 11 hardware requirements and that they are optimizing the workspaces to minimize any impact on Windows' performance.
Securing Copilot agents
Microsoft states that it is securing Copilot AI agents through four security and privacy principles: using distinct agent accounts, limiting agent privileges on files and folders, ensuring operational trust through digitally signed agents, and ensuring that agents are governed by the Microsoft Privacy Statement and Responsible AI Standard.
... continue reading