Microsoft
Microsoft has expanded the powers and reach of its Copilot Vision AI to help you with all types of content. In a Tuesday blog post, the company revealed that Windows insiders can now opt to share their entire desktop with Copilot Vision where you can ask it to analyze and answer questions about all the items on your screen.
A big leap forward
Available in the US for Windows 10 and 11 and coming soon to other non-European countries, Copilot Vision on Windows acts as a virtual companion, providing another set of eyes to help you with files, apps, and other items displayed and shared on the screen. You can ask it to analyze or summarize the content, or respond to any questions about it.
With the latest skill accessible to Windows insiders, you can share your entire desktop with Copilot, prompting the AI to talk about it in real time.
"It can help analyze content, provide insights, and answer your questions, coaching you through it aloud," Microsoft said in its blog post. "Get tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game."
To use Copilot to discuss your whole desktop, launch the app. Click the glasses icon, select the desktop that you'd like to share, and then ask Copilot to help with whatever you're seeing or using. To stop sharing, press Stop or X.
Windows insiders can also now enable Vision from a voice conversation. If you're chatting with Copilot and want help on whatever is on the screen, just click the glasses icon and share your desktop or an individual window.
Though available only to Windows insiders for now, the latest skills reveal ongoing progress for Copilot Vision. All Windows users can currently turn to the app for help. Not sure how to use a specific application? With the Highlights option, you're able to ask Copilot how to accomplish a certain task. The AI will then show you where to go and what to do.
Also: 8 ways I use Microsoft's Copilot Vision AI to save time on my phone and PC
... continue reading