Microsoft Copilot can now ‘see’ what’s on your screen in Edge

is a weekend editor who covers the latest in tech and entertainment. He has written news, reviews, and more as a tech journalist since 2020. Copilot Vision, Microsoft’s AI assistant feature that can interpret what’s on your screen and help you use apps, is now available for free use within the Edge browser, Mustafa Suleyman, CEO of Microsoft AI, announced on Bluesky today. Vision is a “talk-based experience,” as Microsoft calls it, meaning you use it by speaking into the air, then waiting for Copilot to respond. Suleyman says if you opt into the feature, Copilot Vision can “literally see what you see on screen.” Suleyman suggests having Copilot Vision guide you through a recipe while you cook or having it “decode” job descriptions “and jump right into customized interview prep or cover letter brainstorming.” (Although it might not be the best idea to use AI for your resume.) According to a Microsoft support page, “Copilot Vision may highlight portions of the screen to help you find r ... Read full article.