Microsoft starts testing Copilot Vision update that can ‘see’ your screen and apps

Copilot Vision moving connected Windows 11. | Image: Microsoft

Microsoft has started investigating a caller update to its Copilot app connected Windows that volition fto you stock your surface oregon apps with the AI assistant. Copilot Vision was originally limited to Microsoft’s Edge browser, but it’s present extending to immoderate app connected your PC.

Copilot Vision volition beryllium capable to bash things similar manager you done utilizing Adobe Photoshop features, oregon analyse the photos and webpages you’re looking at. I got to spot an aboriginal mentation of Copilot Vision connected Windows astatine Microsoft’s 50th day enactment past week, wherever the AI adjunct guided maine done a crippled of Minecraft and helped to optimize settings successful Microsoft’s Clipchamp video editor.

I haven’t been capable to afloat trial Copilot Vision connected Windows done the Insider beta due to the fact that Microsoft is limiting the acquisition to US testers only. Copilot volition beryllium capable to item parts of your surface to usher you done apps, though this archetypal beta mentation won’t person the diagnostic enabled conscionable yet. Copilot Vision mightiness dependable akin to Microsoft’s Recall diagnostic that automatically takes snapshots if you let it, but it’s really much similar surface sharing an app oregon your full desktop successful a Microsoft Teams call.

Microsoft has besides started investigating record hunt successful Copilot connected Windows, allowing you to inquire the AI adjunct astir the contents of a record connected your PC. File hunt supports .docx, .xlsx, .pptx, .txt, .pdf, .json files, and you tin usage Copilot to easy find the documents you were moving connected recently.

Both of these Copilot features conscionable necessitate the Copilot app connected Windows, and not a afloat Copilot Plus PC. You tin besides usage Copilot Vision connected iOS and Android. Microsoft has started investigating these caller Copilot features with Windows Insiders, up of a broader rollout to each Windows 11 users successful the coming weeks oregon months.