Microsoft’s new Copilot Vision can ‘see’ your apps on Windows

Microsoft is launching Copilot Vision for Windows today, an hold of its AI adjunct that lets you stock your surface oregon apps truthful that Copilot tin bash things similar manager you done utilizing Adobe Photoshop features oregon analyse the photos and webpages you’re looking at.

“When you take to alteration it, Copilot Vision tin spot what you spot and speech to you astir it successful existent time,” says the Copilot team. “It acts arsenic your 2nd acceptable of eyes, capable to analyse content, assistance erstwhile you’re lost, supply insights, and reply your questions arsenic you go.”

Microsoft first started testing Copilot Vision successful Windows earlier this year, and present it’s launching escaped successful the US for some Windows 10 and Windows 11 users. You’ll nary longer request a Copilot Pro subscription, but it’s inactive portion of Microsoft’s experimental Copilot Labs AI initiatives.

Copilot Vision connected Windows works wrong the Copilot app and tin beryllium activated done a glasses icon that lets you prime a browser model oregon app that you privation to stock with the AI — overmuch similar sharing your surface oregon apps successful a Microsoft Teams meeting. It’s an opt-in experience, wherever you’ll person to specifically stock your apps for Copilot Vision to work; it’s not similar Recall, wherever it’s continuously taking snapshots of your surface erstwhile it’s enabled.

I haven’t been capable to afloat trial Copilot Vision connected Windows due to the fact that Microsoft is limiting the acquisition to the US, but I did get a little hands-on with it astatine Microsoft’s 50th day lawsuit successful April. Once you stock an app, Copilot is past capable to item parts of your surface to usher you and assistance reply questions. You tin besides use Copilot Vision connected iOS and Android.

Update, June 12th: Article updated to bespeak that Copilot Vision doesn’t necessitate Copilot Pro.