Microsoft lets Copilot Studio use a computer on its own

Microsoft has enabled a caller “computer use” diagnostic for Copilot Studio this week that lets AI agents interact with websites and desktop applications. Much similar OpenAI’s Operator oregon Claude’s identically named “computer use” feature, businesses volition beryllium capable to usage Copilot Studio to physique AI agents that dainty websites and desktop apps arsenic if they’re tools for automating tasks.

“Computer usage enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields connected the screen,” explains Charles Lamanna, firm vice president of Microsoft’s concern & manufacture Copilot. “This allows agents to grip tasks adjacent erstwhile determination is nary API disposable to link to the strategy directly. If a idiosyncratic tin usage the app, the cause tin too.”

Copilot Studio volition beryllium capable to make AI agents that tin automate information entry, execute marketplace research, oregon adjacent process invoices. This caller instrumentality volition adjacent observe erstwhile buttons and screens alteration successful apps oregon websites and proceed moving without failing oregon breaking, according to Microsoft.

Microsoft added a akin feature, dubbed Actions, to its consumer Copilot earlier this month. Actions tin beryllium performed successful the inheritance portion you enactment connected different tasks. Copilot tin present bash things similar publication edifice reservations, lawsuit tickets, and acquisition items from online stores. The Actions acquisition is constricted to a fig of partners though, and it sounds similar Copilot Studio volition beryllium escaped to enactment with much websites and apps.