Here's What's New With Visual Intelligence in iOS 26

15 hours ago 1

Visual Intelligence, an Apple Intelligence diagnostic that Apple introduced past year, has immoderate caller capabilities successful iOS 26 that marque it much utile and amended capable to vie with the functionality disposable done immoderate Android smartphones.

Onscreen Awareness

In iOS 18, ‌Visual Intelligence‌ lone works with the camera, but successful ‌iOS 26‌, it besides works with what's connected your device. You tin seizure a screenshot of what's connected your surface and past usage ‌Visual Intelligence‌ connected it to place what you're looking at, find images, and get much accusation done ChatGPT.

How to Get Use Onscreen Awareness for Visual Intelligence

‌Visual Intelligence‌ for screenshots works astir the aforesaid arsenic ‌Visual Intelligence‌ with the camera app, but it's located successful the screenshot interface. Take a screenshot (hold down the measurement up fastener and the broadside button), and past pat retired of the Markup interface if it's showing.

To get retired of Markup (which is the default view), pat connected the small pen icon astatine the apical of the display. From there, you should spot the ‌Visual Intelligence‌ options.

Highlight to Search

With Highlight to Search for ‌Visual Intelligence‌ onscreen contented awareness, you tin usage a digit to gully implicit the entity successful the screenshot that you privation to look up. It's akin to Android's Circle to Search feature.

Highlight to Search lets you behaviour an representation hunt for a circumstantial entity successful a screenshot, adjacent if determination are aggregate things successful the picture. It uses Google Image hunt by default, but Apple showed disconnected the diagnostic moving with different apps similar Etsy during its keynote event. Apps volition apt request to adhd enactment for the feature.

In immoderate cases, ‌Visual Intelligence‌ volition place idiosyncratic objects successful an representation connected its own, and you tin pat without needing to usage Highlight to Search. This is akin to the entity recognition diagnostic successful the Photos app, but it inactive leads to an representation search.

Ask and Search

If you don't request to isolate 1 entity successful your screenshot, you tin simply pat connected the Ask fastener to inquire questions astir what you're seeing. Questions volition beryllium relayed to ChatGPT, and ChatGPT volition supply the information. The Search fastener queries Google Search for much information.

As with the modular Visual Search, if your screenshot includes dates, times, and related accusation for an event, it tin beryllium added straight to your calendar.

New Object Identification

Apple didn't notation it, but ‌Visual Intelligence‌ adds enactment for speedy recognition of caller types of objects. It tin present place art, books, landmarks, earthy landmarks, and sculptures, successful summation to the animals and plants it was capable to supply accusation connected before.

If you usage ‌Visual Intelligence‌ connected an entity that it is capable to recognize, you'll spot a tiny glowing icon popular up. Tapping connected it reveals accusation astir what's successful view. What's neat astir this facet of ‌Visual Intelligence‌ is that it works with the unrecorded camera presumption oregon with a snapped photo.

For modular Ask and Search requests utilizing ‌Visual Intelligence‌, you person to instrumentality a photograph truthful that it tin beryllium relayed to sources similar ChatGPT oregon Google Image Search. Art, books, landmarks, earthy landmarks, sculptures, plants, and animals tin beryllium identified on-device without contacting different service.

Compatibility

‌Visual Intelligence‌ is constricted to devices that enactment ‌Apple Intelligence‌, which includes the iPhone 15 Pro models and the iPhone 16 models. It is activated by a agelong property connected the Camera Control fastener connected devices that person Camera Control, oregon utilizing the Action Button oregon a Control Center toggle.