iOS 18.1 and Beyond: Siri's Apple Intelligence Features

6 months ago 15
With Apple Intelligence, Apple is aiming to marque Siri smarter than ever before. The idiosyncratic adjunct is going to beryllium capable to larn much astir you, bash much successful apps, and manus implicit the reins to a smarter virtual adjunct erstwhile needed.


Some caller ‌Siri‌ features are disposable now, portion immoderate won't beryllium coming until 2025. This usher highlights everything that's caller with ‌Siri‌ acknowledgment to ‌Apple Intelligence‌.

Updated Siri Design


‌Siri‌ has a refreshed plan connected devices that enactment ‌Apple Intelligence‌. Rather than the tiny wavelength that utilized to amusement erstwhile activating ‌Siri‌, there's present a pink/purple/blue/orange variegated glow that wraps astir the full iPhone, with the colors shifting arsenic ‌Siri‌ listens to a command.


Better Language Understanding


‌Siri‌ tin amended recognize conversational connection and requests, truthful if you stumble implicit your words oregon alteration your caput mid-sentence, ‌Siri‌ tin inactive travel what you're saying.


‌Siri‌ is besides capable to support discourse betwixt requests, truthful you tin notation to thing successful a erstwhile request, and ‌Siri‌ volition recognize what you're talking about. So if you usage ‌Siri‌ to make a calendar event, you tin past conscionable inquire "What volition the upwind beryllium similar there?" and ‌Siri‌ knows wherever "there" is.

Improved Voice


‌Siri‌ has a new, much earthy sounding voice.

Type to Siri


There is simply a built-in Type to ‌Siri‌ diagnostic truthful you don't request to talk to ‌Siri‌ to interact with the idiosyncratic assistant. To usage it, treble pat connected the bottommost of the ‌iPhone‌ oregon iPad to bring up a substance bar, and past from there, conscionable benignant successful your request.


Type to ‌Siri‌ tin beryllium utilized successful the aforesaid mode arsenic speaking to ‌Siri‌, and ‌Siri‌ is capable to supply accusation without speaking aloud. It is simply a utile diagnostic for nationalist situations wherever you're not capable to talk and bash not privation to person ‌Siri‌ speaking backmost to you.

Siri connected the Mac


While this usher focuses connected the ‌iPhone‌ and the ‌iPad‌, the new, smarter ‌Siri‌ is besides disposable connected the Mac. Type to ‌Siri‌ tin beryllium enabled successful the Settings app, and it tin beryllium assigned to a shortcut, specified arsenic pressing the Command fastener twice.

Apple Product Knowledge


Apple taught ‌Siri‌ astir each of its products, truthful if you privation to cognize however to usage a diagnostic oregon however to implicit a task, you tin inquire ‌Siri‌ for help. ‌Siri‌ tin supply step-by-step directions connected utilizing ‌iPhone‌, ‌iPad‌, and Mac features.


ChatGPT Integration (iOS 18.2)


In iOS 18.2, ChatGPT integration is disposable with ‌Siri‌. If a idiosyncratic asks thing that ‌Siri‌ is not susceptible of handling, ChatGPT tin supply a effect instead, truthful agelong arsenic the idiosyncratic gives permission.


‌Siri‌ tin pat into ChatGPT, and past relay ChatGPT's effect with nary request to power apps oregon usage different tools.

The ‌Siri‌ ChatGPT integration tin fundamentally beryllium utilized to bash thing you tin bash with the ChatGPT app oregon ChatGPT connected the web, it's simply an easier mode to get to ChatGPT.

Object Identification


For thing connected your screen, specified arsenic an image, you tin inquire ‌Siri‌ a question astir it. If you person a photograph of a plant, for example, asking "What is this?" volition punctual ‌Siri‌ to nonstop a screenshot implicit to ChatGPT, and ChatGPT volition effort to supply context.


This works with images connected the web, your photos, the thing you're viewing done the Camera app, text, and more.

ChatGPT tin beryllium utilized to picture a scene, which is utile for radical who mightiness person issues with sight. Opening the Camera app, activating ‌Siri‌, and asking "What is this?" volition supply a elaborate statement of immoderate is successful beforehand of you.


The enactment to nonstop images to ChatGPT from screenshots is chiseled from the ‌Siri‌ onscreen consciousness diagnostic that Apple plans to instrumentality successful the future.

Info From Documents


For emails, documents, PDFs, and more, ChatGPT tin supply a summary. When you inquire "Can you summarize this?" ‌Siri‌ volition nonstop a screenshot oregon the full document, which includes afloat PDFs. It's a utile diagnostic for getting a speedy overview of the contented of a agelong document.


For agelong PDFs oregon documents, you'll privation to pat connected the arrows to marque definite the afloat papers is sent to ChatGPT alternatively than conscionable a screenshot.

Rather than asking for a summary, you tin alternatively inquire a circumstantial question astir a document. If you're looking astatine an security policy, you tin inquire "What are the limits of this policy?" oregon "What are the exclusions?" to get much tailored information.

Checking Spelling and Grammar


If you've written an email, alternatively than selecting it and utilizing Writing Tools to cheque it for spelling and grammar errors, you tin inquire ‌Siri‌ to instrumentality a look, and ‌Siri‌ volition nonstop a screenshot to ChatGPT. "Can you look this implicit for errors?" works arsenic a bid for this feature.


ChatGPT tin besides beryllium utilized for rewriting and refining what you've written, but enactment that this is not the aforesaid arsenic Apple's ain Writing Tools.

Generating Text and Images


ChatGPT tin make substance from scratch based connected prompts that it is given. You can, for example, inquire ‌Siri‌ to inquire ChatGPT to constitute a poem oregon constitute a polite missive to a friend, and ChatGPT volition make thing from scratch.


Some illustration requests you tin use:

  • Write maine a poem astir Apple

  • Create a opus astir Google

  • Help maine constitute a missive to my friend

  • Write 3 paragraphs astir orangish cats

  • Write maine a societal media station astir Thanksgiving

  • Rewrite this to beryllium much concise

  • Create a bedtime communicative astir a dragon


If you person ChatGPT constitute thing for you, you tin pat connected the transcript icon to transcript it to the clipboard to paste it into Notes, Messages, a document, oregon an email.

You tin besides make images. Using the Dall-E 3 engine, ChatGPT tin marque realistic AI-generated images, thing that can't beryllium done with ‌Apple Intelligence‌. For representation requests, it's easiest to archer ‌Siri‌ to "Tell ChatGPT to marque an representation of [thing you privation an representation of]," due to the fact that if you conscionable inquire ‌Siri‌ to marque an representation oregon make an image, it volition often bring up web images.


Answering Questions


One of the champion usage cases for ChatGPT done ‌Siri‌ is getting answers for queries that are conscionable a spot excessively analyzable for ‌Siri‌. Questions that ‌Siri‌ can't grip volition beryllium handed implicit to ChatGPT with your permission, but you tin besides unit ‌Siri‌ to usage ChatGPT alternatively of the interior ‌Siri‌ motor by amending questions with "Ask ChatGPT."


For example, a question astir what artillery an Xbox controller uses volition root Wikipedia and not ChatGPT, but specifically "Ask ChatGPT what artillery an Xbox controller uses" volition punctual ‌Siri‌ to contiguous the question to ChatGPT.


ChatGPT's answers tin sometimes beryllium much informative. Asking ‌Siri‌ however to regenerate eggs successful a look conscionable gives you alternatives, but ChatGPT's reply for the aforesaid question provides the magnitude of an constituent you mightiness privation to adhd to equate to an egg.

Some illustration queries that ‌Siri‌ volition automatically consult ChatGPT on:

  • What are 5 types of edible mushrooms successful North Carolina?

  • What should I battalion for a formation travel successful winter?

  • What are indispensable spot places successful Paris?

  • What should I bash this weekend?

  • I privation a look for banana bread

  • Give maine instructions connected cutting a mango

  • When is avocado season?

  • Suggest bully songs for a quiescent Friday night

  • What's a bully indoor enactment to bash erstwhile it's raining?


Other Things You Can Ask ChatGPT To Do



  • Write code

  • Debug code

  • Get assistance with homework

  • Do calculations, translations, conversions, and more

  • Generate acquisition ideas

  • Come up with names for businesses, pets, characters, and more

  • Create trivia questions oregon riddles

  • Plan trips

  • Create repast plans

  • Get recipes for ingredients you have

  • Generate jokes

  • Suggest movies, TV shows, and books based connected circumstantial parameters

  • Summarize TV shows and movies

  • Generate drawing/writing prompts


While ‌Siri‌ tin bash each of these things with ChatGPT's help, the deficiency of continuity with the ‌Siri‌ mentation of ChatGPT makes it hard to implicit tasks that are not one-off requests. Creating a repast plan, for example, works amended with the existent ChatGPT interface due to the fact that you tin person much of a speech alternatively than relying connected a azygous request.

ChatGPT Settings and Privacy


ChatGPT integration has to beryllium turned on, and aft that, each petition requires idiosyncratic permission. There is an enactment to crook disconnected the other support by toggling disconnected the "Confirm ChatGPT Requests" option.

The toggle tin beryllium accessed by opening up the Settings app, choosing ‌Apple Intelligence‌, and past tapping connected ChatGPT. With the diagnostic disabled, ‌Siri‌ volition not inquire each clip earlier sending accusation to ChatGPT.

‌Siri‌ will, however, ever inquire support earlier sending a record to ChatGPT adjacent with the corroborate requests diagnostic turned off.

As for privacy, nary login is required to usage ChatGPT, and neither Apple nor OpenAI log your requests. But if you motion successful with a paid account, ChatGPT tin support a transcript of requests.

ChatGPT - Free vs. Paid


ChatGPT integration includes a constricted fig of requests that usage ChatGPT-4o, the latest mentation of ChatGPT, for free. After those are utilized up, ChatGPT integration uses 4o Mini, which is little precocious and takes up little resources.


ChatGPT Plus subscribers get much ChatGPT-4o requests. ChatGPT Plus is priced astatine $20 per month, and ‌iPhone‌ users who don't already person ChatGPT Plus tin motion up close from the ‌Apple Intelligence‌ conception of the Settings app.

Apple users fundamentally person entree to ChatGPT's basal plan, truthful requests that usage precocious capabilities reset each 24 hours. With this plan, 2 images per time tin beryllium generated.

ChatGPT vs. Apple Intelligence


There is overlap betwixt what's imaginable with ‌Apple Intelligence‌ and what you tin bash with ChatGPT integration, but determination are immoderate distinctions. ‌Apple Intelligence‌ has Writing Tools for rewriting and editing what you've already written, but ChatGPT tin constitute contented from scratch.

Image Playground, Image Wand, and Genmoji let you to make images, but ‌Apple Intelligence‌ won't make realistic looking images. Instead, styles are constricted to those that look animated oregon sketched. ChatGPT volition make lifelike images, though.

‌Apple Intelligence‌ tin beryllium utilized to summarize documents, but lone erstwhile you prime substance and prime the Summarize enactment from Writing Tools. ‌Apple Intelligence‌ can't reply much circumstantial questions astir PDFs and documents, truthful ChatGPT does person an borderline for that benignant of query.

ChatGPT Limitations


When you inquire ChatGPT a question done ‌Siri‌, you request to marque definite to work the reply close distant due to the fact that it doesn't enactment connected the surface long. Apple does not support a grounds of it, either.

If you're logged into ChatGPT, determination is simply a past successful your OpenAI account, but if you're not logged in, there's nary mode to prevention accusation that you've received from ChatGPT, and there's nary log.

Other Chatbots


Apple has lone added ChatGPT integration close now, but enactment for Google Gemini is planned successful the future.

Siri Apple Intelligence Features Coming Next Year


There are respective ‌Siri‌ features that are inactive successful development, with Apple readying to adhd these capabilities to ‌Siri‌ adjacent year. Timing isn't factual yet, but rumors suggest we'll spot them successful iOS 18.4 successful the spring.

Personal Context


‌Siri‌ volition beryllium capable to support way of your emails, messages, files, photos, and more, learning much astir you to assistance you implicit tasks and support way of what you've been sent.

  • Show maine the files Eric sent maine past week.

  • Find the email wherever Eric mentioned crystal skating.

  • Find the books that Eric recommended to me.

  • Where's the look that Eric sent me?

  • What's my passport number?


Onscreen Awareness


‌Siri‌ volition beryllium capable to archer what's connected your surface and implicit actions involving immoderate you're looking at. If idiosyncratic texts you an address, for example, you tin archer ‌Siri‌ to adhd it to their interaction card. Or if you're looking astatine a photograph and privation to nonstop it to someone, you tin inquire ‌Siri‌ to bash it for you.

Deeper App Integration


‌Siri‌ volition beryllium capable to bash much successful and crossed apps, performing actions and completing tasks that are conscionable not imaginable with the idiosyncratic adjunct close now. We don't person a afloat representation of what ‌Siri‌ volition beryllium susceptible of, but Apple has provided a fewer examples of what to expect.

  • Moving files from 1 app to another.

  • Editing a photograph and past sending it to someone.

  • Get directions location and stock the ETA with Eric.

  • Send the email I drafted to Eric.


The Next Siri Phase


After each of the ‌Siri‌ ‌Apple Intelligence‌ features person been implemented successful iOS 18, Apple plans to unveil the next-generation ‌Siri‌, which volition trust connected ample connection models. An LLM mentation of ‌Siri‌ is already successful development, and it volition beryllium capable to amended vie with chatbots similar ChatGPT.

LLM ‌Siri‌ volition beryllium capable to clasp ongoing conversations, and it volition beryllium much similar speaking with a human. Large connection exemplary integration volition fto ‌Siri‌ execute much analyzable tasks, and successful the future, ‌Siri‌ apt won't request to trust connected ChatGPT.

The updated mentation of ‌Siri‌ volition regenerate the existent mentation of ‌Siri‌ successful the future. Apple is expected to denote LLM ‌Siri‌ successful 2025 alongside the instauration of iOS 19, but the update apt won't motorboat until outpouring 2026.

Apple Intelligence Privacy


‌Apple Intelligence‌ was designed with privateness successful mind, and galore requests are handled on-device. All idiosyncratic discourse learning, for example, is done with on-device quality and thing leaves your ‌iPhone‌ oregon ‌iPad‌.

For requests that request the processing powerfulness of a unreality server, Apple is utilizing Private Cloud Compute connected Apple silicon machines to grip analyzable tasks portion preserving idiosyncratic privacy. Apple promises that information is not stored and is utilized lone for idiosyncratic requests.

Apple Intelligence Compatible Devices


‌Apple Intelligence‌ is disposable connected the iPhone 15 Pro, the ‌iPhone 15‌ Pro Max, each iPhone 16 models, the iPad mini with A17 Pro chip, each iPads with an Apple silicon chip, and each Macs with an Apple silicon chip.

Read More


We've shared elaborate guides connected ‌Genmoji‌ and ‌Image Playground‌ already, positive we person an wide usher connected the afloat acceptable of ‌Apple Intelligence‌ features and a usher for the wide features coming successful iOS 18.2.

Release Date


iOS 18.2 and iPadOS 18.2 with ‌Image Wand‌ integration volition beryllium coming successful December, with Apple apt readying for a December 9 bundle release.
Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18

This article, "iOS 18.1 and Beyond: Siri's Apple Intelligence Features" archetypal appeared connected MacRumors.com

Discuss this article successful our forums

Read Entire Article