Apple's New AI Models Contain 'None' of Google's Gemini Assistant

Apple executives person elaborate the architecture of the company's caller Apple Foundation Models (AFM) and clarified precisely however Google's exertion factored into their development.


Craig Federighi, Apple's SVP of Software Engineering, held a post-keynote tech speech (via 9to5Mac) with property connected Monday alongside AI VP Amar Subramanya, Siri pb Mike Rockwell, and bundle VP Sebastien Marineau-Mes to locomotion done however the third-generation AFM household was built and however it powers Apple Intelligence.

"The magnitude of the Google Assistant we usage is none," Federighi said, explaining that Apple uses nary of the Gemini models deployed to Google's customers, nary of Google's client-side code, and nary Google Search infrastructure arsenic the cognition backbone.

Of course, we don't person the Gemini app arsenic our app. In fact, nary of that lawsuit codification is portion of however we tally connected iOS. For these models, we usage nary of the models that Google deploys to their customers, nor bash we usage the infrastructure and means by which they deploy models to their customers. And then, erstwhile it comes to the cognition base, we of people don't usage Google Search oregon thing similar that arsenic the instauration of our system.

Subramanya outlined the caller AFM family, which spans 2 on-device models and 3 server-side models. The on-device tier consists of AFM Core, a next-generation dense architecture model, and AFM Core Advanced, which uses a sparse architecture and is natively multimodal.

Subramanya said AFM Core Advanced is "unlike immoderate on-device exemplary we've tally before," enabling caller features including invitation and expressive voices without immoderate unreality requests. On the server side, AFM Cloud handles latency-optimized Private Cloud Compute requests, portion AFM Cloud Image powers representation procreation and editing features including spatial reframing.

The cardinal item connected the Google collaboration came successful Subramanya's statement of however these 4 models were trained. "All of these are customized built for Apple Silicon, trained utilizing proprietary information with reinforcement learning and refined utilizing outputs from Gemini frontier models," helium said, making wide that Google's publication was distillation-based, not a wholesale adoption of Gemini.

The 5th and astir susceptible model, AFM Cloud Pro, is designed for agentic instrumentality usage and analyzable reasoning tasks, with prime that Subramanya said is "similar to Gemini frontier models." This exemplary marks a departure from Apple's modular Private Cloud Compute setup.

To tally it, Apple worked with some Google and Nvidia to widen its backstage unreality infrastructure to Nvidia GPUs hosted successful Google's cloud. Marineau-Mes said Apple wanted to usage Nvidia's latest chips but required them to beryllium configured truthful they couldn't work the contents of Apple's servers. A caller Nvidia exertion called "ambiguous confidential compute" provided the solution.

We wanted to avail ourselves of the latest exertion from Nvidia, and truthful we acceptable retired to widen backstage unreality compute to third-party cloud.

Federighi described the broader strategy architecture arsenic being organized astir a System Orchestrator, a portion of bundle helium called "key to the privateness architecture of our full system." The orchestrator routes immoderate fixed query to the due model, on-device oregon cloud, based connected the complexity of the petition and the idiosyncratic discourse required.

It draws connected an App Toolbox for in-app actions, a Spotlight Semantic Index for idiosyncratic content, and on-screen discourse for real-time awareness. For queries involving existent events, responses are recovered done Apple's ain World Knowledge Service, which Federighi said the institution has been gathering for respective years.

Apple besides maintains that each Private Cloud Compute infrastructure, including the extended Nvidia GPU capableness successful Google's cloud, tin beryllium independently verified by third-party researchers to corroborate that idiosyncratic information is ne'er stored oregon accessed.
This article, "Apple's New AI Models Contain 'None' of Google's Gemini Assistant" archetypal appeared connected MacRumors.com

Discuss this article successful our forums