Skip to playerSkip to main content
  • 6 minutes ago
An Apple executive explains the foundation of Apple Intelligence, revealing how they've combined their own models with Google's Gemini technology. The new system runs both on-device and on private cloud servers for enhanced capabilities.
Transcript
00:00products that you use every day and at the heart of apple intelligence are apple foundation models
00:06this year we embarked on a deep collaboration with google leveraging the technologies behind
00:12their gemini family of models together we created the next generation of apple foundation models
00:18for our integrated apple intelligence experiences and adapted these new models to run on device
00:24and on servers using private cloud compute these powerful server and on-device models unlock a huge
00:32upgrade for apple intelligence with state-of-the-art understanding and reasoning and multiple modalities
00:38like powerful image understanding and generation so you can create realistic images edit photos like
00:45never before and get answers about visual content and we went further optimizing for the most capable
00:53of our apple silicon systems with a second even more powerful version of our on-device model
00:59this model lets supported products understand and generate speech along with understanding text
01:05and images and it delivers even higher accuracy for system-wide dictation better natural language
01:12understanding and incredibly expressive voices next we integrated our models deeply into our platforms
01:19enabling a wide range of system-wide capabilities and apple intelligence securely coordinates across them
01:27with a new system orchestrator these capabilities start with personal context understanding whether you're
01:34looking at a photo from years ago or a note you took recently you can find what you're looking for
01:40just by asking behind the scenes apple intelligence uses spotlight and its powerful semantic index which
01:47quickly surfaces what you need in the moment and it works with any app that integrates with it
01:54plus with broad world knowledge apple intelligence can go out to the web to get up-to-date information
02:00then use private cloud compute to generate an answer whether you're researching for school or brainstorming
02:06for a party and with app actions apple intelligence can draw on the app toolbox to find the right tools
02:14from your apps to complete your request like when you're drafting an email from scratch or editing and
02:20sharing a set of photos
Comments

Recommended