Apple Intelligence // New AI Features for iPhone, iPad, and Mac

Apple has announced a major update for iPhone, iPad, and Mac users with the launch of Apple Intelligence, an advanced AI feature suite available with iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1. This new offering includes tools for refining writing, enhancing Siri’s interactions, cleaning up images, and more, all designed to improve productivity, simplify device interactions, and respect privacy.

Transformative Features on iPhone, iPad, and Mac

Apple Intelligence introduces capabilities powered by Apple silicon, designed to work across the Apple ecosystem with on-device processing and Private Cloud Compute to keep user data secure. As Apple’s CEO Tim Cook shared, the platform leverages Apple’s advancements in AI and machine learning, integrating these tools to help users accomplish more while prioritizing privacy. Apple Intelligence, as Cook explained, brings generative AI to users in a uniquely Apple way, ensuring seamless functionality and secure data handling.

Craig Federighi, Apple’s Senior VP of Software Engineering, highlighted how Apple Intelligence brings added convenience and usefulness to everyday tasks, from enhancing the Photos app to refining written communication.

Key Features Now Available

• Systemwide Writing Tools: Users can rewrite, proofread, and summarize text in apps like Mail, Messages, and Notes, choosing from options to adapt tone or create summaries in formats like lists or tables.

• Enhanced Siri: Siri now has a more conversational approach and a refreshed design. Users can switch between typing and speaking and can expect Siri to retain context, allowing it to assist with tasks more intuitively.

• Advanced Search and Editing in Photos: With natural language search, finding specific moments, like “beach photos” or “blue shirt,” is easier than ever. The Clean Up tool helps remove unwanted objects from images, preserving the essence of captured moments.

• Prioritization and Summarization in Mail and Notifications: Priority Messages in Mail show important emails first, while Smart Reply and Summarize functions provide quick insights and responses. On the Lock Screen, notifications are summarized, helping users manage what requires their immediate attention.

• Audio Summaries in Notes and Phone: Apple Intelligence allows users to record and transcribe calls, generating summaries for easier reference to key points discussed.

What’s Coming Next?

In December, Apple will add visual intelligence capabilities, including Genmoji for custom emoji creation, and Image Playground for playful image editing. Writing Tools will expand with options for customized text transformations, and a new Camera Control feature will allow users to identify and interact with objects in their environment, such as translating restaurant signage on the go.

Privacy remains a key focus. Apple’s Private Cloud Compute enables advanced AI capabilities without compromising data, allowing external experts to audit Apple’s privacy features. Users can also choose to integrate ChatGPT, accessing its vast knowledge base for more enriched interactions within Siri and Writing Tools, while maintaining privacy protections.

Expanded Availability

Currently available in U.S. English, Apple Intelligence will expand to more languages starting in December, including English variants across several regions, and plans to add additional languages, including Spanish, Japanese, and more, throughout 2024.

Apple Intelligence is accessible on devices with Apple silicon, including iPhone 16 models, iPad with A17 Pro or newer, and Macs with M1 and above.