Apple has unveiled the next generation Apple Intelligence with a bunch of new features across apps like Photos, Passwords, and more. These new capabilities are powered by the next generation of Apple Foundation Models, custom-built in collaboration with Google and its Gemini models for “deeply integrated Apple Intelligence experiences.”
The next generation Apple Intelligence introduces a range of AI-powered features across iPhone, iPad, Mac, Apple Watch, AirPods, and Apple Vision Pro. Built on a new privacy-focused architecture powered by updated Apple Foundation Models, the latest Apple Intelligence experience brings smarter tools to Photos, Safari, Passwords, Messages, Calendar, Home, and more, while also powering the newly unveiled Siri AI.
One of the biggest upgrades arrives in the Photos app with new AI-powered editing tools. Spatial Reframing allows users to adjust the composition of an image after it has been captured by changing the perspective as if the camera had been repositioned during the original shot. Apple says the feature only generates new content where needed to preserve the integrity of the original image.
Then, the new Extend tool can expand photos, fill missing areas when adjusting aspect ratios, and even straighten horizons without cropping important details. Meanwhile, the upgraded Clean Up tool promises more realistic removal of unwanted objects and distractions from complex scenes. Apple notes that AI-edited images will include a hidden SynthID watermark.
Safari is also getting several AI-driven enhancements with the next generation Apple Intelligence, where the Browser can now automatically organise open tabs into topics, helping users manage research projects, travel planning, and other activities across multiple webpages. A new “Notify Me” feature can monitor websites for changes such as product restocks or price drops and alert users when updates occur. Apple is also introducing Describe an Extension, allowing users to create custom Safari extensions by just describing what they want in natural language.
Also Read: Apple Announces iOS 27 with Siri AI: New Features, Supported Models
The Passwords app gets a new capability where beyond identifying weak or compromised credentials, it can now automatically update eligible accounts with stronger passwords by securely navigating websites and making the necessary changes on behalf of users.
Apple’s Image Playground is receiving a major upgrade with support for photorealistic image generation. Users can create highly detailed AI-generated visuals by describing what they want, and can further edit images by tapping, circling, brushing, moving, or resizing elements. Generated images can now be used for Contact Posters, Lock Screen wallpapers, and other system experiences. Like edited photos, AI-generated images will carry hidden SynthID watermarks.
Communication tools are also getting smarter. Messages can now surface contextual one-tap suggestions, such as creating reminders, adding notes, or finding photos relevant to a conversation. Smart Reply in Messages and Mail has been enhanced to better reflect a user’s writing style, while Mail suggestions can now trigger actions within third-party apps.
Apple is also introducing Call Context in the Phone app. When users call a business, the feature can proactively surface relevant information such as reservation numbers, booking references, or confirmation codes found in Mail and other apps. The feature works entirely on-device and does not share information with Apple.
The Calendar app gains natural language event creation and editing. Users can simply describe an event, and Calendar will automatically identify locations, contacts, and other details while generating an appropriate title.
Shortcuts is becoming more accessible with Describe a Shortcut. Instead of manually building automations, users can explain what they want to accomplish, and Apple Intelligence will automatically assemble the required workflow. Users can further refine shortcuts through natural language instructions.
Apple Intelligence is also expanding into the Home app. Accessory notifications can now be grouped into a single activity, making alerts easier to manage. HomeKit Secure Video cameras gain AI-generated video summaries, searchable footage, and a new Noteworthy section that highlights important clips for quick review.
Accessibility features are receiving significant upgrades as well. VoiceOver can provide richer image descriptions, while Live Recognition can answer questions about a user’s surroundings. Voice Control now allows users to describe interface elements instead of memorizing exact commands, and Accessibility Reader gains support for summaries and translations.
Additional enhancements include automatic proofreading across the operating system, intelligent file and folder naming suggestions, improved Genmoji generation, and expanded language support for Workout Buddy on Apple Watch.
Apple says all of these features are powered by a new privacy-first Apple Intelligence architecture that combines on-device processing with Private Cloud Compute. The company states that personal data processed in the cloud is never stored or accessible to Apple, while independent experts can continue verifying those privacy protections.
Next Generation Apple Intelligence: Availability
Developer testing for next generation Apple Intelligence begins today, with a public rollout planned for later this year. Some features, including image generation, have daily usage limits because they rely on powerful server models, as noted by Apple. Increased access is available with most iCloud+ subscription plans, which also include Apple Intelligence support for compatible Home cameras.
Author: Abhishek Malhotra
Source: The Mobile Indian
Reviewed By: Editorial Team
