One of the most notable and highly anticipated features is the integration with ChatGPT, which allows you to ask Siri about what's showing on your device's screen.
With ChatGPT integrated into Siri, Apple’s virtual assistant will use OpenAI’s platform to answer complex questions. Not only that, Siri can also read what’s on your iPhone, iPad, or Mac screen. For example, if you’re looking at a video or photo on Instagram, you can ask questions like “where is this?” or “what building is in that photo?”
Siri will take a screenshot and upload it to ChatGPT, allowing it to understand the context and use its database to provide a response. Of course, for security reasons, Siri always asks for permission before taking a screenshot and uploading it to ChatGPT.
This feature is especially useful for those who don’t have an iPhone 16, the only device that currently supports Visual Intelligence. With Visual Intelligence, users can tap Camera Control to get information about what they’re seeing through the camera. Visual Intelligence uses Apple Intelligence, ChatGPT, and Google to provide answers.
If you're using an iPhone 15 Pro or compatible iPad, you can simply take a photo and then ask Siri and ChatGPT whatever you want.
Notably, Apple is also working on a feature that will recognize screen content using Apple Intelligence language models. This feature will be released in another iOS 18 update, expected next year. When available, Siri will understand context and perform actions based on what is on the screen, all processed on the device.
In addition to ChatGPT integration, iOS 18.2 also brings new features like Image Playground, Genmoji, and a redesigned Mail app.
Currently, the iOS 18.2 beta is only available for Apple Intelligence-compatible devices, including the iPhone 15 Pro and later and iPads with M1 chips and later. Of course, the update will be released to other devices soon. Apple has said that iOS 18.2 will be released to the public in December.
Meanwhile, iOS 18.1 will launch next week with Apple Intelligence writing tools and notification and text summarization features.
