iOS 18.2 Brings New Siri Functionality for Asking About On-Screen Information

iOS 18.2 Brings New Siri Functionality for Asking About On-Screen Information

iOS 18.2 Brings New Siri Functionality for Asking About On-Screen Information


# Apple’s iOS 18.2: A Major Step Forward with ChatGPT Integration

Apple is set to elevate and enhance user engagement with its forthcoming iOS 18.2 update, currently in its developer beta stage. This release stands out due to its incorporation of OpenAI’s ChatGPT, a functionality that aims to transform how users connect with their devices. With the option to inquire Siri about the content visible on the screen, users can look forward to a more seamless and informative interaction.

## Siri Meets ChatGPT: A Fresh Era of Engagement

Among the most thrilling functionalities of iOS 18.2 is the incorporation of ChatGPT into Siri, Apple’s voice assistant. This improvement enables Siri to utilize OpenAI’s language model to deliver in-depth answers to user questions. For example, if a user is viewing a video or scrolling through images on social media, they can easily ask Siri inquiries such as “Where is this?” or “What building is shown in that photo?”

Siri will capture a screenshot of the current display, submit it to ChatGPT, and provide an informed answer. This procedure prioritizes user privacy; Siri will always request permission before taking a screenshot, guaranteeing that users retain authority over their information.

This addition is particularly advantageous for users with devices lacking the latest Visual Intelligence features, which are currently limited to the iPhone 16. However, owners of the iPhone 15 Pro and compatible iPads can likewise benefit from this capability by taking images and asking Siri for details.

## Upcoming Innovations: Onscreen Awareness

Besides the ChatGPT incorporation, Apple is also crafting its own onscreen awareness functionality, harnessing its proprietary language models. This feature is anticipated to be introduced in a future iOS update, likely next year. Once available, it will enable Siri to comprehend the context of what appears on the screen and execute relevant actions—all processed locally on the device, boosting both speed and privacy.

## Additional Features in iOS 18.2

In addition to the ChatGPT integration, iOS 18.2 is poised to unveil several other thrilling features:

– **Image Playground**: A new feature that empowers users to interact with images creatively.
– **Genmoji**: A feature that seems to enhance the use of emojis, potentially introducing novel forms of expression.
– **Revamped Mail App**: A comprehensive update to the Mail application, designed to elevate user experience and functionality.

Currently, the iOS 18.2 beta is exclusively available for devices equipped with Apple Intelligence, namely the iPhone 15 Pro and later versions, along with M1 iPads and more recent models. Apple has noted that the public launch of iOS 18.2 is anticipated in December, following the release of iOS 18.1, which will debut Apple Intelligence Writing Tools and notification summarization capabilities.

## Conclusion

The incorporation of ChatGPT into Siri represents a significant evolution in how users can engage with their Apple devices. With the ability to pose intricate questions regarding what they view on their screens, users can expect a more dynamic and insightful experience. As Apple continues to enhance and broaden its AI capabilities, the future of iOS appears bright, with groundbreaking features that improve usability while emphasizing privacy and user authority. As we await the public introduction of iOS 18.2, it’s evident that Apple is dedicated to advancing the frontiers of technology and user experience.