Siri now can interpret what is displayed on a screen and respond accordinglyLast updated: June 09, 2026 | 07:463 MIN READThis photograph shows wordmark of Siri, a digital assistant developed by Apple Inc., displayed on a smartphone in Bordeaux, south-western France on February 14, 2025.AFP-PHILIPPE LOPEZSiri is becoming a lot more aware of what's happening on your device.At WWDC 2026, Apple unveiled a major overhaul of its voice assistant, introducing new AI-powered capabilities that allow Siri to understand on-screen content, recall information across apps and help users complete tasks with far less manual searching.One of the standout additions is Siri's ability to interpret what is displayed on a screen and respond accordingly. Whether a user is looking at a screenshot, an email, a photo or a schedule, the assistant can identify relevant information and suggest actions. During demonstrations, Apple showed Siri pulling details from screenshots, creating calendar events and finding related information based on what was visible on the device.The assistant can also search through messages, emails and photos to surface useful details, helping users locate things such as restaurant suggestions, hotel bookings or older images more quickly.Apple is also introducing a standalone Siri app that keeps a private history of conversations. The feature allows users to revisit previous chats and continue them across devices, with conversations syncing securely through iCloud between iPhone, iPad and Mac.The upgrade is part of Apple's broader Apple Intelligence push, which aims to make Siri more context-aware and capable of handling natural, multi-step conversations. According to the company, the assistant can better understand follow-up questions and personal context, reducing the need for users to repeat information during interactions.Beyond answering questions, Siri is also being positioned as a productivity tool. Apple says the assistant can help draft messages, review documents, suggest edits and proofread text across the system, including within third-party apps.Visual Intelligence is expanding as well. The feature will now be available across iPhone, iPad, Mac and visionOS. On iPhone, Siri can use the camera to identify nearby objects and answer related questions, while Mac and iPad users can analyse screenshots and other on-screen content to perform visual searches and complete actions.Apple has also updated Siri's voice capabilities, introducing improved speech recognition, more expressive voices and enhanced dictation. The assistant can automatically handle punctuation, formatting and capitalisation while users speak, and users will be able to adjust elements of Siri's speaking style and pace.Accessing Siri remains familiar, with support for the "Hey Siri" command still in place. On supported iPhones, users can also activate the assistant using the side button or through a swipe-down gesture from the Dynamic Island.The redesigned Siri experience will launch first in English, with support for additional languages expected to expand over time.Siri (WWDC 2026) — Full List of New FeaturesBuilt using Apple Intelligence with major AI upgradesBetter understanding of follow-up questions and conversational contextImproved personal context awareness (remembers user-related info during use)Can understand and act on on-screen content (screen awareness)Can extract information from screenshotsCan add events directly to Calendar from what’s on screenCan search and use information from Messages, Emails and PhotosMore natural, expressive voicesImproved speech recognition and dictation accuracyDictation now automatically handles punctuation, capitalisation and formattingCustomisable voice pace and speaking styleRefreshed Siri interface across Apple devicesNew access methods on iPhone via side button and Dynamic Island swipeDedicated standalone Siri appPrivate conversation history stored in the Siri appConversations sync securely across iPhone, iPad and Mac via iCloudDeeper integration with Spotlight and contextual menus on iPad and MacAbility to query files, images and text directly from the screenExpanded Visual Intelligence across iPhone, iPad, Mac and visionOSCamera-based object recognition and contextual Q&A on iPhoneScreenshot and on-screen visual search on iPad and MacProductivity tools: drafting messages, planning tasks and reviewing documentsWriting assistance: generates drafts, suggests edits and proofreads text systemwideWorks across Apple apps and supported third-party appsInitially launches in English, with more languages coming laterAlso In This PackageGet Updates on Topics You ChooseUp Next
Apple’s biggest Siri upgrade: It can now understand your screen and act on what it sees instantly
Siri now can interpret what is displayed on a screen and respond accordingly











