Apple Unveils Enhanced Accessibility Features Driven by Apple Intelligence

Ahead of Google’s annual developer conference on Tuesday, Apple announced several new accessibility advancements via Apple Intelligence, enhancing features like VoiceOver, voice control, live recognition, and real-time video captioning. Moreover, the update will enable Vision Pro users to control compatible wheelchairs using eye movements.

Apple has indicated that VoiceOver’s image recognition capabilities will see enhancements, providing more comprehensive descriptions of images. For instance, it can read aloud essential details from a bill, including the total amount and due date, and offer improved descriptions for photographs and personal documents.

The Live Recognition feature is now accessible on iPhones, utilizing the camera to recognize visible objects and enabling follow-up questions for further details. Users with low vision can set the Magnifier to the action button for a high-contrast display of content. Additionally, voice commands like “zoom in” or “turn on flashlight” are now available for more streamlined feature access.

Voice command capabilities go beyond the Magnifier app. Apple revealed that users can express actions naturally to interact with on-screen content. For instance, in Apple Maps, one could say, “tap the guide about best restaurants,” or in the Files app, say, “tap the purple folder.”

Apple is also set to upgrade the Reader, allowing it to process intricate documents like scientific papers with multiple columns, images, and tables more effectively.

Coming soon, users can expect AI-generated summaries or the ability to read text in their preferred language while preserving customized fonts and colors. The updated reader will also cater to various disabilities, including dyslexia and low vision.

Additionally, Apple is introducing AI-generated subtitles for videos that do not have pre-existing captions. This will extend to videos recorded on iPhones or shared by friends and family. The automated subtitles will function across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, with users having control over their appearance.

Moreover, Apple introduced a new feature that allows Vision Pro users to navigate compatible wheelchairs through eye movements. This functionality is designed to work seamlessly in various lighting conditions without requiring recalibration, launching first with Tolt and LUCI alternative drive systems in the U.S. and compatible with Bluetooth and wired accessories.

Apple emphasized that its name recognition feature, which alerts users with hearing impairments when their name is called, now supports 50 languages. Plans to expand to large text support for tvOS and enhance transitions for Made for iPhone hearing aids between devices are also in the works.

These promising updates are anticipated to be accessible to users later this year, likely as part of Apple’s upcoming iOS 27 release.