Three weeks before WWDC 2021, Apple has begun to communicate some news that will be incorporated in the new versions of the operating systems that will be presented in that edition.
This time it was the turn of the new in accessibility. Normally this type of functionality would have taken time on stage. The fact that they are presented upfront means that the entire time of WWDC is occupied with features and functionality with even greater appeal than revolutionizing accessibility on the iPhone, Apple Watch and Mac.
Apple announced new software features designed for people with reduced mobility, sight and hearing, and people with cognitive disabilities.
By the end of the year, with software updates on all Apple operating systems, people with limb differences will be able navigate the Apple Watch using AssistiveTouch.
The iPad will support third party eye tracking hardware for easier control; and for communities of the blind and visually impaired, Apple's VoiceOver screen reader will use device intelligence to explore the objects within the images.
In support of neurodiversity, Apple will introduce new background sounds to minimize distractions and, for those who are deaf or hard of hearing, Made for iPhone (MFi) will support soon new bi-directional hearing aids.
SignTime
On Thursday, May 20, Apple will launch SignTime. This allows customers to communicate with AppleCare and Retail Customer Service using American Sign Language (ASL) in the United States, British Sign Language (BSL) in the United Kingdom, or French Sign Language (LSF) in France. , directly in their web browsers.
Customers visiting Apple Store locations can also use SignTime to remotely access a sign language interpreter without booking in advance. SignTime will initially launch in the US, UK and France, with plans to expand to other countries in the future. For more information, visit apple.com/contact.
AssistiveTouch per Apple Watch
To support users with limited mobility, Apple introduces a revolutionary new accessibility feature for Apple Watch.
AssistiveTouch per watchOS allows users with upper body differences to enjoy the benefits of the Apple Watch without ever having to touch the screen or controls.
Using built-in motion sensors such as the gyroscope and accelerometer, along with the optical heart rate sensor and on-device machine learning, the Apple Watch is able to detect subtle differences in muscle movement and tendon activity, allowing users to navigate with an on-screen cursor through a series of hand gestures, such as a pinch or a squeeze.
AssistiveTouch on Apple Watch makes it easier for customers with limb differences to answer incoming calls, control an on-screen motion pointer, and access Notification Center, Control Center, and more.
IPad eye tracking support
iPadOS will support third-party eye-tracking devices, allowing people to control iPad using only their eyes. By the end of the year, compatible MFi devices will track where a person is looking on the screen and the pointer will move to follow the person's gaze, while extended eye contact performs an action, such as a touch.
Explore images with VoiceOver
New features for VoiceOver, a screen reader for the blind and visually impaired communities. Building on the recent updates that brought image descriptions to VoiceOver, users can now explore even more details about people, text, table data, and other objects within images.
Users can browse a photo of a receipt as a table: by row and column, with table headers. VoiceOver can also describe a person's location along with other objects within images, so that people can relive memories in detail and with Markup, users can add your own image descriptions to personalize family photos.
Appliances hearing Made for iPhone (MFi) and audiogram support
In a significant update to the MFi hearing aid program, Apple adds the support for new bi-directional hearing aids. The microphones in these new hearing aids allow people who are deaf or hard of hearing to have hands-free conversations on the phone and FaceTime.
Next generation models from MFi partners will be available later this year.
Apple is also leading the support for recognizing audiograms, charts showing the results of a hearing test, at Headphone Accommodations.
Users will be able to quickly customize their audio with the latest hearing test results imported from a paper or PDF audiogram. The headphone settings amplify soft sounds and adjust certain frequencies to suit the user's hearing.
Background sounds
Everyday sounds can be distracting, annoying or overwhelming, and in support of neurodiversity, Apple is introducing new background sounds to minimize distractions and help users focus, stay calm or rest.
Balanced noise, bright or dark, as well as ocean, rain or current sounds are continuously played in the background to mask unwanted ambient or external noise, and sounds are mixed or heard under other audio and system sounds.
Other features coming later this year include:
- Sound Actions for Switch Control replaces physical buttons and switches with mouth sounds, such as a click, pop, or “ee” sound, for non-speaking users with limited mobility.
- The screen settings and text size they can be customized in each application for users with color blindness or other vision problems to make the screen easier to see. Users will be able to customize these settings on a per-application basis for all supported applications.
- New Memoji customizations that better represent users with oxygen tubes, cochlear implants, and a soft helmet.
- The Accessibility Shortcut Gallery offers Siri shortcuts to keep track of medications, daily routines, and a new Accessibility Assistant shortcut helps people discover features and resources to customize them.
