In increasing accessible technology, persons with disabilities such as Amyotrophic lateral sclerosis (ALS), motor neuron disease (MND), cerebral palsy, or spinal cord injury can now control their iPad using only their eyes and the newly introduced device.
TD Pilot brings sound and control
TD Pilot allows users to control iPad, use apps, and even produce natural-sounding speech using their eyes. It relies on support for eye tracking devices that Apple introduced in iPadOS 15 and is medically certified for use by people with disabilities such as ALS and Cerebral Palsy.
This product is an official Made for iPad accessory developed by Tobii subsidiary Tobii Dynavox in collaboration with Apple. Tobii is a global leader in eye tracking technology, with solutions used in thousands of companies and research institutes worldwide.
What is this and what does it do?
The system uses an iPad, a custom cover, and the Tobii Dynavox app running on the device. These apps include TD Talk, which produces natural-sounding speech, and TD Snap, which is described as a symbol-supported solution to facilitate communication.
Sturdy waterproof and dust-resistant covers are also noteworthy. It augments the iPad with additional features, including powerful speakers, a battery, and a wheelchair mount and offers a small, rear-mounted display that mirrors what TD Pilot users are saying to help make face-to-face communication feel more natural.
Eye-tracking technology isn’t reliable in bright light, but TD Pilot says its system, which is currently available, can track eyes even in bright sunlight.
Apple builds the basic technology
Product introduction is not easy. Not only have Apple and Tobii worked together to develop it for some time, but iPadOS support has been around for years.
Apple has always been at the forefront of accessibility. But some features, such as eye tracking or motion detection, take time to build, even though the device can already be controlled using the innovative Voice Over technology.
The principles of building them and they will come also apply here, of course. Now that Apple’s mobile products support a wide range of accessibility features, it seems inevitable that we will see more developers bringing this kind of solution to the Apple market.
Sarah Herrlinger, Apple’s senior director of Global Accessibility Policy and Initiatives, said in a TD Pilot statement:
“We are excited that the people who need this technology will have the opportunity to control the iPad using just their eyes…. We built basic technology, including support for eye tracking, into our operating system to make it accessible, and we’re excited that TD Pilot Tobii Dynavox is leveraging it to enable people with disabilities to pursue their passions.”
With Apple’s AI/ML Accessibility research lead, Jeffrey Bigham, Herrlinger will speak at the Global Sight Tech Conference on December 1st (The session that involved them was called “Designing for Everyone: Accessibility and Machine Learning at Apple.”) Herrlinger also spoke at the same event in 2020, when he focused on VoiceOver Recognition and machine learning.
Tools that make a difference
Solutions like these can make a real difference to people. Team Gleason is one of the largest ALS nonprofit organizations. Its Chief Impact Officer, Blair Casey, called the launch of TD Pilot for iPad a “significant turning point for accessibility.”
In part, that’s because this advanced technology is now available on iPad for the first time, even though it’s been on Windows from the start. “So many people who need eye-tracking technology are forced to abandon their original technology,” Casey said.
If there’s a hitch, it’s the cost.
Complete systems can cost thousands of dollars. And while it’s available for the iPad, it’s not on the Mac yet. It seems inevitable that the price will put this out of the reach of many who will benefit from it, even though the payoff can be huge. To be fair, this is not a plug-and-play solution; a lot of work also has to be done around training and assessing one’s condition.
Competitive solutions using the same technology are also starting to emerge, so it is hoped that costs will come down over time, allowing more people to use this technology.