When You Can't Touch a Touch Screen

Abstract

A touch screen can be an intuitive interface method for many people. Mobile phones, tablets, and tablet computer combinations have made this technology part of daily use. Touchscreen technologies are common and present unique difficulties for individuals who require alternative access methods. Dedicated augmentative and alternative communication systems continue to offer a range of access methods, but it is also important to examine existing accessibility options from mainstream companies (e.g., Microsoft [Redmond, WA], Apple [Cupertino, CA]) and how current tools can be used to allow individuals to interact with touch screen technologies. An overview of current accessibility features available on popular mainstream devices (e.g., Microsoft Surface, Apple iPad) is provided along with discussion of alternative access methods for current technologies, future research directions, and the potential impact of speech recognition, virtual reality, and augmented reality for interfacing with multiple devices.

Keywords

Alternative access - augmentative and alternative communication - accessibility - scanning - assistive technology

• References

• 1 Ion F. From touch displays to the surface: a brief history of touchscreen technology. Ars Technica. April 4, 2013. Available at: https://arstechnica.com/gadgets/2013/04/from-touch-displays-to-the-surface-a-brief-history-of-touchscreen-technology/ . Accessed February 8, 2017
• 2 Light J, McNaughton D. Putting people first: re-thinking the role of technology in augmentative and alternative communication intervention. Augment Altern Commun 2013; 29 (04) 299-309
• 3 Beukelman DR, Mirenda P. Augmentative and Alternative Communication: Supporting Children and Adults with Complex Communication Needs. 4rth ed. Baltimore, MD: Paul H. Brookes Publishing Companies; 2013
• 4 Fager S, Beukelman DR, Fried-Oken M, Jakobs T, Baker J. Access interface strategies. Assist Technol 2011; 24 (01) 25-33
• 5 Paivi M, Ulla-Kaija A, Spakov O. Fast gaze typing with an adjustable dwell time. Proceedings of CHI 09. Boston, MA: ACM Press; 2009
• 6 Yorkston K, Beukelman DR, Tice R. Sentence Intelligibility Test for Macintosh. Lincoln, NE: Communication Disorders Software; 1996
• 7 Fiannaca A, Paradiso A, Shah M, Ringel Morris M. AAcrobat: Using Mobile Devices to Lower Communication Barriers and Provide Autonomy with Gaze-based AAC. Boston, MA: ACM Press; 2017
• 8 Hill K, Kovacs T, Shin S. Critical issues using brain-computer interfaces for augmentative and alternative communication. Arch Phys Med Rehabil 2015; 96 (3, Suppl): S8-S15
• 9 Wagner BT, Jackson HM. Developmental memory capacity resources of typical children retrieving picture communication symbols using direct selection and visual linear scanning with fixed communication displays. J Speech Lang Hear Res 2006; 49 (01) 113-126
• 10 White AR, Carney E, Reichle J. Group-item and directed scanning: examining preschoolers' accuracy and efficiency in two augmentative communication symbol selection methods. Am J Speech Lang Pathol 2010; 19 (04) 311-320
• 11 Light J, McNaughton D. Supporting the communication, language, and literacy development of children with complex communication needs: state of the science and future research priorities. Assist Technol 2011; 24 (01) 34-44
• 12 McCarthy J, Light J, Drager K. , et al. Re-designing scanning to reduce learning demands: the performance of typically developing 2-year-olds. Augment Altern Commun 2006; 22 (04) 269-283
• 13 McCarthy JW, Boster JB. A comparison of the performance of 2.5 to 3.5-year-old children without disabilities using animated and cursor-based scanning in a contextual scene. Assist Technol 2017; 1-8 [Epub ahead of print]
• 14 Blackstone S. Circles of communication partners. Augmentative Communication News 1999; 12: 1-2 :1–10
• 15 Sharf S. The world's largest tech companies 2016: Apple bests Samsung, Microsoft and alphabet. Forbes 2016;26(May). Available at: https://www.forbes.com/sites/samanthasharf/2016/05/26/the-worlds-largest-tech-companies-2016-apple-bests-samsung-microsoft-and-alphabet/#17c9f359b661 . Accessed March 15, 2017
• 16 Purcher J. Apple wins patent for advanced 3D eye/head tracking system supporting apple's 3D camera. Patently Apple. August 23, 2016. Available at: http://www.patentlyapple.com/patently-apple/2016/08/apple-wins-patent-for-advanced-3d-eyehead-tracking-system-supporting-apples-3d-camera.html . Accessed February 24, 2017
• 17 Phoneia Technology & Entertainment. EVA facial mouse, control your phone only with nods. Available at: http://phoneia.com/eva-facial-mouse-control-your-phone-only-with-nods/ . Accessed February 22, 2017
• 18 Parker M, Cunningham S, Enderby P, Hawley M, Green P. Automatic speech recognition and training for severely dysarthric users of assistive technology: the STARDUST project. Clin Linguist Phon 2006; 20 (2–3): 149-156
• 19 McKalin V. Augmented reality vs. virtual reality: what are the differences and similarities. Tech Times. April 6, 2014. Available at: http://www.techtimes.com/articles/5078/20140406/augmented-reality-vs-virtual-reality-what-are-the-differences-and-similarities.htm . Accessed March 15, 2017
• 20 Ernest Labs. Reading in virtual reality. Available at: http://earnest-labs.com/reading-in-virtual-reality/ . Accessed March 15, 2017
• 21 Charlton J. Nothing About Us Without Us: Disability Oppression and Empowerment. 1st ed. Berkeley, CA: University of California Press; 1998