Touchscreen Interaction

Hands on a tabletop touchscreen keyboardWith the transition from desktop computing to mobile devices comes the critical need to ensure that touchscreen interaction is efficient, easy to use, and accessible for the broadest range of users. We’re studying how motor ability impacts touchscreen interaction through both small-scale and large-scale studies, and designing and evaluating new touchscreen interaction techniques to meet each user’s abilities, needs, and context. For example, a lack of tactile feedback and smooth input surface can make touchscreen typing challenging at best. We’ve examined natural typing patterns on flat surfaces and proposed novel input techniques that incorporate gestures and adaptation to improve the typing experience. A key finding: different people exhibit different typing patterns, thus adapting the keyboard layout to suit each user’s typing pattern improves typing performance and satisfaction.

Funding Sources

This work is funded by an NSF CAREER Award (2014-2019) and a Google Faculty Research Award (2012-2013).

Related Publications

Ma, Y., Edge, D., Findlater, L., Tan, H.Z. 2015. Haptic Keyclick Feedback Improves Typing Speed and Reduces Typing Errors on a Flat Keyboard. Proc. IEEE World Haptics Conference (WHC 2015), 220-227.

Ye, H., Malu, M., Oh, U., Findlater, L. 2014. Current and Future Mobile and Wearable Device Use by People With Visual Impairments. Proceedings of CHI 2014, 3123-3132.

Naftali, M., & Findlater, L. 2014. Accessibility in Context: Understanding the Truly Mobile Experience of Smartphone Users with Motor Impairments. Proceedings of ASSETS 2014, 206-216.

Rust, K., Malu, M., Anthony, L., & Findlater, L. 2014. Understanding Child-Defined Gestures and Children’s Mental Models for Touchscreen Tabletop Interaction. Proceedings of Interaction Design and Children (IDC 2014), 201-204.

McNally, B., Guha, M.L., Norooz, L., Rhodes, E., & Findlater, L. 2014. Incorporating Peephole Interactions into Children’s Second Language Learning Activities on Mobile Devices. Proceedings of Interaction Design and Children (IDC 2014), 115-124.

Findlater, L., Froehlich, J., Fattal, K., Wobbrock, J.O., and Dastyar, T. 2013. Age-Related Differences in Performance With Touchscreens Compared to Traditional Mouse InputProceedings of CHI 2013, 343-346. Honorable Mention

Anthony, L., Kim, Y., and Findlater, L. 2013. Analyzing User-Generated YouTube Videos to Understand Touchscreen Use by People With Motor ImpairmentsProceedings of CHI 2013, 1223-1232. Best Paper Award

Oh, U. and Findlater, L. 2013. The Challenges and Potential of End-User Gesture CustomizationProceedings of CHI 2013, 1129-1138.

Oh, U., Kane, S., Findlater, L. 2013. Follow That Sound: Using Sonification and Corrective Verbal Feedback to Teach Touchscreen GesturesProceedings of ASSETS 2013.

Li, F.C.Y., Findlater, L., Truong, K.N. 2013. Effects of Hand Drift While Typing on TouchscreensProceedings of GI 2013, 95-98.

Kim, Y., Sutreja, N., Froehlich, J., Findlater, L. 2013. Surveying the Accessibility of Mobile Touchscreen Games for Persons With Motor Impairments: A Preliminary AnalysisProceedings of ASSETS 2013, Article 68.

Goel, M., Findlater, L., Wobbrock, J.O. 2012. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text EntryProceedings of CHI 2012, 2687-2696. Honorable Mention

Findlater, L., Lee, B., Wobbrock, J.O. 2012. Beyond QWERTY: Augmenting Touch Screen Keyboards With Multi-Touch Gestures for Non-Alphanumeric InputProceedings of CHI 2012, 2679-2682. Honorable Mention

Findlater, L., Wobbrock, J.O. 2012. Personalized Input: Improving Ten-Finger Touchscreen Typing Through Automatic AdaptationProceedings of CHI 2012, 815-824.

Findlater, L., Wobbrock, J.O. 2012. From Plastic to Pixels: In Search of Touch-Typing Touchscreen Keyboards. interactions, 19(3), 44-49.