User-defined gestures for surface computing

JO Wobbrock, MR Morris, AD Wilson - Proceedings of the SIGCHI …, 2009 - dl.acm.org
Proceedings of the SIGCHI conference on human factors in computing systems, 2009dl.acm.org
Many surface computing prototypes have employed gestures created by system designers.
Although such gestures are appropriate for early investigations, they are not necessarily
reflective of user behavior. We present an approach to designing tabletop gestures that
relies on eliciting gestures from non-technical users by first portraying the effect of a gesture,
and then asking users to perform its cause. In all, 1080 gestures from 20 participants were
logged, analyzed, and paired with think-aloud data for 27 commands performed with 1 and 2 …
Many surface computing prototypes have employed gestures created by system designers. Although such gestures are appropriate for early investigations, they are not necessarily reflective of user behavior. We present an approach to designing tabletop gestures that relies on eliciting gestures from non-technical users by first portraying the effect of a gesture, and then asking users to perform its cause. In all, 1080 gestures from 20 participants were logged, analyzed, and paired with think-aloud data for 27 commands performed with 1 and 2 hands. Our findings indicate that users rarely care about the number of fingers they employ, that one hand is preferred to two, that desktop idioms strongly influence users' mental models, and that some commands elicit little gestural agreement, suggesting the need for on-screen widgets. We also present a complete user-defined gesture set, quantitative agreement scores, implications for surface technology, and a taxonomy of surface gestures. Our results will help designers create better gesture sets informed by user behavior.
ACM Digital Library