skip to main content
10.1145/3382507.3418841acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
short-paper

Examining the Link between Children's Cognitive Development and Touchscreen Interaction Patterns

Published: 22 October 2020 Publication History

Abstract

It is well established that children's touch and gesture interactions on touchscreen devices are different from those of adults, with much prior work showing that children's input is recognized more poorly than adults? input. In addition, researchers have shown that recognition of touchscreen input is poorest for young children and improves for older children when simply considering their age; however, individual differences in cognitive and motor development could also affect children's input. An understanding of how cognitive and motor skill influence touchscreen interactions, as opposed to only coarser measurements like age and grade level, could help in developing personalized and tailored touchscreen interfaces for each child. To investigate how cognitive and motor development may be related to children's touchscreen interactions, we conducted a study of 28 participants ages 4 to 7 that included validated assessments of the children's motor and cognitive skills as well as typical touchscreen target acquisition and gesture tasks. We correlated participants? touchscreen behaviors to their cognitive development level, including both fine motor skills and executive function. We compare our analysis of touchscreen interactions based on cognitive and motor development to prior work based on children's age. We show that all four factors (age, grade level, motor skill, and executive function) show similar correlations with target miss rates and gesture recognition rates. Thus, we conclude that age and grade level are sufficiently sensitive when considering children's touchscreen behaviors.

Supplementary Material

MP4 File (3382507.3418841.mp4)
It is well established that children?s touchscreen interactions are different from those of adults, and that children?s gestures are recognized more poorly than those of older children and adults. However, individual differences in cognitive development could also affect children?s touchscreen interaction, as opposed to only coarser measurements like age and grade level. Therefore, we conducted a study of 28 participants ages 4 to 7 that included validated assessments of the children?s cognitive development level, including both motor skill and executive function, as well as typical touchscreen target touching and gesture drawing tasks. We show that all four factors (age, grade level, motor skill, and executive function) show significant but moderate correlations with target miss rates and gesture recognition rates. Thus, we conclude that age and grade level are sufficiently sensitive when considering children?s touchscreen behaviors.

References

[1]
Nor Azah Abdul Aziz, Firat Batmaz, Roger Stone, and Paul Wai Hing Chung. 2013. Selection of touch gestures for children's applications. Proceedings of the Science and Information Conference, 721--726. http://doi.org/10.14569/IJACSA.2014.050415
[2]
Lisa Anthony, Quincy Brown, Jaye Nias, and Berthel Tate. 2015. Children (and adults) benefit from visual feedback during gesture interaction on mobile touchscreen devices. International Journal of Child-Computer Interaction 6, 17--27. http://doi.org/10.1016/j.ijcci.2016.01.002
[3]
Lisa Anthony, Quincy Brown, Jaye Nias, Berthel Tate, and Shreya Mohan. 2012. Interaction and recognition challenges in interpreting children's touch and gesture input on mobile devices. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '12), ACM Press, 225--234. http://doi.org/10.1145/2396636.2396671
[4]
Lisa Anthony, Quincy Brown, Berthel Tate, Jaye Nias, Robin Brewer, and Germaine Irwin. 2014. Designing smarter touch-based interfaces for educational contexts. Personal and Ubiquitous Computing 18, 6, 1471--1483. http://doi.org/10.1007/s00779-013-0749--9
[5]
Quincy Brown and Lisa Anthony. 2012. Toward comparing the touchscreen interaction patterns of kids and adults. Proceedings of the SIGCHI Workshop on Educational Software, Interfaces and Technology, 4pp.
[6]
Christine P Dancey and John Reidy. 2007. Statistics without maths for psychology. Pearson Education.
[7]
Katya P. Feder and Annette Majnemer. 2007. Handwriting development, competency, and intervention. Developmental Medicine and Child Neurology 49, 312--317. http://doi.org/10.1111/j.1469--8749.2007.00312.x
[8]
Arnold Gesell and Frances L. Ilg. 1946. The Child from Five to Ten. Harper & Brothers.
[9]
Alexis Hiniker, Kiley Sobel, Sungsoo Ray Hong, Hyewon Suh, India Irish, Daniella Kim, and Julie A. Kientz. 2015. Touchscreen Prompts for Preschoolers: Designing Developmentally Appropriate Techniques for Teaching Young Children to Perform Gestures. Proceedings of the 14th International Conference on Interaction Design and Children, 109--118. http://doi.org/10.1145/2771839.2771851
[10]
Richard Gershon Jerry Slotkin, Michael Kallen, James Griffith, Susan Magasi, John Salsman, Cindy Nowinski. 2012. NIH Toolbox Technical Manual: NIH Dimensional Change Card Sort Task. Retrieved from http://www.healthmeasures.net/images/nihtoolbox/Technical_Manuals/Cognition/Toolbox_Dimensional_Change_Card_Sort_Test_Technical_Manual.pdf
[11]
H. K. Kabali, M. M. Irigoyen, R. Nunez-Davis, J. G. Budacki, S. H. Mohanty, K. P. Leister, and R. L. Bonner. 2015. Exposure and Use of Mobile Media Devices by Young Children. Pediatrics 136, 6, 1044--1050. http://doi.org/10.1542/peds.2015--2151
[12]
Hong-hoe Kim, Paul Taele, Stephanie Valentine, Erin McTigue, and Tracy Hammond. 2013. KimCHI: a sketch-based developmental skill classifier to enhance pen-driven educational interfaces for children. Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling (SBIM '13), ACM Press, 33--42. http://doi.org/10.1145/2487381.2487389
[13]
Richard Gershon Michael Kallen, Jerry Slotkin, James Griffith, Susan Magasi, John Salsman, Cindy Nowinski. 2012. NIH Toolbox Technical Manual: NIH Toolbox 9 Hole Pegboard Dexterity Test. Retrieved from http://www.healthmeasures.net/images/nihtoolbox/Technical_Manuals/Motor/Toolbox_9-Hole_Pegboard_Dexterity_Test_Technical_Manual.pdf
[14]
Vicente Nacher, Javier Jaen, Elena Navarro, Alejandro Catala, and Pascual Gonzalez. 2015. Multi-touch gestures for pre-kindergarten children. International Journal of Human Computer Studies 73, 37--51. http://doi.org/10.1016/j.ijhcs.2014.08.004
[15]
Jean Piaget. 1983. Piaget's Theory. In Handbook of Child Psychology, P Mussen (ed.). Wiley & Sons, New York, NY, USA.
[16]
John W Santrock. 2006. Life-span development. McGraw-Hill.
[17]
C. M. Schneck and A. Henderson. 1990. Descriptive analysis of the developmental progression of grip position for pencil and crayon control in nondysfunctional children. The American journal of occupational therapy.?: official publication of the American Occupational Therapy Association 44, 10, 893--900. http://doi.org/10.5014/ajot.44.10.893
[18]
Mike Sharples, Inmaculada Arnedillo-Sánchez, Marcelo Milrad, and Giasemi Vavoula. 2009. Mobile Learning: Small Devices, Big Issues. Mobile Learning: Small Devices, Big Issues.
[19]
Carly Shuler. 2009. Pockets of Potential: Using Mobile Technologies to Promote Children's Learning. Joan Ganz Cooney Center at Sesame Workshop, New York, NY. Retrieved August 23, 2012 from http://www.joanganzcooneycenter.org/publication/industry-brief-pockets-of-potential-using-mobile-technologies-to-promote-childrens-learning/
[20]
Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures as point clouds: a $P recognizer for user interface prototypes. Proceedings of the ACM International Conference on Multimodal Interaction (ICMI '12), ACM Press, 273--280. http://doi.org/10.1145/2388676.2388732
[21]
Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '07), ACM Press, 159--168. http://doi.org/10.1145/1294211.1294238
[22]
Julia Woodward, Alex Shaw, Aishat Aloba, Ayushi Jain, Jaime Ruiz, and Lisa Anthony. 2017. Tablets, tabletops, and smartphones: cross-platform comparisons of children's touchscreen interactions. Proceedings of the International Conference on Multimodal Interaction (ICMI '17), ACM Press, 5--14.
[23]
Julia Woodward, Alex Shaw, Annie Luc, Brittany Craig, Juthika Das, Phillip Hall, Akshay Hollay, Germaine Irwin, Danielle Sikich, Quincy Brown, and Lisa Anthony. 2016. Characterizing How Interface Complexity Affects Children's Touchscreen Interactions. Proceedings of the ACM International Conference on Human Factors in Computing Systems (CHI '16), ACM Press, 1921--1933. http://doi.org/10.1145/2858036.2858200

Cited By

View all

Index Terms

  1. Examining the Link between Children's Cognitive Development and Touchscreen Interaction Patterns

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction
    October 2020
    920 pages
    ISBN:9781450375818
    DOI:10.1145/3382507
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 October 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. child
    2. cognitive
    3. gesture
    4. motor
    5. nih toolbox
    6. touchscreen

    Qualifiers

    • Short-paper

    Funding Sources

    • National Science Foundation

    Conference

    ICMI '20
    Sponsor:
    ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
    October 25 - 29, 2020
    Virtual Event, Netherlands

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)18
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 03 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media