skip to main content
10.1145/2702123.2702250acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Exploring Expressive Augmented Reality: The FingAR Puppet System for Social Pretend Play

Published: 18 April 2015 Publication History

Abstract

We present "FingAR Puppet", an Augmented Reality (AR) system enhancing social pretend play by young children. Unlike goal-oriented AR systems that augment reality with informative instructions, FingAR Puppet helps children associate expressive interpretations with immediate reality. Empirical results show that FingAR Puppet promotes reasoning about emotional states, communication and divergent thinking during social pretend play for children 4-6 years old. We suggest that this study opens an interesting space for future AR systems to support complex cognitive and social development in early childhood. We also identify broader implications from using theories of cognitive development to guide the design of tangible and augmented interactions.

References

[1]
R. T. Azuma et al. A survey of augmented reality. Presence, 6(4):355--385, 1997.
[2]
Z. Bai, A. F. Blackwell, and G. Coulouris. Through the looking glass: Pretend play for children with autism. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, pages 49--58. IEEE, 2013.
[3]
C. Barnes, D. E. Jacobs, J. Sanders, D. B. Goldman, S. Rusinkiewicz, A. Finkelstein, and M. Agrawala. Video puppetry: a performative interface for cutout animation. In ACM Transactions on Graphics (TOG), volume 27, page 124. ACM, 2008.
[4]
A. L. Brown and M. J. Kane. Preschool children can learn to transfer: Learning to learn and learning from example. Cognitive Psychology, 20(4):493--523, 1988.
[5]
K. Coolahan, J. Fantuzzo, J. Mendez, and P. McDermott. Preschool peer interactions and readiness to learn: Relationships between classroom peer play and learning behaviors and conduct. Journal of Educational Psychology, 92(3):458, 2000.
[6]
P. Dourish. Where the action is: the foundations of embodied interaction. MIT press, 2004.
[7]
J. Dunn, J. Brown, C. Slomkowski, C. Tesla, and L. Youngblade. Young children's understanding of other people's feelings and beliefs: Individual differences and their antecedents. Child development, 62(6):1352--1366, 1991.
[8]
D. Edge, A. Blackwell, and L. Dubuc. The physical world as an abstract interface. Contemporary Ergonomics, pages 224--228, 2006.
[9]
P. Ekman. An argument for basic emotions. Cognition & Emotion, 6(3--4):169--200, 1992.
[10]
W. Farr, N. Yuill, and S. Hinske. An augmented toy and social interaction in children with autism. International Journal of Arts and Technology, 5(2):104--125, 2012.
[11]
G. G. Fein. Pretend play in childhood: An integrative review. Child development, pages 1095--1118, 1981.
[12]
C. Garvey and R. Berndt. The organization of pretend play. 1975.
[13]
Y. Guiard. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior, 19(4):486--517, 1987.
[14]
N. K. Hayles. How we think: Digital media and contemporary technogenesis. University of Chicago Press, 2012.
[15]
S. E. Hunter, P. Maes, A. Tang, K. M. Inkpen, and S. M. Hessey. Waazam!: supporting creative play at a distance in customized video environments. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, pages 1197--1206. ACM, 2014.
[16]
A. M. Leslie. Pretense and representation: The origins of theory of mind. Psychological review, 94(4):412, 1987.
[17]
A. Lillard. Pretend play as twin earth: A social-cognitive analysis. Developmental Review, 21(4):495--531, 2001.
[18]
F. Lu, F. Tian, Y. Jiang, X. Cao, W. Luo, G. Li, X. Zhang, G. Dai, and H. Wang. Shadowstory: creative and collaborative digital storytelling inspired by cultural heritage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1919--1928. ACM, 2011.
[19]
R. MacLaren and D. Olson. Trick or treat: Children's understanding of surprise. Cognitive development, 8(1):27--46, 1993.
[20]
P. Maes, T. Darrell, B. Blumberg, and A. Pentland. The alive system: Wireless, full-body interaction with autonomous agents. Multimedia Systems, 5(2):105--112, 1997.
[21]
P. Marshall, Y. Rogers, and M. Scaife. Puppet: a virtual environment for children to act and direct interactive narratives. In 2nd international workshop on narrative and interactive learning environments, pages 8--15, 2002.
[22]
M. Nitsche and S. Nayak. Cell phone puppets: turning mobile phones into performing objects. In Entertainment Computing-ICEC 2012, pages 363--372. Springer, 2012.
[23]
J. Piaget. Play, dreams and imitation in childhood, volume 25. Routledge, 2013.
[24]
D. Premack and G. Woodruff. Does the chimpanzee have a theory of mind? Behavioral and brain sciences, 1(04):515--526, 1978.
[25]
I. Radu and B. MacIntyre. Using children's developmental psychology to guide augmented-reality design and usability. In Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on, pages 227--236. IEEE, 2012.
[26]
A. Rosenfeld and J. L. Pfaltz. Sequential operations in digital picture processing. Journal of the ACM (JACM), 13(4):471--494, 1966.
[27]
T. Ruffman and T. R. Keenan. The belief-based emotion of suprise: The case for a lag in understanding relative to false belief. Developmental Psychology, 32(1):40, 1996.
[28]
M. A. Runco. Divergent thinking. Ablex Publishing, 1991.
[29]
M. A. Runco and R. S. Albert. The reliability and validity of ideational originality in the divergent thinking of academically gifted and nongifted children. Educational and Psychological Measurement, 45(3):483--501, 1985.
[30]
S. W. Russ. Play, creativity, and adaptive functioning: Implications for play interventions. Journal of Clinical Child Psychology, 27(4):469--480, 1998.
[31]
K. Ryokai and J. Cassell. Computer support for children's collaborative fantasy play and storytelling. In Proceedings of the 1999 conference on Computer support for collaborative learning, page 63. International Society of the Learning Sciences, 1999.
[32]
K. Ryokai, H. Raffie, and R. Kowalski. Storyfaces: pretend-play with ebooks to support social-emotional storytelling. In Proceedings of the 11th International Conference on Interaction Design and Children, pages 125--133. ACM, 2012.
[33]
R. K. Sawyer. Levels of analysis in pretend play discourse: Metacommunication in conversational routines. PLAY AND CULTURE STUDIES, 5:137--158, 2003.
[34]
B. Shneiderman. Direct manipulation: a step beyond programming languages. Sparks of Innovation in Human-Computer Interaction, 17, 1993.
[35]
S. Smilansky. The effects of sociodramatic play on disadvantaged preschool children. Wiley New York, 1968.
[36]
H. Tager-Flusberg and K. Sullivan. Attributing mental states to story characters: A comparison of narratives produced by autistic and mentally retarded individuals. Applied Psycholinguistics, 16(03):241--256, 1995.
[37]
F. Zhou, H. B.-L. Duh, and M. Billinghurst. Trends in augmented reality tracking, interaction and display: A review of ten years of ismar. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 193--202. IEEE Computer Society, 2008.
[38]
Z. Zhou, A. D. Cheok, J. Tedjokusumo, and G. S. Omer. wizqubestm--a novel tangible interface for interactive storytelling in mixed reality. Int J Virtual Real, 7(4):9--15, 2008.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
April 2015
4290 pages
ISBN:9781450331456
DOI:10.1145/2702123
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. children
  3. pretend play
  4. tangible user interface

Qualifiers

  • Research-article

Funding Sources

  • University of Cambridge

Conference

CHI '15
Sponsor:
CHI '15: CHI Conference on Human Factors in Computing Systems
April 18 - 23, 2015
Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)62
  • Downloads (Last 6 weeks)7
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media