demonstration

Interactive rich reading: enhanced book reading experience with a conversational agent

Authors:

Mirjana SpasojevicAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 825 - 826

https://doi.org/10.1145/2072298.2072478

Published: 28 November 2011 Publication History

Get Access

Abstract

In this work, we introduce Interactive Rich Reading, a new enhanced book experience designed to run on smartphones and a tablet device. Interactive Rich Reading is characterized by a video-based conversational agent that asks questions or makes comments about the current page and is specifically designed to promote engagement with the contents of children's books. We use video compositing techniques to overlay the conversational agent directly over the book contents, creating a magical experience for children by bringing the book to life. We describe technical issues related to enabling this experience on mobile platforms for easier adoption of this technique by other researchers and practitioners.

References

[1]

Raffle, H., Revelle, G., Mori, K., Ballagas, R., Buza, K., Horii, H., Kaye, J., Cook, K., Freed, N., Go, J., Spasojevic, M. "Hello, is Grandma there? Let's Read! StoryVisit: Family Video Chat and Connected E-Books." Proc. CHI 2011, 1195--1204.

Digital Library

Google Scholar

[2]

Richter, R. A., Robb, M. B., and Smith, E. I. Media as social partners: The social nature of young children's learning from social media. Child Development, 82(1):82--95, Jan/Feb 2011.

Crossref

Google Scholar

[3]

Whitehurst, G. J., Falco, F. L., Lonigan, C. J., Fischel, J. E., DeBaryshe, B. D., Valdez-Menchaca, M. C., et al. (1988). "Accelerating language development through picture book reading." Developmental Psychology, 24(4), 552--559.

Crossref

Google Scholar

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
He KLevine JCervera KOjeda-Ramirez SXu YWarschauer M(2024)A Home Study of Parent-Child Co-Reading with a Bilingual Conversational AgentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650836(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650836
Cutrupi CFadda SValcarenghi GCosentino GCatania FSpitale MGarzotto FTorres MSchlögl SClark LPorcheron M(2020)SmemoProceedings of the 2nd Conference on Conversational User Interfaces10.1145/3405755.3406162(1-3)Online publication date: 22-Jul-2020
https://dl.acm.org/doi/10.1145/3405755.3406162
Show More Cited By

Index Terms

Interactive rich reading: enhanced book reading experience with a conversational agent
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Read, Play and Learn: An Interactive E-book for Children with Autism
GALA 2015: Revised Selected Papers of the 4th International Conference on Games and Learning Alliance - Volume 9599

Serious games can easily engage students, captivate and maintain their attention allowing them both learning with an adult, or on their own. But, teaching children with developmental disabilities like ASD, requires special set of tools and methods, due ...
Exploring audience reading behaviour through interactive public displays
HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction Conference

This paper focuses on how people read and respond to text on static and dynamic display screens in public spaces. It aims to explore what is effective and engaging about the interactive experience in reading, as well as exploring the engagement ...
Teaching with an Interactive E-book to Improve Children's Online Privacy Knowledge
IDC '16: Proceedings of the The 15th International Conference on Interaction Design and Children

We designed the Cyberheroes interactive e-book and conducted a preliminary user study to test its effectiveness in educating children aged 7 to 9 about online privacy risks. Children and parents found the book to be fun and engaging. Our study included ...

Comments

Information & Contributors

Information

Published In

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
476
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)4

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
He KLevine JCervera KOjeda-Ramirez SXu YWarschauer M(2024)A Home Study of Parent-Child Co-Reading with a Bilingual Conversational AgentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650836(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650836
Cutrupi CFadda SValcarenghi GCosentino GCatania FSpitale MGarzotto FTorres MSchlögl SClark LPorcheron M(2020)SmemoProceedings of the 2nd Conference on Conversational User Interfaces10.1145/3405755.3406162(1-3)Online publication date: 22-Jul-2020
https://dl.acm.org/doi/10.1145/3405755.3406162
Xu YWarschauer MRubegni EVasalou AParés NSawhney N(2020)Exploring young children's engagement in joint reading with a conversational agentProceedings of the Interaction Design and Children Conference10.1145/3392063.3394417(216-228)Online publication date: 21-Jun-2020
https://dl.acm.org/doi/10.1145/3392063.3394417
Storer KBranham SHarrison SBardzell SNeustaedter CTatar D(2019)"That's the Way Sighted People Do It"Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322374(385-398)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322374
Ju SLee KKim SPark YBrewster SFitzpatrick GCox AKostakos V(2019)BooklyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300614(1-8)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300614
Schafer GFullerton SWalker IVijaykumar AGreen KKoskinen ILim YCerratto-Pargman TChow KOdom W(2018)Words Become WorldsProceedings of the 2018 Designing Interactive Systems Conference10.1145/3196709.3196728(511-522)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3196709.3196728
Sargeant BMueller FMandryk RHancock MPerry MCox A(2018)How Far Is Up?Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174093(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174093
Kang DTian FSahandi R(2017)Interactive illustration of collage for children with folktale e-bookJournal of Visualization10.1007/s12650-016-0403-520:3(639-650)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1007/s12650-016-0403-5
Kang DYoon KCostabile MBuono PMatera M(2016)A Study on Developing the Interface of Mobile E-learning Application for Children's Foreign Language EducationProceedings of the International Working Conference on Advanced Visual Interfaces10.1145/2909132.2926074(320-321)Online publication date: 7-Jun-2016
https://dl.acm.org/doi/10.1145/2909132.2926074
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Read, Play and Learn: An Interactive E-book for Children with Autism

Exploring audience reading behaviour through interactive public displays

Teaching with an Interactive E-book to Improve Children's Online Privacy Knowledge

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Read, Play and Learn: An Interactive E-book for Children with Autism

Exploring audience reading behaviour through interactive public displays

Teaching with an Interactive E-book to Improve Children's Online Privacy Knowledge

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations