Cited By
View all- Gildebrant G(2024)Digital reading, digital reader: In search of the definitionsScientific and Technical Libraries10.33186/1027-3689-2024-12-64-79(64-79)Online publication date: 24-Dec-2024
Immersion or Disruption?: Readers’ Evaluation of and Requirements for (3D-)audio as a Tool to Support Immersion in Digital Reading Practices.
Pages 129 - 139
Abstract
In this paper, we aim to contribute to the understanding of how readers experience immersion in digital reading experiences, more specifically with digital reading supported by (3D-)audio tracks. We formulate user and content requirements for implementing (3D-)audio soundtracks for readers in a digital reading application. The main research question addressed in this paper is: (how) can audio aid the immersion of readers in digital fiction stories? To answer this question, three online focus group discussions were organised in Belgium and Germany. As part of the set-up of the Horizon Europe project Möbius, 18 participants tested different 3D-audio tracks while reading via the Thorium Reader application. The results first address how participants define immersion, and how the role of audio in immersion can become paradoxical. Then, the paper presents a detailed evaluation of the factors en- or disabling immersion for the specific 3D-audio tracks, and how these insights can be implemented in reading apps via user and content requirements.
References
[1]
Ackerman, R., & Goldsmith, M. (2011). Metacognitive regulation of text learning: on screen versus on paper. Journal of experimental psychology: Applied, 17(1), 18.
[2]
Acocella, I. (2012). The focus groups in social research: advantages and disadvantages. Quality & Quantity, 46, 1125-1136.
[3]
Agrawal, S., Simon, A. M. D., Bech, S., Bærentsen, K. B., & Forchammer, S. (2020). Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences. Journal of the Audio Engineering Society, 68(6), 404-417.
[4]
Altun, D., Tantekin Erden, F., & Hartman, D. K. (2022). Preliterate young children's reading attitudes: Connections to the home literacy environment and maternal factors. Early Childhood Education Journal, 50(4), 567-578.
[5]
Associazione italiana editori (n.d.). Report on publishing in Italy: Highlights 2018. Retrieved 25 January, 2023 from https://www.aie.it/Portals/_default/Skede/Allegati/Skeda105-4263-2018.10.22/Highlights_2018_DEF_digitale.pdf?IDUNI=s3noxrldf4c55i2j3dusvkgi3961
[6]
Back, M., Cohen, J., Gold, R., Harrison, S., & Minneman, S. (2001, March). Listen reader: an electronically augmented paper-based book. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 23-29).
[7]
Bal, P. M., & Veltkamp, M. (2013). How does fiction reading influence empathy? An experimental investigation on the role of emotional transportation. PloS one, 8(1), e55341.
[8]
Baron, N. S. (2013). Redefining reading: The impact of digital communication media. PMLA, 128(1), 193-200.
[9]
Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The magicbook-moving seamlessly between reality and virtuality. IEEE Computer Graphics and applications, 21(3), 6-8.
[10]
Birkerts, S. (1994). The Gutenberg elegies: The fate of reading in an electronic age. Boston, MA: Faber and Faber.
[11]
Bryman, A. (2016). Social research methods. Oxford university press.
[12]
Bundesverband (n.d.). Studie “Buchkäufer - quo vadis?” 2018. Retrieved 25 January, 2023 from https://www.boersenverein.de/markt-daten/marktforschung/studien-umfragen/studie-buchkaeufer-quo-vadis/
[13]
Clowes, R. W. (2019). Screen reading and the creation of new cognitive ecologies. AI & SOCIETY, 34(4), 705-720.
[14]
Douglas, J. Y. (2001). The End of Books–or Books Without End?: Reading Interactive Narratives. University of Michigan Press.
[15]
Eurostat (2018, 23 April). World Book Day. Retrieved 25 January, 2023 https://ec.europa.eu/eurostat/web/products-eurostat-news/-/EDN-20180423-1
[16]
Federation of European Publishers (n.d.). EUROPEAN BOOK MARKET STATISTICS 2021-2022. Retrieved 25 January, 2023 from https://fep-fee.eu/-Publications-
[17]
Federation of European Publishers (n.d.). THE BOOK SECTOR IN EUROPE: FACTS AND FIGURES 2017. Retrieved 25 January, 2023 from https://fep-fee.eu/-Publications-
[18]
Fernandez-Blanco, V., Prieto-Rodriguez, J., & Suarez-Pandiello, J. (2017). A quantitative analysis of reading habits in Spain. International Journal of Arts Management, 19-32.
[19]
Goldstein, M., Öquist, G., & Björk, S. (2003). Evaluating Sonified Rapid Serial Visual Presentation: An immersive reading experience on a mobile device. In Universal Access Theoretical Perspectives, Practice, and Experience: 7th ERCIM International Workshop on User Interfaces for All, Paris, France, October 24–25, 2002, Revised Papers 7 (pp. 508-523). Springer Berlin Heidelberg.
[20]
Gorichanaz, T. (2016). Novel experiences: on page, in ear, on screen. IConference 2016 Proceedings.
[21]
Grasset, R., Duenser, A., Seichter, H., & Billinghurst, M. (2007, April). The mixed reality book: a new multimedia reading experience. In CHI'07 extended abstracts on Human factors in computing systems (pp. 1953-1958).
[22]
Griswold, W., McDonnell, T., & Wright, N. (2005). Reading and the reading class in the twenty-first century. Annual review of sociology, 127-141.
[23]
Harger, R. O. (1996). Teaching in a computer classroom with a hyperlinked, interactive book. IEEE transactions on Education, 39(3), 327-335.
[24]
Hayles, N.K. (2003). Translating media: Why we should rethink textuality. The Yale Journal of Criticism, 16(2), 263–290.
[25]
Henkel, A. Q., Mygind, S., & Svendsen, H. B. (2021). Exploring reading experiences of three media versions: Danish 8th grade students reading the story Nord. L1-Educational Studies in Language and Literature, 1-29.
[26]
Holenderski, K., & Hu, J. (2013). Enriching reading experience with dramatic soundtracks. Adv. Multimedia Technol, 2(1), 24-31.
[27]
Ihde, D. (1990). Technology and the lifeworld: From garden to earth. Bloomington, IN: Indiana University Press.
[28]
Issaev, S., Zahiri, M., Cao, M., & Lu, L. (2019). Applying Audio Cues to Increase Manga Immersion.
[29]
Johnsson‐Smaragdi, U., & Jönsson, A. (2006). Book Reading in Leisure Time: Long‐Term changes in young peoples' book reading habits. Scandinavian Journal of Educational Research, 50(5), 519-540.
[30]
Kalyuga, S. (2000). When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology, 16(2), 161-172.
[31]
Kirner, T. G., Reis, F. M. V., & Kirner, C. (2012, June). Development of an interactive book with augmented reality for teaching and learning geometric shapes. In 7th Iberian Conference on Information Systems and Technologies (CISTI 2012) (pp. 1-6). IEEE.
[32]
Kitzinger, J., Barbour, R.S.: Introduction: the challenge and promise of focus groups. In: Barbour, R.S., Kitzinger, J. (eds.) Developing Focus Group Research. Politics, Theory and Practice, pp. 1–20. Sage, London (2001)
[33]
Larson, L. C. (2015). E‐books and audiobooks: Extending the digital reading experience. The Reading Teacher, 69(2), 169-177.
[34]
Levy, D.M. (2001). Scrolling forward: Making sense of documents in the digital age. (1st edn). New York: Arcade.
[35]
Liu, Z. (2005). Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation, 61(6), 700–712.
[36]
Loh, C. E., Sun, B., & Majid, S. (2020). Do girls read differently from boys? Adolescents and their gendered reading habits and preferences. English in Education, 54(2), 174-190.
[37]
Mangen, A. (2008). Hypertext fiction reading: haptics and immersion. Journal of research in reading, 31(4), 404-419.
[38]
Mangen, A., & Kuiken, D. (2014). Lost in an iPad: Narrative engagement on paper and tablet. Scientific study of literature, 4(2), 150-177.
[39]
Mažgon, J., Kovač, M., KOVAČ ŠEBART, M., & Vidmar, T. (2020). Books in the time of screens: the reading habits of Slovenian students. Universal journal of educational research, 3916-3923.
[40]
O'Connor, H., & Madge, C. (2003). “Focus groups in cyberspace”: Using the Internet for qualitative research. Qualitative Market Research: An International Journal.
[41]
Okuyay Platform. Turkey reading culture study 2019. Retrieved 25 January, 2023 from https://okuyayplatformu.com/wp-content/uploads/2020/02/readingculturestudy.pdf
[42]
Rahman, A. S. M. M., Alam, K. M., & El Saddik, A. (2011). Augmented he-book: A multimedia-based extension to support immersive reading experience. In Autonomous and Intelligent Systems: Second International Conference, AIS 2011, Burnaby, BC, Canada, June 22-24, 2011. Proceedings 2 (pp. 321-330). Springer Berlin Heidelberg.
[43]
Rieger, M., & Zingler, D. (2023). 3D Audio: The Next Step in Realism for Gaming: Benefits and pitfalls of 3D audio in games from a creative content and technical implementation point of view. ACM Games: Research and Practice, 1(1), 1-3.)
[44]
Robinson, J. P. (2011). IT use and leisure time displacement: Convergent evidence over the last 15 years. Information, Communication & Society, 14(4), 495-509.
[45]
Robinson, J., & De Haan, J. (2006). Information technology and family time displacement. In R. Kraut, M. Brynan & S. Kiesler (Eds.), Computers, phones and the Internet (pp. 51–69). Oxford: Oxford University Press.
[46]
Schettino, P. (2015). Re-defining the concept of immersion in digital immersive environments. In 2015 Digital Heritage (Vol. 2, pp. 409-412). IEEE.
[47]
Schoeffler, M., Silzle, A., & Herre, J. (2017). Evaluation of spatial/3D audio: Basic audio quality versus quality of experience. IEEE Journal of Selected Topics in Signal Processing, 11(1), 75-88.
[48]
Shimray, S. R., & Ramaiah, C. K. (2019). Reading habits and subjects predilection by mobile readers: A Study. Library Philosophy and Practice (e-journal). Retrieved 25 January, 2023 from https://digitalcommons.unl.edu/libphilprac/2805/?utm_source=digitalcommons.unl.edu%2Flibphilprac%2F2805&utm_medium=PDF&utm_campaign=PDFCoverPages
[49]
Skenderi, L., & Ejupi, S. (2017). The reading habits of university students in Macedonia. KNOWLEDGE-International Journal, 20(6), 2835-2839.
[50]
Spjeldnæs, K., & Karlsen, F. (2022). How digital devices transform literary reading: The impact of e-books, audiobooks and online life on reading habits. new media & society, 14614448221126168.
[51]
Statista (n.d.). Video Streaming (SVoD) - Europe. Retrieved 25 January, 2023 from https://www.statista.com/outlook/206/102/video-streaming–svod-/europe
[52]
Suárez-Fernández, S., & Boto-García, D. (2022). Unraveling the effect of extrinsic reading on reading with intrinsic motivation. In The Economics of Books and Reading (pp. 63-89). Cham: Springer Nature Switzerland.
[53]
Thums, K., Artelt, C., & Wolter, I. (2021). Reading for entertainment or information reception? Gender differences in reading preferences and their impact on text-type-specific reading competences in adult readers. European Journal of Psychology of Education, 36, 339-357.
[54]
Twenge, J. M., Martin, G. N., & Spitzberg, B. H. (2019). Trends in US Adolescents’ media use, 1976–2016: The rise of digital media, the decline of TV, and the (near) demise of print. Psychology of Popular Media Culture, 8(4), 329.
[55]
Waycott, J., & Kukulska-Hulme, A. (2003). Students' experiences with PDAs for reading course materials. Personal and ubiquitous computing, 7, 30-43.
[56]
Wolf, M., Barzillai, M., & Dunne, J. (2009). The importance of deep reading. Challenging the whole child: reflections on best practices in learning, teaching, and leadership, 130, 21.
Index Terms
- Immersion or Disruption?: Readers’ Evaluation of and Requirements for (3D-)audio as a Tool to Support Immersion in Digital Reading Practices.
Recommendations
How VR 360º Impacts the Immersion of the Viewer of Suspense AV Content
TVX '19: Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online VideoVirtual Reality (VR) is increasingly a tempting option for creators seeking more immersive VR audiovisual experiences. In the suspense genre, VR promises to deliver a more impactful experience to the viewers. Nevertheless, it's needed to confirm if such ...
Social engagement and user immersion in a socially based virtual world
We assess social engagement and spatial exploration in a virtual environment.We examine predictors of user reported immersion in a virtual environment.Social engagement is positively associated with user reported immersion.Spatial exploration is ...
Transforming Lives Through Story Immersion: Innovation of Aphasia Rehabilitation Therapy through Storytelling Learning Landscapes
ImmersiveMe '14: Proceedings of the 2nd ACM International Workshop on Immersive Media ExperiencesAphasia is a disease that renders its victims unable to effectively use language. Evidence supports the efficacy of treatment for aphasia yet the effectiveness or transferability of learned communicative abilities to everyday conversation continues to ...
Comments
Information & Contributors
Information
Published In
June 2023
465 pages
ISBN:9798400700286
DOI:10.1145/3573381
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Horizon 2020 research and innovation programme
Conference
IMX '23: ACM International Conference on Interactive Media Experiences
June 12 - 15, 2023
Nantes, France
Acceptance Rates
Overall Acceptance Rate 69 of 245 submissions, 28%
Upcoming Conference
IMX '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 90Total Downloads
- Downloads (Last 12 months)53
- Downloads (Last 6 weeks)5
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
Cited By
View all- Gildebrant G(2024)Digital reading, digital reader: In search of the definitionsScientific and Technical Libraries10.33186/1027-3689-2024-12-64-79(64-79)Online publication date: 24-Dec-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format