Work in Progress

Towards an Immersive and Accessible Virtual Reconstruction of Theaters from the Early Modern: Bringing Back Cultural Heritage from the Past

Authors:

Mario Montagud,

Jaume Segura-Garcia,

J. Antonio De Rus,

Rafael Fayos JordánAuthors Info & Claims

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

Pages 143 - 147

https://doi.org/10.1145/3391614.3399390

Published: 17 June 2020 Publication History

Abstract

This paper reports on the work being done towards achieving an immersive and accessible reconstruction of Historical and Cultural Heritage, focusing on Theaters of the Early Modern as use case. In particular, the paper presents and discusses potential possibilities to enable: 1) the acoustical reconstruction of the virtual (lost) environments – beyond the graphical reconstruction for the buildings, elements and performances; 2) effective interaction features and navigation within the virtual environment (e.g. by means of adaptive interfaces, guiding methods, insertion of Point of Interest); and 3) accessible experiences, by means of an innovative and personalized presentation modes for access services, like subtitles and audio description. For most of these aspects and features, proof of concept implementation are provided, and opportunities for future work are outlined. With an effective combination of all these contributions, the goal is to bring back valuable (both tangible and intangible) Cultural Heritage from the past, providing high benefits in relevant sectors like Culture, Tourism and Education.

References

[1]

B. Agulló. 2019. The challenge of implementing SDH in immersive media: a reception study. In Proceedings of the Media4ALL Conference(Media4All ’19). Stockholm (Sweden).

[2]

C. Barker. 2018. Seeing the past through the future: Virtual reality experiences in archaeology: The story of the Paphos Theatre in VR project. Teaching History 52, 2 (June 2018).

[3]

M. K. Bekele, R. Pierdicca, E. Frontoni, E. S. Malinverni, and J. Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage 11, 2 (2018), 7.

Digital Library

[4]

U. Berardi, G. Iannace, and L. Maffei. 2016. Virtual Reconstruction of the Historical Acoustics of the Odeon of Pompeii. Journal of Cultural Heritage 19, 2 (2016), 555––566. https://doi.org/10.1016/j.culher.2015.12.004

[5]

E. Chang, Y. Cai, and H. Thwaites. 2018. Special Issue on VR for Culture and Heritage: The Experience of Cultural Heritage with Virtual Reality: Guest Editors´ Introduction. Presence 26, 3 (May 2018), iii–vi.

[6]

A. Brown et al.2018. Exploring Subtitle Behaviour for 360º Video. Technical Report. White Paper WHP. 330 pages.

[7]

J. Jansen, S. Subramanyam, R. Bouqueau, G. Cernigliaro, M. Martos, F. Pérez, and P. Cesar. 2020. A Pipeline for Multiparty Volumetric Video Conferencing: transmission of point clouds over low latency DASH (Demo Paper). In Proceedings of the 11th ACM Multimedia Systems Conference(ACM MMSYS ’20). Istambul (Turkey).

[8]

M. Johansson. 2019. VR For Your Ears: Dynamic 3D Audio is Key to the Immersive Experience·. IEEE Spectr. 56, 2 (Feb. 2019), 24––29. https://doi.org/10.1109/MSPEC.2019.8635813

Digital Library

[9]

M. Montagud, P. Orero, and S. Fernández. 2020. Immersive Media and Accessibility: Hand in Hand to the Future. ITU Journal, Accepted for Publication in 2020 (2020).

[10]

M. Montagud, P. Orero, and A. Matamala. 2020. Culture 4 All: Accessibility-Enabled Cultural Experiences through Immersive VR360 content. Personal and Ubiquitous Computing, Springer, Accepted for Publication in 2020 (2020). https://doi.org/10.1007/s00779-019-01357-3

Digital Library

[11]

M. Montagud, J.A. De Rus, R. Fayos-Jordán, M. García-Pineda, and J. Segura-Garcia. 2020. Open-Source Software Tools for Measuring Resources Consumption and #DASH Metrics. In Proceedings of the 11th ACM Multimedia Systems Conference(ACM MMSYS ’20). Istambul (Turkey).

[12]

J. H. Rindel. 2011. The ERATO Project and Its Contribution to Our Understanding of the Acoustics of Ancient Theatres. In Acoustics of ancient theaters conference(IAC ’11). Patras (Greece), 1––6.

[13]

S. Rothe, T. Kim, and H. Hussmann. 2018. Dynamic Subtitles in Cinematic Virtual Reality. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video(ACM TVX ’18). Seoul (South Korea).

[14]

J. Segura, S. Mirasol, M. Montagud, and J. Oleza. 2018. Beyond Virtual Reality. Virtual Acoustic Reconstruction of ancient theatres in the Golden Age. Towards a virtual experience of theatre at the dawn of ultra-realism. Diablotexto Digital 3, 8 (Dec. 2018).

[15]

J. Segura-Garcia, M. Montagud, S. Mirasol-Menacho, and J. Oleza-Simó. 2019. Theatrical Virtual Acoustic rendering with head movement interaction. AI EDAM (Artificial Intelligence for Engineering Design, Analysis and Manufacturing) 33, 3 (Aug. 2019), 359–368.

[16]

M. Sender, A. Planells, R. Perelló, J. Segura, and A.Giménez. 2018. Virtual acoustic reconstruction of a lost church: application to an Order of Saint Jerome monastery in Alzira, Spain. Journal of Building Performance Simulation 11, 3 (2018), 369–390.

[17]

J. Tompkins and L. Kastanis. 2017. Staging supernatural creatures in a computer-based visualisation of London’s sixteenth-century Rose Theatre. International Journal of Performance Arts and Digital Media 13, 1(2017), 4–20. https://doi.org/10.1080/14794713.2017.1280306

[18]

M. Vorländer. 2008. Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality. Springer, Berlin.

[19]

A. Weis, J. Jacobson, and M. Darnell. 2010. The Virtual Theater District of Pompeii. In Computer Applications in Archaeology(CAA ’10). Granada (Spain).

[20]

Y. Zhao, E. Cutrell, C. Holz, M. R. Morris, E. Ofek, and A. D. Wilson. 2019. SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(ACM CHI ’19). Glasgow (UK).

Digital Library

Cited By

Nevsky ABircanin FCruice MWilson SSimperl ENeate T(2024)"I Wish You Could Make the Camera Stand Still": Envisioning Media Accessibility Interventions with People with AphasiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675598(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675598
Nevsky ANeate TSimperl ECruice M(2024)Lights, Camera, Access: A Closeup on Audiovisual Media Accessibility and AphasiaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641893(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641893
Andrei A(2024)MW4HBI: Mobile and Wearable Human-Building Interactions with a Multi-Platform User Interface2024 International Conference on Development and Application Systems (DAS)10.1109/DAS61944.2024.10541293(1-7)Online publication date: 23-May-2024
https://doi.org/10.1109/DAS61944.2024.10541293
Show More Cited By

Recommendations

A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage

A multimedia approach to the diffusion, communication, and exploitation of Cultural Heritage (CH) is a well-established trend worldwide. Several studies demonstrate that the use of new and combined media enhances how culture is experienced. The benefit ...
Designing the Experience for Virtual Graveyard Heritage Sites
MUM '24: Proceedings of the International Conference on Mobile and Ubiquitous Multimedia
We present the design and implementation of a virtual graveyard accessible through an immersive virtual reality (VR) experience. The virtual environment recreates two graveyards, both heritage sites that are currently inaccessible, using 3D models based ...
Visiting a virtual graveyard: designing virtual reality cultural heritage experiences
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Virtual reality offers a potential solution to enable visiting inaccessible cultural heritage sites. We present the design, prototyping and evaluation (n = 6) of a virtual visit to a historic graveyard. The Salla World War II graveyard is located in an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

June 2020

211 pages

ISBN:9781450379762

DOI:10.1145/3391614

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2020

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

IMX '20

Sponsor:

IMX '20: ACM International Conference on Interactive Media Experiences

June 17 - 19, 2020

Cornella, Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Sponsor:
sigchi

ACM International Conference on Interactive Media Experiences

June 3 - 6, 2025

Niter?i , Brazil

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
297
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nevsky ABircanin FCruice MWilson SSimperl ENeate T(2024)"I Wish You Could Make the Camera Stand Still": Envisioning Media Accessibility Interventions with People with AphasiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675598(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675598
Nevsky ANeate TSimperl ECruice M(2024)Lights, Camera, Access: A Closeup on Audiovisual Media Accessibility and AphasiaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641893(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641893
Andrei A(2024)MW4HBI: Mobile and Wearable Human-Building Interactions with a Multi-Platform User Interface2024 International Conference on Development and Application Systems (DAS)10.1109/DAS61944.2024.10541293(1-7)Online publication date: 23-May-2024
https://doi.org/10.1109/DAS61944.2024.10541293
De Rus Arance JMontagud MCobos M(2023)Towards the Creation of Tools for Automatic Quality of Experience Evaluation with Focus on Interactive Virtual EnvironmentsProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596508(411-414)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596508
Nevsky A(2023)Object-Based Access: Enhancing Accessibility with Data-Driven MediaProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596500(402-406)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596500
De Rus Arance JMontagud MCobos M(2023)Towards the Creation of Scalable Tools for automatic Quality of Experience Evaluation and a Multi-Purpose Dataset for Affective ComputingProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596468(269-275)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596468
Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Dudley JYin LGaraj VKristensson P(2023)Inclusive Immersion: a review of efforts to improve accessibility in virtual reality, augmented reality and the metaverseVirtual Reality10.1007/s10055-023-00850-827:4(2989-3020)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10055-023-00850-8
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
De Rus JMontagud MCobos MMurray NSimon GFarias MViola IMontagud M(2022)AI-assisted affective computing and spatial audio for interactive multimodal virtual environmentsProceedings of the 13th ACM Multimedia Systems Conference10.1145/3524273.3533930(372-377)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3524273.3533930
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents