Geomatics and metaverse for lost heritage sites documentation and dissemination: the case study of Palmyra Roman Theatre (Syria)

Anna Forte; Yara Jamil Alkhatib; Gabriele Bitelli; Eva Savina Malinverni; Roberto Pierdicca

doi:10.4995/var.2024.21662

Authors

Anna Forte University of Bologna https://orcid.org/0009-0008-8300-9057
Yara Jamil Alkhatib University of Bologna https://orcid.org/0009-0004-8799-055X
Gabriele Bitelli University of Bologna https://orcid.org/0000-0002-6118-6000
Eva Savina Malinverni Marche Polytechnic University https://orcid.org/0000-0001-6582-2943
Roberto Pierdicca Marche Polytechnic University https://orcid.org/0000-0002-9160-834X

DOI:

https://doi.org/10.4995/var.2024.21662

Keywords:

geomatics, metaverse, spherical photogrammetry, 3D reconstruction, virtual reality (VR), lost heritage

Abstract

Highlights:

Geomaticsthree-dimensional (3D)reconstruction of lost Syrian heritage (PalmyraRoman Theatre)with spherical photogrammetry, recreating the monument’s conditions before its destruction.
Operationsof polygon decimationto optimise the geometry of the 3D model for virtual reality (VR) and metaverse applications, including texturing operations to enhance realism.
Development of a virtual environmentto be explored in a shared and immersive metaverse platform, available online to disseminate the historical significance of the Roman Theatre in Palmyra.

Abstract:

Cultural heritage encompasses both tangible and intangible aspects for each of us, and efforts must be made to safeguard this legacy for future generations. Unfortunately, in addition to natural and environmental degradation, human activities pose a significant threat to the integrity of historical sites. Monuments and architecture have frequently been intentionally destroyed in conflict zones all over the world. Three-dimensional (3D) and virtual technologies can serve as tools to digitally preserve these sites and raise awareness about the importance of historical properties to the general public, particularly when physical sites are at risk or no longer exist. This challenging field of lost heritage is the framework of this project, in which a procedure of geomatics-based techniques such as spherical photogrammetry, 3D modelling and virtual reality (VR) technologies was developed to reconstruct lost historical architecture. The Roman Theatre in Palmyra, Syria, partially destroyed during Syria’s war in 2017, serves as a case study. The methodology report starts with the description of the metrological foundation of the 3D model construction, i.e. spherical photogrammetry as developed by Prof. Fangi (Marche Polytechnic University). Then, the geometry optimisation phase carried out to accomplish the VR limitations in terms of polygon count is presented. Ultimately, the procedure for the virtual environment construction is explained, as well as the development of a metaverse scenario to be visited and shared on an online-based platform. This collective virtual experience aims to revive the destroyed architecture and communicate its significance to the public through a collective and interactive virtual exploration. This study also includes experiments to assess user response, providing insights into methodology effectiveness in conveying Palmyra’s Theatre historical relevance and shedding light on the users’ perceptions of virtual tools usage for lost heritage dissemination. The evaluation questionnaire’s results will guide the project’s future developments.

Downloads

Download data is not yet available.

Author Biographies

Anna Forte, University of Bologna

PhD candidate and Research Fellow at Bologna University (Dept. of Civil, Chemical Environmental and Materials Engineering), Anna is currently focusing on optimising and integrating processes and methods in high-precision 3D surveying. Her PhD research is devoted to investigating the limits and potentials of the geomatic instruments involved in acquiring highly accurate 3D datasets, focusing on their applications to the study of historical assets. She also conducts research in the field of eXtended Reality for heritage digital documentation and dissemination. She is also a teaching tutor of Geomatic Engineering for Cultural Heritage for the master’s degree in building engineering at Bologna University, author of geomatics-related publications, Master’s thesis co-tutor and part of CIPA Emerging Professional.

Yara Jamil Alkhatib, University of Bologna

An architect with a Master’s degree in engineering of building Processes and Systems, curriculum Historic Building Rehabilitation from the University of Bologna. She is a research fellow at the Department of Civil, Chemical, Environmental, and Materials Engineering (DICAM) at the University of Bologna. Her primary interest lies in the 3D reconstruction and documentation of lost heritage, combining her architectural background with advanced digital and virtual tools to preserve cultural history.

Gabriele Bitelli, University of Bologna

Since 2002 Full Professor of Geomatics at the Department of Civil, Chemical, Environmental and Materials Engineering (DICAM) of the University of Bologna. The main research topics are related to modern surveying methodologies with the integration of sensors and advanced geomatic techniques, particularly in the field of Archaeology and Cultural Heritage, to the monitoring of structures and the territory with integrated terrestrial and satellite techniques, three-dimensional modelling of the terrain and surfaces for territorial and non-territorial applications, digital applications to historical cartography, Geographic Information Systems. He has participated in numerous research projects and is the author of over 350 national and international publications.

Eva Savina Malinverni, Marche Polytechnic University

Full Professor in GEOMATICS, Engineering Faculty, DICEA, UNIVPM (Italy). Her research is involved in different fields of Geomatics: from Cultural Heritage to Land Use, from acquisition with digital tools to management of increasingly complex data in GIS/(H)BIM, 3D and CityGML. Her actual bibliographic indexes in Scopus are: 107 papers, 2123 citations and 19 of H-index. She attends several MAECI, CONCYTEC, COST, PRIN projects in collaboration with National and International Universities and Research Centers, applying research on Unesco sites. She is a member of ICOMOS and Expert Member of CIPA-HD.

Roberto Pierdicca, Marche Polytechnic University

Roberto Pierdicca is Tenure Track Assistant Professor and adjunct professor of Geomatics and statistics, co-director of GAP - Geomatics Applications and Processing Lab. His research interest is mainly focused on Geospatial Intelligence, Photogrammetry and Remote Sensing, 3D Point Clouds, Cultural Heritage and eXtended Reality. He is author of more than 100 papers in international conferences and journal, and participates to several international projects related to Cultural Heritage, Tourism Management, Education, Geosciences and Archaeology. He is an expert member of international associations such as ICOMOS (Cultural Heritage Conservation), CIPA and ISPRS where he is Secretary of the WGIII/commission 8. From 2022 he’s president of the SIFET Marche (National Association of Geomatics). He organized international conferences, workshops and tutorials (such as ISPRS, CIPA, SalentoXR among the others) and was invited speaker in international venues. In 2020 he was honored with the Outstanding Early Career Scientist by the European Geoscientist Union.

References

Al-Barzngy, M. Y. M., & Khayat, M. (2023). Post-Conflict Safeguarding of Built Heritage: Content Analysis of the ICOMOS Heritage at Risk Journal, 2000–2019. Sustainability, 15(16), 12364. https://doi.org/10.3390/su151612364

Bardon, A. (2017). UNESCO Director-General condemns destruction of the Tetrapylon and severe damage to the Theatre in Palmyra, a UNESCO World Heritage site. Retrieved June 26, 2024, from https://whc.unesco.org/en/news/1620/

Bekele, M. K., Pierdicca, R., Frontoni, E., Malinverni, E. S., & Gain, J. (2018). A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage, 11(2), 1-36. https://doi.org/10.1145/3145534

Benjamins, R., Viñuela, Y. R., & Alonso, C. (2023). Social and ethical challenges of the metaverse. AI and Ethics, 3(3), 689–697. https://doi.org/10.1007/s43681-023-00278-5

Bitelli, G., Dellapasqua, M., Girelli, V. A., Sbaraglia, S., & Tinia, M. A. (2017). Historical photogrammetry and terrestrial laser scanning for the 3D virtual reconstruction of destroyed structures: a case study in Italy. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-5/W1, 113–119. https://doi.org/10.5194/isprs-archives-xlii-5-w1-113-2017

Brůha, L., Laštovička, J., Palatý, T., Štefanová, E., & Štych, P. (2020). Reconstruction of lost cultural heritage sites and landscapes: Context of ancient objects in time and space. ISPRS International Journal of Geo-Information, 9(10), 604. https://doi.org/10.3390/ijgi9100604

Cantaluppi, E., & Ceccon, L. (2022). Defining a Metaverse for the Cultural Heritage. In 27th International Conference on Cultural Heritage and New Technologies (pp. 10-12). Vienna, Austria. Heidelberg: Propylaeum.

Chehab, A., & Nakhal, B. (2023). Exploring virtual reality as an approach to resurrect destroyed historical buildings-an approach to revive the destroyed “Egg Building” through VR. Architecture And Planning Journal, 28(3), 17. https://doi.org/10.54729/2789-8547.1212

Cruz Franco, P. A., Rueda Márquez de la Plata, A., & Gómez Bernal, E. (2022). Protocols for the graphic and constructive diffusion of digital twins of the architectural heritage that guarantee universal accessibility through AR and VR. Applied Sciences, 12(17), 8785. https://doi.org/10.3390/app12178785

D'Annibale E., Tassetti A., & Malinverni E. (2013). From panoramic photos to a low-cost photogrammetric workflow for cultural heritage 3D documentation. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W2, 213–218. https://doi.org/10.5194/isprsarchives-XL-5-W2-213-2013

De Pascale, F. (2024). Understanding Risks to Cultural Heritage: Are Disasters Natural?. In B. Rouhani, X. Romão (Eds.), Managing Disaster Risks to Cultural Heritage (pp. 14-32). London: Routledge. https://doi.org/10.4324/9781003263647

Denker, A. (2017). Rebuilding Palmyra virtually: Recreation of its former glory in digital space. Virtual Archaeology Review, 8(17), 20. https://doi.org/10.4995/var.2017.5963

Di Stefano, F., Pierdicca, R., & Zaid, Z. (2022). Documentation of Syrian lost heritage: 3D modelling to support an open information system and Mixed Reality. In Restauro Archeologico 1972-2022 World Heritage in transition. About management, protection and sustainability (pp. 44-49). Florence, Italy (Nov. 2022). Florence: Firenze University Press

Doppelhofer, C. (2018). Reviving Palmyra in Multiple Dimensions: images, ruins and cultural memory, by Minna Silver, Gabriele Fangi and Ahmet Denker, Dunbeath: Whittles Publishing. International Journal of Heritage Studies, 25(2), 219–224. https://doi.org/10.1080/13527258.2018.1475416

Dwivedi, Y. K., Hughes, L., Baabdullah, A. M., Ribeiro-Navarrete, S., Giannakis, M., Al-Debei, M. M., …, & Fosso Wamba, S. (2022). Metaverse beyond the hype: Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. International Journal of Information Management, 66, 102542. https://doi.org/10.1016/j.ijinfomgt.2022.102542

Fan, X., Jiang, X., & Deng, N. (2022). Immersive technology: A meta-analysis of augmented/virtual reality applications and their impact on tourism experience. Tourism Management, 91, 104534. https://doi.org/10.1016/j.tourman.2022.104534

Fangi G. (2007). La Fotogrammetria sferica dei mosaici di scena per il rilievo architettonico. Bollettino della Società Italiana di Fotogrammetria e Topografia, 3, 23-42.

Fangi, G., & Pierdicca, R. (2012). Notre Dame du Haut by spherical photogrammetry integrated by point clouds generated by multi-view software. International Journal of Heritage in the Digital Era, 1(3), 461-479. https://doi.org/10.1260/2047-4970.1.3.461

Fangi, G. (2015). Documentation of some Cultural Heritage Emergencies in Syria In August 2010 by Spherical Photogrammetry. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-5/W3, 401–408. https://doi.org/10.5194/isprsannals-ii-5-w3-401-2015

Fangi, G., Wahbeh, W., Malinverni, E. S., Di Stefano, F., & Pierdicca, R. (2017). Archaeological Syrian Heritage memory safeguard by low-cost geomatics techniques. In IMEKO TC4 International Conference on Metrology for Archaeology and Cultural Heritage (pp. 23-25). Lecce, Italy (Oct. 2017). Budapest: International Measurement Confederation (IMEKO)

Fangi, G. (2019). Aleppo - Before and after. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W9, 333–338. https://doi.org/10.5194/isprs-archives-xlii-2-w9-333-2019

Fangi, G., Malinverni, E. S., Di Stefano, F., & Pierdicca, R. (2022) Documentation of Syrian Lost Heritage: From 3D Reconstruction to Open Information System. In M. Silver (Eds.), Challenges, Strategies and High-Tech Applications for Saving the Cultural Heritage of Syria (pp. 213-226). Vienna: Austrian Academy of Sciences Press. https://doi.org/10.1553/978OEAW83747

Gaffar, A. A. M. (2021). Using Metaverse to Rebuild Non-reachable or Ruined Heritage Buildings. International Journal of Architecture, Arts and Applications, 7(4), 119-130 https://doi.org/10.11648/j.ijaaa.20210704.13

Galeazzi, F., Di Franco, P. D. G., Toulson, R., Camporesi, C., & Patel, S. (2023). Earthquakes, communities and heritage: Telling stories of resilience through co-designed immersive media. Visual Studies, 38(1), 101-118. https://doi.org/10.1080/1472586X.2022.2102539

Günay, S. (2022). Virtual reality for lost architectural heritage visualization utilizing limited data. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVI-2/W1-2022, 253–257. https://doi.org/10.5194/isprs-archives-XLVI-2-W1-2022-253-2022

Huggett, J. (2020). Virtually real or really virtual: Towards a heritage metaverse. Studies in Digital Heritage, 4(1), 1- 15. https://doi.org/10.14434/sdh.v4i1.26218

Khan, I., Melro, A., Amaro, A. C., & Oliveira, L. (2020). Systematic review on gamification and cultural heritage dissemination. Journal of Digital Media & Interaction, 3(8), 19-41. https://doi.org/10.34624/jdmi.v3i8.21934

Longo M. C., & Faraci R. (2023). Next-generation museum: a metaverse journey into culture. Sinergie - Italian Journal of Management, 41(1), 147-176. https://doi.org/10.7433/s120.2023.08

Meghraoui, M., & Sbeinati, R. (2023). Archeoseismology and the Lost Villages in Northern Syria, the Impact of Large Earthquakes on Cultural Heritage. In El-Qady, G.M., Margottini, C. (Eds.), Sustainable Conservation of UNESCO and Other Heritage Sites Through Proactive Geosciences (pp. 445-461). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-13810-2_24

Ministri, E. (2015). Il Teatro Romano di Palmira con la Fotogrammetria Sferica: Confronto con i Teatri Romani di Bosra e Sabratha. (Master’s Thesis). Marche Polytechnic University, Italy.

Moneta, A. (2020). Architecture, Heritage, and the Metaverse: New Approaches and Methods for the Digital Built Environment. Traditional Dwellings and Settlements Review, 32(1), 37–49. https://www.jstor.org/stable/27074915

Mystakidis, S. (2022). Metaverse. Encyclopedia, 2(1), 486-497. https://doi.org/10.3390/encyclopedia2010031

Pellegrino, A., Wang, R.,& Stasi, A. (2023). Exploring the intersection of sustainable consumption and the Metaverse: A review of current literature and future research directions. Heliyon, 9(9), e19190. https://doi.org/10.1016/j.heliyon.2023.e19190

Sear, F. (2007). Roman Theatres: An Architectural Study. Oxford: Oxford University Press. https://doi.org/10.1093/oso/9780198144694.001.0001

Shadi, W., & Bashar, M. (2015). Syrian Archaeological Heritage: Past And Present. Scientific Culture, 1(3), 1–14. https://doi.org/10.5281/zenodo.18445

Silver, M., Fangi, G., & Denker, A. (2018). Reviving Palmyra in Multiple Dimensions: Images, Ruins and Cultural Memory. Caithness, Scotland, UK: Whittles Publishing.

Wang, M., & Lau, N. (2023). NFT Digital Twins: A Digitalization Strategy to Preserve and Sustain Miao Silver Craftsmanship in the Metaverse Era. Heritage, 6(2), 1921-1941. https://doi.org/10.3390/heritage6020103

Yang, S. (2023). Storytelling and user experience in the cultural metaverse. Heliyon, 9(4), e14759. https://doi.org/10.1016/j.heliyon.2023.e14759

Zhang, X., Yang, D., Yow, C. H., Huang, L., Wu, X., Huang, X., Guo, J., Zhou, S., & Cai, Y. (2022). Metaverse for cultural heritages. Electronics, 11(22), 3730. https://doi.org/10.3390/electronics11223730