skip to main content
tutorial

A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage

Published: 22 March 2018 Publication History

Abstract

A multimedia approach to the diffusion, communication, and exploitation of Cultural Heritage (CH) is a well-established trend worldwide. Several studies demonstrate that the use of new and combined media enhances how culture is experienced. The benefit is in terms of both number of people who can have access to knowledge and the quality of the diffusion of the knowledge itself. In this regard, CH uses augmented-, virtual-, and mixed-reality technologies for different purposes, including education, exhibition enhancement, exploration, reconstruction, and virtual museums. These technologies enable user-centred presentation and make cultural heritage digitally accessible, especially when physical access is constrained. A number of surveys of these emerging technologies have been conducted; however, they are either not domain specific or lack a holistic perspective in that they do not cover all the aspects of the technology. A review of these technologies from a cultural heritage perspective is therefore warranted. Accordingly, our article surveys the state-of-the-art in augmented-, virtual-, and mixed-reality systems as a whole and from a cultural heritage perspective. In addition, we identify specific application areas in digital cultural heritage and make suggestions as to which technology is most appropriate in each case. Finally, the article predicts future research directions for augmented and virtual reality, with a particular focus on interaction interfaces and explores the implications for the cultural heritage domain.

References

[1]
Daniel Acevedo, Eileen Vote, David H. Laidlaw, and Martha S. Joukowsky. 2001. Archaeological data visualization in VR: Analysis of lamp finds at the great temple of petra, a case study. In Proceedings of the Conference on Visualization’01. IEEE Computer Society, 493--496.
[2]
Alonzo C. Addison and Marco Gaiani. 2000. Virtualized architectural heritage: New tools and techniques. IEEE MultiMedia 7, 2 (2000), 26--31.
[3]
Nur Intan Adhani and Rambli Dayang Rohaya Awang. 2012. A survey of mobile augmented reality applications. In Proceedings of the 1st International Conference on Future Trends in Computing and Communication Technologies. 89--96.
[4]
Yahaya Ahmad. 2006. The scope and definitions of heritage: From tangible to intangible. Int. J. Herit. Stud. 12, 3 (2006), 292--300.
[5]
Alba Amato, Salvatore Venticinque, and Beniamino Di Martino. 2013. Image recognition and augmented reality in cultural heritage using openCV. In Proceedings of the International Conference on Advances in Mobile Computing 8 Multimedia. ACM, 53.
[6]
Anastassia Angelopoulou, Daphne Economou, Vassiliki Bouki, Alexandra Psarrou, Li Jin, Chris Pritchard, and Frantzeska Kolyda. 2011. Mobile augmented reality for cultural heritage. In Mobile Wireless Middleware, Operating Systems, and Applications. Springer, 15--22.
[7]
C. Anthes, R. J. GarcÃŋa-HernÃa̧ndez, M. Wiedemann, and D. KranzlmÃijller. 2016. State of the art of virtual reality technology. In Proceedings of the 2016 IEEE Aerospace Conference. 1--19.
[8]
Gabriella Arcese, Laura Di Pietro, and Roberta Guglielmetti. 2011. The augmented reality in the cultural heritage sector. In Proceedings of the QMOD Conference on Quality and Service Sciences 2011. Servicios de Publicaciones Universidad de Navarra Carretera del Sadar s/n 31080 Pamplona Spain, 158.
[9]
Clemens Arth, Raphael Grasset, Lukas Gruber, Tobias Langlotz, Alessandro Mulloni, and Daniel Wagner. 2015. The history of mobile augmented reality. arXiv Preprint arXiv:1505.01319 (2015).
[10]
Kajos Attila and Bányai Edit. 2012. Beyond reality: The possibilities of augmented reality in cultural and heritage tourism. In Proceedings of the 2nd International Tourism and Sport Management Conference. 5--6.
[11]
Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre. 2001. Recent advances in augmented reality. IEEE Trans. Comput. Graph. Appl. 21, 6 (2001), 34--47.
[12]
Ronald T. Azuma. 1997. A survey of augmented reality. Presence: Teleoperat. Virtual Environ. 6, 4 (1997), 355--385.
[13]
Jorge Bacca, Silvia Baldiris, Ramon Fabregat, Sabine Graf, and others. 2014. Augmented reality trends in education: A systematic review of research and applications. J. Educ. Technol. Soc. 17, 4 (2014), 133.
[14]
Antonio Baglivo, Francesca Delli Ponti, Daniele De Luca, Antonella Guidazzoli, Maria Chiara Liguori, and Bruno Fanini. 2013. X3D/X3DOM, blender game engine and OSG4WEB: Open source visualisation for cultural heritage environments. In Proceedings of the Digital Heritage International Congress (DigitalHeritage’13), Vol. 2. IEEE, 711--718.
[15]
S. Baldissini and M. Gaiani. 2014. Interacting with the andrea palladio works: The history of palladian information system interfaces. J. Comput. Cult. Herit. 7, 2 (2014), 11.
[16]
S. Gonizzi Barsanti, G. Caruso, L. L. Micoli, M. Covarrubias Rodriguez, and G. Guidi. 2015. 3D visualization of cultural heritage artefacts with virtual reality devices. Int. Arch. Photogram. Remote Sens. Spatial Inf. Sci. 40, 5 (2015), 165.
[17]
Herbert Bay, Beat Fasel, and Luc Van Gool. 2005. Interactive museum guide. In Proceedings of the 7th International Conference on Ubiquitous Computing Workshop on Smart Environments and Their Applications to Cultural Heritage (UBICOMP’05).
[18]
Hrvoje Benko, Edward W. Ishak, and Steven Feiner. 2004. Collaborative mixed reality visualization of an archaeological excavation. In Proceedings of the 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’04). IEEE, 132--140.
[19]
Mark Billinghurst, Adrian Clark, Gun Lee, and others. 2015. A survey of augmented reality. Found. Trends Hum.--Comput. Interact. 8, 2--3 (2015), 73--272.
[20]
Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. 2008. Tangible augmented reality. ACM SIGGRAPH Asia Course Notes 7 (2008).
[21]
Erkan Bostanci, Nadia Kanwal, and Adrian F. Clark. 2015. Augmented reality applications for cultural heritage using Kinect. Hum.-Centric Comput. Inf. Sci. 5, 1 (2015), 1--18.
[22]
Philipp Breuss-Schneeweis. 2016. The speaking celt: Augmented reality avatars guide through a museum--case study. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 1484--1491.
[23]
Fabio Bruno, Stefano Bruno, Giovanna De Sensi, Maria-Laura Luchi, Stefania Mancuso, and Maurizio Muzzupappa. 2010. From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. J. Cult. Herit. 11, 1 (2010), 42--49.
[24]
Andres Bustillo, Mario Alaguero, Ines Miguel, Jose M. Saiz, and Lena S. Iglesias. 2015. A flexible platform for the creation of 3D semi-immersive environments to teach cultural heritage. Dig. Appl. Arch. Cult. Herit. 2, 4 (2015), 248--259.
[25]
Giuseppe Caggianese, Pietro Neroni, and Luigi Gallo. 2014. Natural interaction and wearable augmented reality for the enjoyment of the cultural heritage in outdoor conditions. In Augmented and Virtual Reality. Springer, 267--282.
[26]
Fiona Cameron and Sarah Kenderdine. 2007. Theorizing Digital Cultural Heritage: A Critical Discourse. MIT Press.
[27]
M. Canciani, E. Conigliaro, M. Del Grasso, P. Papalini, and M. Saccone. 2016. 3D survey and augmented reality for cultural heritage. The case study of aurelian wall at castra praetoria in rome. Int. Arch. Photogram. Remote Sens. Spatial Inf. Sci. 41, B5 (2016), 931--937.
[28]
Julie Carmigniani, Borko Furht, Marco Anisetti, Paolo Ceravolo, Ernesto Damiani, and Misa Ivkovic. 2011. Augmented reality technologies, systems and applications. Multimedia Tools Appl. 51, 1 (2011), 341--377.
[29]
Marcello Carrozzino and Massimo Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Herit. 11, 4 (2010), 452--458.
[30]
Guida Casella and Moises Coelho. 2013. Augmented heritage: Situating augmented reality mobile apps in cultural heritage communication. In Proceedings of the 2013 International Conference on Information Systems and Design of Communication. ACM, 138--140.
[31]
Kuo-En Chang, Chia-Tzu Chang, Huei-Tse Hou, Yao-Ting Sung, Huei-Lin Chao, and Cheng-Ming Lee. 2014. Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Comput. Educ. 71 (2014), 185--197.
[32]
Yu-Lien Chang, Huei-Tse Hou, Chao-Yang Pan, Yao-Ting Sung, and Kuo-En Chang. 2015. Apply an augmented reality in a mobile guidance to increase sense of place for heritage places. Educ. Technol. Soc. 18, 2 (2015), 166--178.
[33]
Hee-soo Choi. 2014. The conjugation method of augmented reality in museum exhibition. Int. J. Smart Home 8, 1 (2014), 217--228.
[34]
Omar Choudary, Vincent Charvillat, Romulus Grigoras, and Pierre Gurdjos. 2009. MARCH: Mobile augmented reality for cultural heritage. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, 1023--1024.
[35]
Chris Christou, Cameron Angus, Celine Loscos, Andrea Dettori, and Maria Roussou. 2006. A versatile large-scale multimodal VR system for cultural heritage visualization. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology. ACM, 133--140.
[36]
Angeliki Chrysanthi, Constantinos Papadopoulos, Tom Frankland, and Graeme Earl. 2012. ‘Tangible pasts’: User-centred design of a mixed reality application for cultural heritage. Archaeology in the Digital Era (2012), 31.
[37]
Paolo Cignoni and Roberto Scopigno. 2008. Sampled 3D models for CH applications: A viable and enabling new medium or just a technological exercise? J. Comput. Cult. Herit. 1, 1 (2008), 2.
[38]
Paolo Clini, Emanuele Frontoni, Ramona Quattrini, and Roberto Pierdicca. 2014. Augmented reality experience: From high-resolution acquisition to real time augmented contents. Adv. Multimedia 2014 (2014), 18--27.
[39]
Paolo Clini, Emanuele Frontoni, Ramona Quattrini, Roberto Pierdicca, and Romina Nespeca. 2016. Real/not real: Pseudo-holography and augmented. Handbook of Research on Emerging Technologies for Digital Preservation and Information Modeling (2016), 201.
[40]
Lucio Colizzi, Andrea Martini, and Francesco Chionna. 2010. Augmented reality applied to the diagnostics and fruition of cultural heritage. Conserv. Sci. Cult. Herit. 10, 1 (2010), 195--238.
[41]
Radu Comes, Călin Neamţu, Zsolt Buna, Ionuţ Badiu, and Paul Pupeză. 2014. Methodology to create 3d models for augmented reality applications using scanned point clouds.Mediter. Archaeol. Archaeom. 14, 4 (2014), 35--44.
[42]
Enrico Costanza, Andreas Kunz, and Morten Fjeld. 2009. Mixed reality: A survey. In Human Machine Interaction. Springer, 47--68.
[43]
Rita Cucchiara and Alberto Del Bimbo. 2014. Visions for augmented cultural heritage experience. IEEE MultiMedia 21, 1 (2014), 74--82.
[44]
F. D’Agnano, C. Balletti, F. Guerra, and P. Vernier. 2015. Tooteko: A case study of augmented reality for an accessible cultural heritage. Digitization, 3D printing and sensors for an audio-tactile experience. Int. Arch. Photogram. Remote Sens. Spatial Info. Sci. 40, 5 (2015), 207.
[45]
Areti Damala, Eva Hornecker, Merel van der Vaart, Dick van Dijk, and Ian Ruthven. 2016. The Loupe:: Tangible augmented reality for learning to look at ancient greek art. Int. J. Mediter. Archaeol. Archaeom. 16, 5 (2016), 73--85.
[46]
Areti Damala and Nenad Stojanovic. 2012. Tailoring the adaptive augmented reality (A 2 R) museum visit: Identifying cultural heritage professionals’ motivations and needs. In Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality-Arts, Media, and Humanities (ISMAR-AMH’12). IEEE, 71--80.
[47]
Areti Damala, Nenad Stojanovic, Tobias Schuchert, Jorge Moragues, Ana Cabrera, and Kiel Gilleade. 2012. Adaptive augmented reality for cultural heritage: ARtSENSE project. In Progress in Cultural Heritage Preservation. Springer, 746--755.
[48]
Daniela D’Auria, Dario Di Mauro, Davide Maria Calandra, Francesco Cutugno, and Via Cinthia SNC. 2015. A 3D audio augmented reality system for a cultural heritage management and fruition. J. Dig. Inf. Manage. 13, 4 (2015), 203.
[49]
Ioannis Deliyiannis and Georgios Papaioannou. 2014. Augmented reality for archaeological environments on mobile devices: A novel open framework. Mediter. Archaeol. Archaeom. 14, 4 (2014), 1--10.
[50]
M. Claudia, Tom Dieck, Timothy Hyungsoo Jung, and Dario tom Dieck. 2016. Enhancing art gallery visitors learning experience using wearable augmented reality: Generic learning outcomes perspective. Curr. Issues Tourism 0, 0 (2016), 1--21.
[51]
Steven Dow, Jaemin Lee, Christopher Oezbek, Blair Maclntyre, Jay David Bolter, and Maribeth Gandy. 2005. Exploring spatial narratives and mixed reality experiences in Oakland Cemetery. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology. ACM, 51--60.
[52]
Emmanuel Durand, Frederic Merienne, Christian Pere, and Patrick Callet. 2014. Ray-on, an on-site photometric augmented reality device. J. Comput. Cult. Herit. 7, 2 (2014), 7.
[53]
Tommaso Empler. 2015. Cultural heritage: Displaying the forum of nerva with new technologies. In 2015 Digital Heritage, Vol. 2. IEEE, 581--586.
[54]
Tommaso Empler, Giovanni Murru, and Marco Fratarcangeli. 2013. Practical augmented visualization on handheld devices for cultural heritage. In Proceedings of the 21st International Conference on Computer Graphics, Visualisation and Computer Vision. Václav Skala-UNION Agency, 97--103.
[55]
Alex Ibáñez Etxeberria, Mikel Asensio, Naiara Vicent, and José María Cuenca. 2012. Mobile devices: A tool for tourism and learning at archaeological sites. Int. Jo. Web Based Commun. 8, 1 (2012), 57--72.
[56]
Belen Jiménez Fernández-Palacios, Daniele Morabito, and Fabio Remondino. 2017. Access to complex reality-based 3D models using virtual reality solutions. J. Cult. Herit. 23 (2017), 40--48.
[57]
F. Fritz, A Susperregui, and Maria Teresa Linaza. 2005. Enhancing cultural tourism experiences with augmented reality technologies. In Proceedings of the6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST’05).
[58]
Athanasios Gaitatzes, Dimitrios Christopoulos, and Maria Roussou. 2001. Reviving the past: Cultural heritage meets virtual reality. In Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage. ACM, 103--110.
[59]
Areti Galani. 2003. Mixed reality museum visits: Using new technologies to support co-visiting for local and remote visitors. Museol. Rev. 10 (2003).
[60]
Michael Gargalakos, Elpida Giallouri, Aggelos Lazoudis, Sofoklis Sotiriou, and Franz X Bogner. 2011. Assessing the impact of technology-enhanced field trips in science centers and museums. Adv. Sci. Lett. 4, 11--12 (2011), 3332--3341.
[61]
Philip Geiger, Marc Schickler, Rüdiger Pryss, Johannes Schobel, and Manfred Reichert. 2014. Location-based mobile augmented reality applications: Challenges, examples, lessons learned. In 10th Int'l Conference on Web Information Systems and Technologies (WEBIST'14), Special Session on Business Apps (2014), 383--394.
[62]
Jean-Pierre Gerval and Yann Le Ru. 2015. Fusion of multimedia and mobile technology in audioguides for museums and exhibitions. In Fusion of Smart, Multimedia and Computer Gaming Technologies. Springer, 173--205.
[63]
Florin Girbacia, Silviu Butnariu, A. Orman, and C. Postelnicu. 2013. Virtual restoration of deteriorated religious heritage objects using augmented reality technologies. Eur. J. Sci. Theol. 9, 2 (2013), 223--231.
[64]
Diego Gutierrez, Francisco J. Seron, Juan A. Magallon, Emilio J. Sobreviela, and Pedro Latorre. 2004. Archaeological and cultural heritage: Bringing life to an unearthed muslim suburb in an immersive environment. J. Cult. Herit. 5, 1 (2004), 63--74.
[65]
Daniel A Guttentag. 2010. Virtual reality: Applications and implications for tourism. Tourism Manage. 31, 5 (2010), 637--651.
[66]
Tony Hall, Luigina Ciolfi, Liam Bannon, Mike Fraser, Steve Benford, John Bowers, Chris Greenhalgh, Sten-Olof Hellström, Shahram Izadi, Holger Schnädelbach, and others. 2001. The visitor as virtual archaeologist: Explorations in mixed reality technology to enhance educational and social interaction in the museum. In Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage. ACM, 91--96.
[67]
Jong-Gil Han, Kyoung-Wook Park, Kyeong-Jin Ban, and Eung-Kon Kim. 2013. Cultural heritage sites visualization system based on outdoor augmented reality. AASRI Proc. 4 (2013), 64--71.
[68]
Marek Hatala and Ron Wakkary. 2005. Ontology-based user modeling in an augmented audio reality system for museums. User Model. User-Adapt. Interact. 15, 3--4 (2005), 339--380.
[69]
Anne-Cecilie Haugstvedt and John Krogstie. 2012a. Mobile augmented reality for cultural heritage: A technology acceptance study. In Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR’12). IEEE, 247--255.
[70]
A.-C. Haugstvedt and John Krogstie. 2012b. Mobile augmented reality for cultural heritage: A technology acceptance study. In Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR’12). IEEE, 247--255.
[71]
Mahmoud Haydar, David Roussel, Madjid Maïdi, Samir Otmane, and Malik Mallem. 2011. Virtual and augmented reality for cultural computing and heritage: A case study of virtual exploration of underwater archaeological sites (preprint). Virtual Real. 15, 4 (2011), 311--327.
[72]
Henry Heberle, Gabriela Vaz Meirelles, Felipe R. da Silva, Guilherme P. Telles, and Rosane Minghim. 2015. InteractiVenn: A web-based tool for the analysis of sets through Venn diagrams. BMC Bioinf. 16, 1 (2015), 169.
[73]
Luis A. Hernández, Javier Taibo, David Blanco, José A Iglesias, Antonio Seoane, Alberto Jaspe, and Rocío López. 2007. Physically walking in digital spaces a virtual reality installation for exploration of historical heritage. Int. J. Arch. Comput. 5, 3 (2007), 487--506.
[74]
Heiko Herrmann and Emiliano Pastorelli. 2014. Virtual reality visualization for photogrammetric 3d reconstructions of cultural heritage. In Proceedings of the International Conference on Augmented and Virtual Reality. Springer, 283--295.
[75]
Chun-Ko Hsieh, Wen-Ching Liao, Meng-Chieh Yu, and Yi-Ping Hung. 2014. Interacting with the past: Creating a time perception journey experience using kinect-based breath detection and deterioration and recovery simulation technologies. J. Comput. Cult. Herit. 7, 1 (2014), 1.
[76]
Wei Huang, Min Sun, and Songnian Li. 2016. A 3D GIS-based interactive registration mechanism for outdoor augmented reality system. Expert Syst. Applic. 55 (2016), 48--58.
[77]
Wolfgang Hürst and Casper Van Wezel. 2013. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools Appl. 62, 1 (2013), 233--258.
[78]
Sara Invitto, Italo Spada, Dario Turco, and Genuario Belmonte. 2014. Easy perception lab: Evolution, brain and virtual and augmented reality in museum environment. In Proceedings of the International Conference on Augmented and Virtual Reality. Springer, 302--310.
[79]
Hiroshi Ishii. 2008. The tangible user interface and its evolution. Commun. ACM 51, 6 (2008), 32--36.
[80]
Jiyoung Kang. 2013. AR teleport: Digital reconstruction of historical and cultural-heritage sites for mobile phones via movement-based interactions. Wireless Pers. Commun. 70, 4 (2013), 1443--1462.
[81]
Stavros Kateros, Stylianos Georgiou, Margarita Papaefthymiou, George Papagiannakis, and Michalis Tsioumas. 2015. A comparison of gamified, immersive VR curation methods for enhanced presence and human-computer interaction in digital humanities. Int. J. Herit. Dig. Era 4, 2 (2015), 221--233.
[82]
Hirokazu Kato, Mark Billinghurst, Ivan Poupyrev, Kenji Imamoto, and Keihachiro Tachibana. 2000. Virtual object manipulation on a table-top AR environment. In Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR’00). IEEE, 111--119.
[83]
Irene Katsouri, Aimilia Tzanavari, Kyriakos Herakleous, and Charalambos Poullis. 2015. Visualizing and assessing hypotheses for marine archaeology in a VR CAVE environment. J. Comput. Cultur. Herit. 8, 2 (2015), 10.
[84]
Kangsoo Kim, Byung-Kuk Seo, Jae-Hyek Han, and Jong-Il Park. 2009. Augmented reality tour system for immersive experience of cultural heritage. In Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry. ACM, 323--324.
[85]
Chris D. Kounavis, Anna E. Kasimati, and Efpraxia D. Zamani. 2012. Enhancing the tourism experience through mobile augmented reality: Challenges and prospects. Int. J. Eng. Bus. Manage. 4 (2012), 1--6.
[86]
Dejan Kovachev, Petru Nicolaescu, and Ralf Klamma. 2014. Mobile real-time collaboration for semantic multimedia. Mobile Netw. Appl. 19, 5 (2014), 635--648.
[87]
Robert G. Laycock, David Drinkwater, and Andy M. Day. 2008. Exploring cultural heritage sites through space and time. J. Comput. Cult. Herit. 1, 2 (2008), 11.
[88]
Johnny Lee. 2017. 4-1: Invited paper: Mobile AR in your pocket with google tango. In SID Symposium Digest of Technical Papers, Vol. 48. Wiley Online Library, 17--18.
[89]
Fotis Liarokapis. 2007. An augmented reality interface for visualizing and interacting with virtual content. Virtual Real. 11, 1 (2007), 23--43.
[90]
Fotis Liarokapis, Ian Greatbatch, David Mountain, Anil Gunesh, Vesna Brujic-Okretic, and Jonathan Raper. 2005. Mobile augmented reality techniques for geovisualisation. In Proceedings of the 9th International Conference on Information Visualisation, 2005. IEEE, 745--751.
[91]
Fotis Liarokapis, Robert M. Newman, Sarah Mount, Daniel Goldsmith, Louis Macan, Garry Malone, James Shuttleworth, and others. 2007. Sense-enabled mixed reality museum exhibitions. In Proceedings of the6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST’07). 31--38.
[92]
Gunnar Liestøl. 2014. Along the appian way. Storytelling and memory across time and space in mobile augmented reality. In Proceedings of the Euro-Mediterranean Conference. Springer, 248--257.
[93]
Weiquan Lu, Linh-Chi Nguyen, Teong Leong Chuah, and Ellen Yi-Luen Do. 2014. Effects of mobile AR-enabled interactions on retention and transfer for learning in art museum contexts. In Proceedings of the 2014 IEEE International Symposium on Mixed and Augmented Reality-Media, Art, Social Science, Humanities and Design (ISMAR-MASH’D’14). IEEE, 3--11.
[94]
Jacob B. Madsen and Claus B. Madsen. 2016. Handheld visual representation of a castle chapel ruin. J. Comput. Cult. Herit. 9, 1 (2016), 6.
[95]
Nadia Magnenat-Thalmann and George Papagiannakis. 2005. Virtual worlds and augmented reality in cultural heritage applications. Recording, Modeling and Visualization of Cultural Heritage (2005), 419--430.
[96]
Nadia Magnenat-Thalmann, George Papagiannakis, Alessandro Foni, Marlene Arevalo, and Nedjma Cadi-Yazli. 2004. Simulating life in ancient sites using mixed reality technology. CEIG04 (2004).
[97]
Lev Manovich. 2006. The poetics of augmented space. Vis. Commun. 5, 2 (2006), 219--240.
[98]
Fabio Marton, Marcos Balsa Rodriguez, Fabio Bettio, Marco Agus, Alberto Jaspe Villanueva, and Enrico Gobbetti. 2014. IsoCam: Interactive visual exploration of massive cultural heritage models on large projection setups. J. Comput. Cult. Herit. 7, 2 (2014), 12.
[99]
Camillia Matuk. 2016. The learning affordances of augmented reality for museum exhibits on human health. Mus. Soc.Issues 11, 1 (2016), 73--87.
[100]
Tamás Matuszka. 2015. The design and implementation of semantic web-based architecture for augmented reality browser. In Proceedings of the European Semantic Web Conference. Springer, 731--739.
[101]
Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77, 12 (1994), 1321--1329.
[102]
Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Photonics for Industrial Applications. International Society for Optics and Photonics, 282--292.
[103]
Tsutomu Miyashita, Peter Meier, Tomoya Tachikawa, Stephanie Orlic, Tobias Eble, Volker Scholz, Andreas Gapel, Oliver Gerl, Stanimir Arnaudov, and Sebastian Lieberknecht. 2008. An augmented reality museum guide. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 103--106.
[104]
Rozhen Kamal Mohammed-Amin, Richard M. Levy, and Jeffrey Edwin Boyd. 2012. Mobile augmented reality for interpretation of archaeological sites. In Proceedings of the 2nd International ACM Workshop on Personalized Access to Cultural Heritage. ACM, 11--14.
[105]
N. Mourkoussis, F. Liarokapis, J. Darcy, M. Pettersson, P. Petridis, P. Lister, and M. White. 2002. Virtual and augmented reality applied to educational and cultural heritage domains. In Proceedings of the Workshop on Business Applications of Virtual Reality.
[106]
Sander Münster, Cindy Kröber, Heide Weller, and Nikolas Prechtel. 2017. Virtual reconstruction of historical architecture as media for knowledge representation. In Mixed Reality and Gamification for Cultural Heritage. Springer, 313--330.
[107]
Takeshi Naemura, Yasuaki Kakehi, Tomoko Hashida, Daisuke Akatsuka, Takuro Wada, Takashi Nariya, Totaro Nakashima, Ryo Oshima, Takafumi Kuno, and others. 2010. Mixed reality technologies for museum experience. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry. ACM, 17--20.
[108]
Zakiah Noh, Mohd Shahrizal Sunar, and Zhigeng Pan. 2009. A review on augmented reality for virtual heritage system. In Proceedings of the International Conference on Technologies for E-Learning and Digital Entertainment. Springer, 50--61.
[109]
Fumio Okura, Masayuki Kanbara, and Naokazu Yokoya. 2015. Mixed-reality world exploration using image-based rendering. J. Comput. Cult. Herit. 8, 2 (2015), 9.
[110]
Laura Serra Oliva, Anna Mura, Daniel Pacheco, Enrique Martinez, Paul Verschure, and others. 2015. Recovering the history of bergen belsen using an interactive 3D reconstruction in a mixed reality space the role of pre-knowledge on memory recollection. In 2015 Digital Heritage, Vol. 1. IEEE, 163--165.
[111]
Kemal Egemen Ozden, Devrim Unay, Huseyin Inan, Bahtiyar Kaba, and Ovgu Ozturk Ergun. 2014. Intelligent interactive applications for museum visits. In Proceedings of the Euro-Mediterranean Conference. Springer, 555--563.
[112]
Daniel Pacheco, Sytse Wierenga, Pedro Omedas, Laura S Oliva, Stefan Wilbricht, Stephanie Billib, Habbo Knoch, and Paul FMJ Verschure. 2015. A location-based augmented reality system for the spatial interaction with historical datasets. In 2015 Digital Heritage, Vol. 1. IEEE, 393--396.
[113]
Margarita Papaefthymiou, Steve Kateros, Stylianos Georgiou, Nikos Lydatakis, Paul Zikas, Vasileios Bachlitzanakis, and George Papagiannakis. 2017. Gamified AR/VR character rendering and animation-enabling technologies. In Mixed Reality and Gamification for Cultural Heritage. Springer, 333--357.
[114]
George Papagiannakis, Gurminder Singh, and Nadia Magnenat-Thalmann. 2008. A survey of mobile and wireless technologies for augmented reality systems. Comput. Anim. Virtual Worlds 19, 1 (2008), 3--22.
[115]
Sofia Pescarin, Alfonsina Pagano, Mattias Wallergård, Wim Hupperetz, and Christie Ray. 2012. Archeovirtual 2011: An evaluation approach to virtual museums. In Proceedings of the 2012 18th International Conference on Virtual Systems and Multimedia (VSMM’11). IEEE, 25--32.
[116]
Panagiotis Petridis, Ian Dunwell, Fotis Liarokapis, George Constantinou, Sylvester Arnab, Sara de Freitas, and Maurice Hendrix. 2013. The herbert virtual museum. J. Electr. Comput. Engineer. 2013 (2013), 16.
[117]
Corrado Petrucco and Daniele Agostini. 2016. Teaching cultural heritage using mobile augmented reality. J. e-Learn. Knowl. Soc. 12, 3 (2016).
[118]
Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, Francesca Colosi, and Roberto Orazi. 2016a. 3D visualization tools to explore ancient architectures in south america. Virtual Archaeology Review (2016).
[119]
Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, Francesca Colosi, and Roberto Orazi. 2016b. Virtual reconstruction of archaeological heritage using a combination of photogrammetric techniques: Huaca Arco Iris, Chan Chan, Peru. Digital Appl. Archaeology Cult. Herit. 3, 3 (2016), 80--90.
[120]
Roberto Pierdicca, Emanuele Frontoni, Primo Zingaretti, Eva Savina Malinverni, Francesca Colosi, and Roberto Orazi. 2015a. Making visible the invisible. augmented reality visualization for 3D reconstructions of archaeological sites. In Proceedings of the International Conference on Augmented and Virtual Reality. Springer, 25--37.
[121]
Roberto Pierdicca, Emanuele Frontoni, Primo Zingaretti, Mirco Sturari, Paolo Clini, and Ramona Quattrini. 2015b. Advanced interaction with paintings by augmented reality and high resolution visualization: A real case exhibition. In Proceedings of the International Conference on Augmented and Virtual Reality. Springer, 38--50.
[122]
Eva Pietroni, Annachiara Pagano, and Claudio Rufa. 2013. The etruscanning project: Gesture-based interaction and user experience in the virtual reconstruction of the regolini-galassi tomb. In Proceedings of the Digital Heritage International Congress (DigitalHeritage’13), Vol. 2. IEEE, 653--660.
[123]
Cristina Portalés, José L. Lerma, and Carmen Pérez. 2009. Photogrammetry and augmented reality for cultural heritage applications. Photogram. Rec. 24, 128 (2009), 316--331.
[124]
R. Quattrini, R. Pierdicca, E. Frontoni, and R. Barcaglioni. 2016. Virtual reconstruction of lost architectures: From the Tls survey to AR visualization. Int. Arch. Photogram. Remote Sens. Spatial Inf. Sci. (2016), 383--390.
[125]
Sasithorn Rattanarungrot, Martin White, Zeeshan Patoli, and Tudor Pascu. 2014. The application of augmented reality for reanimating cultural heritage. In Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality. Springer, 85--95.
[126]
Gerhard Reitmayr and Dieter Schmalstieg. 2004. Collaborative augmented reality for outdoor navigation and information browsing. In Proceedings of the Symposium Location-Based Services and Telecartography.
[127]
Markku Reunanen, Lily Díaz, and Tommi Horttana. 2015. A holistic user-centered approach to immersive digital cultural heritage installations: Case vrouw maria. J. Comput. Cult. Herit. 7, 4 (2015), 24.
[128]
Heather Richards-Rissetto, Jim Robertsson, Jennifer von Schwerin, Giorgio Agugiaro, Fabio Remondino, and Gabrio Girardi. 2014. Geospatial virtual heritage: A gesture-based 3D GIS to engage the public with ancient maya archaeology. Archaeology in the Digital Era (2014), 118--130.
[129]
Brett Ridel, Patrick Reuter, Jérémy Laviole, Nicolas Mellado, Nadine Couture, and Xavier Granier. 2014. The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cult. Herit. 7, 2 (2014), 6.
[130]
Jacob Rigby and Shamus P. Smith. 2013. Augmented reality challenges for cultural heritage. Newcastle: Applied Informatics Research Group. University of Newcastle (2013).
[131]
Marcos Balsa Rodriguez, Marco Agus, Fabio Bettio, Fabio Marton, and Enrico Gobbetti. 2015. Digital mont’e prama: 3D cultural heritage presentations in museums and anywhere. In Digital Heritage, 2015, Vol. 2. IEEE, 557--564.
[132]
Jannick P. Rolland and Henry Fuchs. 2000. Optical versus video see-through head-mounted displays in medical visualization. Presence 9, 3 (2000), 287--309.
[133]
Michele Ruta, Floriano Scioscia, Danilo De Filippis, Saverio Ieva, Mario Binetti, and Eugenio Di Sciascio. 2014. A semantic-enhanced augmented reality tool for OpenStreetMap POI discovery. Transport. Res. Proc. 3 (2014), 479--488.
[134]
Giovanni Saggio and Davide Borra. 2011. Augmented reality for restoration/reconstruction of artefacts with artistic or historical value. Some Emerging Application Area (2011).
[135]
Fernando Sambinelli and Cecilia Sosa Arias. 2015. Augmented reality browsers: A proposal for architectural standardization. Int. J. Softw. Eng. Appl. 6, 1 (2015), 1.
[136]
Andrea Sanna and Federico Manuri. 2016. A survey on applications of augmented reality. Adv. Comput. Sci. 5, 1 (2016), 18--27.
[137]
Pedro Santos, Dominik Acri, Thomas Gierlinger, Hendrik Schmedt, and André Stork. 2010. Supporting outdoor mixed reality applications for architecture and cultural heritage. In Proceedings of the 2010 Spring Simulation Multiconference. Society for Computer Simulation International, 190.
[138]
Holger Schnädelbach, Boriana Koleva, Martin Flintham, Mike Fraser, Shahram Izadi, Paul Chandler, Malcolm Foster, Steve Benford, Chris Greenhalgh, and Tom Rodden. 2002. The augurscope: A mixed reality interface for outdoors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 9--16.
[139]
Alberto Sdegno, Silvia Masserano, Denis Mior, Paola Cochelli, and Eleonora Gobbo. 2015. Augmenting painted architectures for communicating cultural heritage. Sci. Res. Inf. Technol. 5, 1 (2015), 93--100.
[140]
Byung-Kuk Seo, Kangsoo Kim, Jungsik Park, and Jong-Il Park. 2010. A tracking framework for augmented reality tours on cultural heritage sites. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry. ACM, 169--174.
[141]
Orit Shaer and Eva Hornecker. 2010. Tangible user interfaces: Past, present, and future directions. Found. Trends Hum.-Comput. Interact. 3, 1--2 (2010), 1--137.
[142]
Filippo Stanco, Davide Tanasi, Giovanni Gallo, Matteo Buffa, and Beatrice Basile. 2012. Augmented perception of the past. the case of hellenistic syracuse. J. Multimedia 7 (2012), 211--216.
[143]
Sylaiou Styliani, Liarokapis Fotis, Kotsakis Kostas, and Patias Petros. 2009. Virtual museums, a survey and some issues for consideration. J. Cult. Herit. 10, 4 (2009), 520--528.
[144]
Stella Sylaiou, Katerina Mania, Athanasis Karoulis, and Martin White. 2010. Exploring the relationship between presence and enjoyment in a virtual museum. Int. J. Hum.-Comput. Stud. 68, 5 (2010), 243--253.
[145]
Hideaki Uchiyama and Eric Marchand. 2012. Object detection and pose tracking for augmented reality: Recent approaches. In Proceedings of the 18th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV’12).
[146]
Chris Van Aart, Bob Wielinga, and Willem Robert Van Hage. 2010. Mobile cultural heritage guide: Location-aware semantic search. In Proceedings of the International Conference on Knowledge Engineering and Knowledge Management. Springer, 257--271.
[147]
D. W. F. Van Krevelen and R. Poelman. 2010. A survey of augmented reality technologies, applications and limitations. Int. J. Virt. Real. 9, 2 (2010), 1.
[148]
David Vanoni, Maurizio Seracini, and Falko Kuester. 2012. ARtifact: Tablet-based augmented reality for interactive analysis of cultural artifacts. In Proceedings of the 2012 IEEE International Symposium on Multimedia (ISM’12). IEEE, 44--49.
[149]
Styliani Verykokou, Charalabos Ioannidis, and Georgia Kontogianni. 2014. 3D visualization via augmented reality: The case of the middle stoa in the ancient agora of athens. In Proceedings of the Euro-Mediterranean Conference. Springer, 279--289.
[150]
Vassilios Vlahakis, John Karigiannis, Manolis Tsotros, Michael Gounaris, Luis Almeida, Didier Stricker, Tim Gleue, Ioannis T Christou, Renzo Carlucci, and Nikos Ioannidis. 2001. Archeoguide: First results of an augmented reality, mobile computing system in cultural heritage sites. In Virtual Reality, Archeology, and Cultural Herit. 131--140.
[151]
Fei-Yue Wang. 2009. Is culture computable? IEEE Intell. Syst. 24, 2 (2009), 2--3.
[152]
Bridgette Wiley and Jürgen P. Schulze. 2015. archAR: An archaeological augmented reality experience. In SPIE/IS8T Electronic Imaging. International Society for Optics and Photonics, 939203--939203.
[153]
Rafal Wojciechowski, Krzysztof Walczak, Martin White, and Wojciech Cellary. 2004. Building virtual and augmented reality museum exhibitions. In Proceedings of the 9th International Conference on 3D Web Technology. ACM, 135--144.
[154]
Jiri Zara. 2004. Virtual reality and cultural heritage on the web. In Proceedings of the 7th International Conference on Computer Graphics and Artificial Intelligence. 101--112.
[155]
Qinping Zhao. 2009. A survey on virtual reality. Sci. Chin. Ser. F: Inf. Sci. 52, 3 (2009), 348--400.
[156]
Feng Zhou, Henry Been-Lirn Duh, and Mark Billinghurst. 2008. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 193--202.
[157]
Ning-Ning Zhou and Yu-Long Deng. 2009. Virtual reality: A state-of-the-art survey. Int. J. Autom. Comput. 6, 4 (2009), 319--325.
[158]
Michael Zoellner, Jens Keil, Timm Drevensek, and Harald Wuest. 2009a. Cultural heritage layers: Integrating historic media in augmented reality. In Proceedings of the 15th International Conference on Virtual Systems and Multimedia, 2009 (VSMM’09). IEEE, 193--196.
[159]
Michael Zoellner, Jens Keil, Harald Wuest, and Daniël Pletinckx. 2009b. An augmented reality presentation system for remote cultural heritage sites. In Proceedings of the 10th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST’09). Citeseer, 112--116.

Cited By

View all

Index Terms

  1. A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Journal on Computing and Cultural Heritage
      Journal on Computing and Cultural Heritage   Volume 11, Issue 2
      June 2018
      124 pages
      ISSN:1556-4673
      EISSN:1556-4711
      DOI:10.1145/3199679
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 22 March 2018
      Accepted: 01 September 2017
      Revised: 01 September 2017
      Received: 01 June 2017
      Published in JOCCH Volume 11, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Cultural heritage
      2. augmented reality
      3. mixed reality
      4. virtual reality

      Qualifiers

      • Tutorial
      • Research
      • Refereed

      Funding Sources

      • Hasso-Plattner Institute

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1,607
      • Downloads (Last 6 weeks)201
      Reflects downloads up to 18 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media