research-article

Supporting outdoor mixed reality applications for architecture and cultural heritage

Authors:

Thomas Gierlinger,

Hendrik Schmedt,

André StorkAuthors Info & Claims

SpringSim '10: Proceedings of the 2010 Spring Simulation Multiconference

Article No.: 190, Pages 1 - 8

https://doi.org/10.1145/1878537.1878735

Published: 11 April 2010 Publication History

Abstract

This paper introduces new approaches to enable collaborative outdoor mixed reality design review in the architectural domain as well as outdoor mixed reality experiences in the cultural heritage domain.

For this purpose we present the results of three closely related European projects, IMPROVE and CINeSPACE, which are currently succeeded by MAXIMUS, continuing the development of technologies relevant to the two domains.

The paper focuses on the base technologies needed to develop usable outdoor mixed reality applications, such as marker-less optical tracking combined with sensor fusion for accurate pose estimation outdoors. Furthermore the paper presents a new visualization system developed within the project, one of the few daylight blocking head.-mounted displays available. In addition to pose estimation and visualization devices, the paper presents a VR framework adapted for the architecture and the cultural heritage domain featuring high dynamic range image acquisition combined with pre-computed radiance transfer rendering to be able to photo-realistically render urban content. For the cultural heritage domain this framework has been extended to allow accurate display and generation of multimedia content super-imposed on a real environment as well as city navigation.

References

[1]

{Sloan et al 2002}: Sloan, P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of the 29th Annual Conference on Computer Graphics and interactive Techniques (San Antonio, Texas, July 23--26, 2002). SIGGRAPH '02. ACM, New York, NY, 527--536.

Digital Library

[2]

{Klinker et al 2002}: Klinker, G., Dutoit, A. H., Bauer, M., Bayer, J., Novak, V., and Matzke, D. 2002. Fata Morgana "A Presentation System for Product Design. In Proceedings of the 1st international Symposium on Mixed and Augmented Reality (September 30 - October 01, 2002). Symposium on Mixed and Augmented Reality. IEEE Computer Society, Washington, DC, 76.

Digital Library

[3]

{ARIS 2004}: ARIS project (2004) European research project aris, augmented reality image synthesis through illumination reconstruction and its integration in interactive and shared mobile ar-systems for e (motion)-commerce applications. http://aris-ist.intranet.gr

[4]

{Pomi et al 2003}: Pomi, A., Marmitt, G., Wald, I., Slusallek, P. 2003. Streaming Video Textures for Mixed Reality Applications in Interactive Ray Tracing Environments. In Virtual Reality, Modelling and Visualization 2003 (VMV), November 19--21, Munich, Germany. 2003

[5]

{Santos et al 2007}: Santos, P., Gierlinger, T., Stork, A., McIntyre, D. 2007. Display and rendering technologies for virtual and mixed reality design review. In 7th International Conference on Construction Applications of Virtual Reality, CONVR 2007. Penn State University, University Park, PA, USA.

[6]

{Gierlinger et al 2009}: Gierlinger T., Danch, D. Stork, A. 2009. Rendering techniques for mixed reality. In Journal of Real-Time Image Processing, Special Issue, Springer Berlin / Heidelberg. DOI 10.1007/s11554-009-0137-x

[7]

{Debevec et al 1998}: Debevec, P. Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1998), ACM, pp. 189--198.

Digital Library

[8]

{HDRShop 2009}: Website: http://www.hdrshop.com/; Last visited: 01.12.2009

[9]

{PFSTools 2009}: Website: http://pfstools.sourceforge.net/; Last visited: 01.12.2009

[10]

{AHDRIA 2009}: Website: http://www2.cs.uh.edu/~somalley/hdri_images.html; Last visited: 01.12.2009

[11]

{SPHERON 2009}: Website: http://www.spheron.com/; Last visited: 01.12.2009

[12]

{Shirley et al 2003}: Shirley, P., and Morley, R. K. Realistic Ray Tracing. A. K. Peters, Ltd., Natick, MA, USA, 2003.

Digital Library

[13]

{Trivisio 2009}: Website: http://www.trivisio.com/; Last visited: 01.12.2009

[14]

{Kiyokawa et al 2003}: Kiyokawa K., Billinghurst M., Campbell B., Woods E., An Occlusion-Capable Optical See-through Head Mounted Display for Supporting Co-located Collaboration, Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p. 133, October 07--10, 2003

Digital Library

[15]

{Mulder et al 2005}Mulder, J. D. Realistic occlusion effects in mirror-based co-located augmented reality systems. In Virtual Reality 2005. Proceedings of VR2005, IEEE 12--16 March 2005, p. 203--208

Digital Library

[16]

{Santos et al 2008a}: Santos, P., Gierlinger, T., Machui, O., Stork, A. 2008. The daylight blocking optical stereo see-through hmd. In IPT/EDT 2008. Proceedings, 4.

Digital Library

[17]

{Santos et al 2008b}: Santos, P., Gierlinger, T., Machui, O., Stork, A. 2008. An innovative daylight blocking optical stereo see-through hmd. In Siggraph 2008. Full Conference DVDROM, 1.

Digital Library

[18]

{Sutherland 1968}: Sutherland, Ivan E.: A head-mounted three dimensional display. In: AFIPS'68 (Fall, part I): Proceedings of the December 9--11, 1968, fall joint computer conference, part I. New York, NY, USA: ACM, 1968, S. 757 764 2, 2.1

Digital Library

[19]

{Klein et al 2007}: Klein, G.; Murray, D.: Parallel Tracking and Mapping for Small AR Workspaces. In: ISMAR '07: Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Washington, DC, USA: IEEE Computer Society, 2007. ISBN 978 1 4244 1749 0, S. 1 10 2.1.3

Digital Library

[20]

{Bleser et al 2006}: Bleser, G.; Wuest, H.; Stricker, D.: Online camera pose estimation in partially known and dynamic scenes. In: ISMAR '06: Proceedings of the 2006 Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'06). Washington, DC, USA: IEEE Computer Society, 2006. ISBN 1 4244 0650 1, S. 56 65 2.1.3

Digital Library

[21]

{DiVerdi et al 2007}: DiVerdi, S.; Hollerer, T.: GroundCam: A Tracking Modality for Mobile Mixed Reality. In: Virtual Reality Conference, 2007. VR '07. IEEE, 2007, S. 75 82 2.1.3

[22]

{Reitinger et al 2007}: Reitinger, B.; Zach, C.; Schmalstieg, D.: Augmented Reality Scouting for Interactive 3D Reconstruction. In: Virtual Reality Conference, 2007. VR '07. IEEE, 2007, S. 219 222 2.1.3

[23]

{Bleser et al 2008}: Bleser, G.; Stricker, D.: Advanced Tracking through Efficient Image Processing and Visual-inertial Sensor Fusion. In: IEEE Virtual Reality 2008. Proceedings, 2008, 137--144 2.1.3

[24]

{Lee et al 2008}: Lee, T.; Hollerer, T.: Hybrid Feature Tracking and User Interaction for Markerless Augmented Reality. In: Virtual Reality Conference, 2008. VR '08. IEEE, 2008, S. 145 152 2.1.3

[25]

{Reitmayr et al 2007}: Reitmayr, G.; Drummond, T. W.: Initialisation for Visual Tracking in Urban Environments. In: Mixed and Augmented Reality, 2007. ISMAR 2007. 6th IEEE and ACM International Symposium on, 2007, S. 161 172 2.1.3

Digital Library

[26]

{Huber et al 2007}: Huber, M.; Pustka, D.; Keitler, P.; Echtler, F.; Klinker, G.: A System Architecture for Ubiquitous Tracking Environments. In: Mixed and Augmented Reality, 2007. ISMAR 2007. 6th IEEE and ACM International Symposium on, 2007, S. 211 214 2.1.3

Digital Library

[27]

{Pustka and Klinker 2008}: Pustka, D.; Klinker, G.: Dynamic gyroscope fusion in Ubiquitous Tracking environments. In: Mixed and Augmented Reality, 2008. ISMAR 2008. 7^th IEEE/ACM International Symposium on, 2008, S. 13 20 2.1.3

Digital Library

[28]

{Kotake et al 2007}: Kotake, D.; Satoh, K.; Uchiyama, S.; Yamamoto, H.: A Fast Initialization Method for Edge-based Registration Using an Inclination Constraint. In: Mixed and Augmented Reality, 2007. ISMAR 2007. 6th IEEE and ACM International Symposium on, 2007, S. 239 248 2.1.3

Digital Library

[29]

{Fong et al 2008}: Fong, W. T.; Ong, S. K.; Nee, A.: A di erential GPS carrier phase technique for precision outdoor AR tracking. In: Mixed and Augmented Reality, 2008. ISMAR 2008. 7th IEEE/ACM International Symposium on, 2008, S. 25 28 2.1.3

Digital Library

[30]

{Zhang 1999}: Zhang, Z.: Flexible Camera Calibration By Viewing a Plane From Unknown Orientations. Version: 1999. IEEE 1999

[31]

{Pedram et al. 2007} Pedram Azad, Rüdiger D. Tilo Gockel G. Tilo Gockel: Computer Vision - DasPraxisbuch. 1. Auflage. Elektor Verlag, 2007. -- ISBN 978-3-89576-165 3.2,3.2,3, 4.5.2.1

[32]

{Lucas et al 1981} B. D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision", DARPA Image Understanding Workshop, 1981, pp. 121--130 (see also IJCAI'81, pp. 674--679).

Digital Library

Cited By

Perera PWebber SSmith W(2024)Digital design considerations in urban natureProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3689441(235-243)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3689441
Kulkarni SKulkarni A(2024)Review on use of Immersive Technologies in Tourism2024 International Conference on Intelligent Computing and Emerging Communication Technologies (ICEC)10.1109/ICEC59683.2024.10837334(1-7)Online publication date: 23-Nov-2024
https://doi.org/10.1109/ICEC59683.2024.10837334
Bekele MChampion E(2019)A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual HeritageFrontiers in Robotics and AI10.3389/frobt.2019.000916Online publication date: 24-Sep-2019
https://doi.org/10.3389/frobt.2019.00091
Show More Cited By

Supporting outdoor mixed reality applications for architecture and cultural heritage
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage

A multimedia approach to the diffusion, communication, and exploitation of Cultural Heritage (CH) is a well-established trend worldwide. Several studies demonstrate that the use of new and combined media enhances how culture is experienced. The benefit ...
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)

The paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
A Survey of Augmented Reality Applications in Cultural Heritage

Augmented reality is now a well-known concept, a technology that integrates digital content to the user's physical world. As more and more applications begin to reshape user's daily lives in multiple domains, cultural heritage sites have begun to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SpringSim '10: Proceedings of the 2010 Spring Simulation Multiconference

April 2010

1726 pages

ISBN:9781450300698

General Chairs:
Robert McGraw
RAM Laboratories, Inc
,
Eric Imsand
Auburn University
,
Program Chair:
Michael J. Chinni
US Army - RDECOM - ARDEC

Sponsors

SCS: Society for Modeling and Simulation International

In-Cooperation

SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

Society for Computer Simulation International

San Diego, CA, United States

Publication History

Published: 11 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SpringSim '10

Sponsor:

SCS

SpringSim '10: 2010 Spring Simulation Conference

April 11 - 15, 2010

Florida, Orlando

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
290
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)1

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Perera PWebber SSmith W(2024)Digital design considerations in urban natureProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3689441(235-243)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3689441
Kulkarni SKulkarni A(2024)Review on use of Immersive Technologies in Tourism2024 International Conference on Intelligent Computing and Emerging Communication Technologies (ICEC)10.1109/ICEC59683.2024.10837334(1-7)Online publication date: 23-Nov-2024
https://doi.org/10.1109/ICEC59683.2024.10837334
Bekele MChampion E(2019)A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual HeritageFrontiers in Robotics and AI10.3389/frobt.2019.000916Online publication date: 24-Sep-2019
https://doi.org/10.3389/frobt.2019.00091
Bekele MPierdicca RFrontoni EMalinverni EGain J(2018)A Survey of Augmented, Virtual, and Mixed Reality for Cultural HeritageJournal on Computing and Cultural Heritage 10.1145/314553411:2(1-36)Online publication date: 22-Mar-2018
https://dl.acm.org/doi/10.1145/3145534
Pan XSchröttner MHavemann SSchiffer TBerndt RHecher MFellner D(2013)A Repository Infrastructure for Working with 3D Assets in Cultural HeritageInternational Journal of Heritage in the Digital Era10.1260/2047-4970.2.1.1432:1(143-166)Online publication date: 1-Mar-2013
https://doi.org/10.1260/2047-4970.2.1.143
Pan XSchiffer TSchrottner MHavemann SHecher MBerndt RFellner D(2012)A scalable repository infrastructure for CH digital object management2012 18th International Conference on Virtual Systems and Multimedia10.1109/VSMM.2012.6365928(219-226)Online publication date: Sep-2012
https://doi.org/10.1109/VSMM.2012.6365928
Santos PSchmedt HAmend BHammer PGiera RHergenröther EStork A(2011)LIS3D: Low-cost 6DOF Laser Interaction for outdoor Mixed RealityVirtual and Mixed Reality - New Trends10.1007/978-3-642-22021-0_30(270-279)Online publication date: 2011
https://doi.org/10.1007/978-3-642-22021-0_30

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten