Article

HyperReal: a hypermedia model for mixed reality

Authors:

Luis Romero,

Nuno CorreiaAuthors Info & Claims

HYPERTEXT '03: Proceedings of the fourteenth ACM conference on Hypertext and hypermedia

Pages 2 - 9

https://doi.org/10.1145/900051.900055

Published: 26 August 2003 Publication History

Get Access

Abstract

This paper describes a generic hypermedia model that is used as a framework for building context aware and mixed reality applications. It can handle different media elements, and it defines a presentation scheme that abstracts several relevant navigation concepts, including link awareness. The model specifies a base structure for the relation between spaces, either real or virtual, and supports contextual mechanisms. Additionally, it establishes a way to correlate real/virtual world objects with information present in the hypermedia graph. It also includes store/replay mechanisms that can be used to repurpose the content in new ways, including storytelling applications. The proposed model is being tested in a gaming and storytelling environment that integrates the real world, media elements and virtual 3D worlds. The paper presents the overall framework, the current implementation and evaluates its usage in the prototype application.

References

[1]

R. Azuma, "A Survey of Augmented Reality", Presence, vol. 6, no. 4, pp. 355--285, 1997.

Digital Library

Google Scholar

[2]

R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, "Recent Advances in Augmented Reality", IEEE Computer Graphics and Applications, November/December 2001, pp. 34--47.

Digital Library

Google Scholar

[3]

J. Baus, A. Kruger, W. Wahlster, "A Resource-Adaptive Mobile Navigation System", Proceedings of the 7th International Conference on Intelligent User Interfaces, ACM (2002) pp. 15--22.

Digital Library

Google Scholar

[4]

F. Bellotti, R. Berta, A. Gloria, and M. Margarone, "User Testing a Hypermedia Tour Guide", Pervasive Computing, IEEE, (April-June 2002) pp. 33--41.

Digital Library

Google Scholar

[5]

M. Billinghurst, K. Hirkazu, I. Poupyrev, "The MagicBook: Moving Seamlessly between Reality and Virtuality", IEEE Computer Graphics and Applications, May-June 2001 pp. 2--4.

Digital Library

Google Scholar

[6]

S. Bjork, J. Falk, R. Hansson, P. Ljungstrand, "Pirates! Using the Physical World as a Game Board". Interact 2001.

Google Scholar

[7]

P. Brusilovsky, "Methods and Techniques of Adaptive Hypermedia", User Modeling and User-Adapted Interaction, Vol. 6, pp. 87--129, Kluwer academic publishers, 1996.

Digital Library

Google Scholar

[8]

N. Bushnell, "Relationships between Fun and Computer Business", Communication of the ACM, August 1996/Vol. 39, No. 8, pp. 31--37.

Digital Library

Google Scholar

[9]

B. Campbell, J. M. Goodman, "HAM: A General-Purpose Hypertext Abstract Machine", Hypertext '87, pp. 22--32.

Digital Library

Google Scholar

[10]

T. Chambel, N. Guimarães, "Context Perception in Video-Based Hypermedia Spaces", Hypertext'02, ACM, 2002, pp. 85--94.

Digital Library

Google Scholar

[11]

K. Cheverest, K. Mitchell, N. Davies, "The Role of Adaptive Hypermedia in a Context-Aware Tourist Guide", Communications of the ACM (May 2002) pp. 47--51.

Digital Library

Google Scholar

[12]

P. De Bra, G. J. Houben, H. Wu, "AHAM: A Dexter-based Reference Model for Adaptive Hypermedia", Proc. Hypertext 99, pp. 147--156.

Digital Library

Google Scholar

[13]

P. De Bra, G. J. Houben, Y. Kornatzky, "An Extensible Data Model for Hyperdocuments", Proc. 4th ACM Conference on Hypertext, Milan, pp. 222--231, 1992.

Digital Library

Google Scholar

[14]

S. Duri, A. Cole, J. Munson, J. Christensen, "An Approach to Providing a Seamless End-User Experience for Location-Aware Applications", WMC 2001, pp. 20--25.

Digital Library

Google Scholar

[15]

M. Flintham, R. Anastasi, S. Benford, T. Hemmings, A. Crabtree, C. Greenhalgh, T. Rodden, N. Tandavanitj, M. Adams, J. Row-Farr, "Where On-Line Meets On-The-Streets: Experiences With Mobile Mixed Reality Games", Technical Report Equator-02-008, Equator, September 2002.

Google Scholar

[16]

K. Grönbæk, R. H. Trigg, "Design Issues for a Dexter-based hypermedia", Proc. ACM ECHT Conference (1992) pp. 191--200.

Digital Library

Google Scholar

[17]

K. Grönbæk, P. P. Vestergaard, P. Orbaek, "Towards Geo-Spatial Hypermedia: Concepts and Prototype Implementation", ACM Hypertext 2002, pp. 117--126.

Digital Library

Google Scholar

[18]

F. Halasz, T. Moran, R. Trigg, "NoteCards in a Nutshell." CHI + GI Conference Proceedings, Toronto, Ontario, Canada. (April 5-9, 1987), pp. 45--52.

Digital Library

Google Scholar

[19]

F. Halasz, M. Schwartz, "The Dexter Hypertext Reference Model", Communications of the ACM, Vol. 37, n.°2, (February 1994) pp. 30--38.

Digital Library

Google Scholar

[20]

L. Hardman, D.C.A. Bulterman, and G.V. Rossum, "The Amsterdam Hypermedia Model: Adding Time and Context to the Dexter Model", Comm. of the ACM, 37, No. 2, Feb. 1995, pp. 50--62.

Digital Library

Google Scholar

[21]

L. Hardman, J. van Ossenbruggen, L. Rutledge, D. C. A. Bulterman, "Hypermedia: the link with time", ACM Computing Surveys, Vol. 31, Number 4es, December 1999, pp. 1--5.

Digital Library

Google Scholar

[22]

M. Korkeaaho, "Context-Aware Applications Survey", Department of Computer Science, Helsinki University of Technology, April 2000, http://www.hut.fi/Eckorkeaa/doc/context-aware.html.

Google Scholar

[23]

S. Long, K. Kooper, G. D. Abowd, C. G. Atkeson, "Rapid Prototyping of Mobile Context-Aware Applications: The Cyberguide Case Study", In Proceedings of the 2nd ACM International Conference on Mobile Computing and Networking, pp. 97--107, 1996.

Digital Library

Google Scholar

[24]

N. Meyrowitz, "Intermedia: The Architecture and Consauction of an Object-Oriented Hyper-media System and Applications Framework", OOPSLA '86 Proceedings, Portland, Oregon.

Digital Library

Google Scholar

[25]

E. Not, D. Petrelli, M. Sarini, O. Stock, C. Strapparava, and M. Zancanaro, "Hypernavigation in the physical space: Adapting presentations to the user and to the situational context", The New Review of Hypermedia and Multimedia, 4:33--45, 1998.

Crossref

Google Scholar

[26]

T. Romão, N. Correia, C. Santos, et al, "Augmenting Reality with Geo-Referenced Information for Environmental Management", ACM GIS Conference, McLean, VA, USA, 2002.

Digital Library

Google Scholar

[27]

N. Sawhney, D. Balcom, and I. Smith, "HyperCafe: Narrative and Aesthetic Properties of Hypervideo", Proc. Hypertext 96, ACM, 1996, pp. 1--10.

Digital Library

Google Scholar

[28]

D. Schwabe, G. Rossi, "The Object-Oriented Hypermedia Design Model", Communications of the ACM, Vol. 38, nr. 8, pp. 45--46, 1995.

Digital Library

Google Scholar

[29]

A. Steed, I. MacColl, C. Randell, B. Brown, and others, "The Use of Spacial Models in Mixed-Reality Systems (Draft)", Technical Report Equator-02-040, UCL, Glasgow, October 2002.

Google Scholar

[30]

H. Tamura, H. Yamamoto, and A. Katayama, "Mixed Reality: Future Dreams Seen at the Border between Real and Virtual Worlds", IEEE Computer Graphics and Applications, November/December 2001, pp. 64--70.

Digital Library

Google Scholar

[31]

H. Tarumi, K. Morishita, Y. Ito, Y. Kambayashi, "Communication through Virtual Active Objects Overlaid onto the Real World", Collaborative Virtual Environments 2000 pp. 155--164.

Digital Library

Google Scholar

[32]

B. H. Thomas, B. Close, J. Donoghue, J. Squires, P. De Bondi, and W. Piekarski, "ARQuake: A First Person Indoor/Outdoor Augmented Reality Application", Journal of Personal and Ubiquitous Computing.

Digital Library

Google Scholar

[33]

Polle T. ZelIweger, "Scripted Documents: A Hypermedia Path Mechanism", ACM Hypertext 98, pp. 2--14.

Digital Library

Google Scholar

[34]

Polle T. Zellweger, Bay- Wei Chang, Jock D. Mackinlay, "Fluid Links for Informed and Incremental Link Transitions", ACM Hypertext 98, pp. 50--57.

Digital Library

Google Scholar

Cited By

View all

Millard DHargood C(2023)NHT'23Proceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3610577(1-2)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3610577
Ataguba G(2018)Exploring post-mortem storytelling applicationsProceedings of the 32nd International BCS Human Computer Interaction Conference10.14236/ewic/HCI2018.197(1-7)Online publication date: 4-Jul-2018
https://dl.acm.org/doi/10.14236/ewic/HCI2018.197
Thomas B(2012)A survey of visual, mixed, and augmented reality gamingComputers in Entertainment10.1145/2381876.238187910:1(1-33)Online publication date: 6-Dec-2012
https://dl.acm.org/doi/10.1145/2381876.2381879
Show More Cited By

Recommendations

Contextual information access and storytelling in mixed reality using hypermedia
Theoretical and Practical Computer Applications in Entertainment

This article describes gaming and storytelling activities in a mixed environment that integrates the real and virtual worlds, uses an augmented reality paradigm, and is supported by a structuring and presentation framework for use in context-aware mixed-...
Natural embedding of live actors and entities into 360° virtual reality scenes
Abstract
This paper is concerned with techniques for directly embedding moving objects in the real world into 360° virtual reality scenes captured by 360° camera, DSLR camera, smartphone, and others. For more natural embedding, we present a cylindrical ...
A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues

We present the design and implementation of an optical see-through head-mounted display (HMD) with addressable focus cues utilizing a liquid lens. We implemented a monocular bench prototype capable of addressing the focal distance of the display from ...

Reviews

Reviewer: Joao Orvalho

Question answering (Q/A) is the discipline concerned with building software systems that respond to natural language questions asked by a user, by extracting the answers from a corpus of unstructured texts. Interactions may include simple requests for facts ("Who was Johnny Mathis' track coach__?__"), requests for definitions ("What is bipolar disorder__?__"), and others. In the last five years, research in Q/A has been boosted by the Text Retrieval Conference (TREC) Q/A track, a comparative evaluation campaign carried out by the US National Institute of Standards and Technology (NIST), where the Q/A efforts of participating research groups, tested on a NIST benchmark of questions and texts, are subject to evaluation by NIST assessors. The TREC evaluation addresses whole Q/A systems only. Since these are usually very complex systems consisting of a variety of modules, each of which addresses a complex task (question type classification, candidate document retrieval, candidate answer extraction, answer selection, and so on), the contribution of each individual module to the performance of the system is not assessed in such evaluations. The aim of this paper is to look more deeply into the components of Q/A systems, and to assess the role and contribution of some widespread techniques that individually address some of the Q/A problems mentioned above. By adopting an experimental approach that is independent of particular Q/A systems, the authors reach several interesting conclusions: that the performance of a Q/A system is directly related to the level of redundancy of the text corpus (namely, the more instances of the correct answer that are present in the corpus, the higher the chance that the system will answer correctly); that the candidate answers that have a higher degree of word-by-word overlap with the question are more likely to contain a correct answer; and that there are severe upper bounds on the performance obtainable by selecting candidate answers through word-by-word overlap. The paper is methodologically sound, and its conclusions are valuable, even more so in light of the fact that component-wise analysis of Q/A systems is rare. The insights gained from this study may be helpful in improving the performance of a Q/A system, and in singling out the possible causes of its successes or failures. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

HYPERTEXT '03: Proceedings of the fourteenth ACM conference on Hypertext and hypermedia

August 2003

232 pages

ISBN:1581137044

DOI:10.1145/900051

General Chairs:
Helen Ashman
University of Nottingham, UK
,
Tim Brailsford
University of Nottingham, UK
,
Program Chairs:
Les Carr
University of Southampton, UK
,
Lynda Hardman
CWI & Technical University of Eindhoven, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 August 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

HT03

Sponsor:

HT03: The Fourteenth ACM Conference on Hypertext and Hypermedia

August 26 - 30, 2003

Nottingham, UK

Acceptance Rates

HYPERTEXT '03 Paper Acceptance Rate 36 of 136 submissions, 26%;

Overall Acceptance Rate 378 of 1,158 submissions, 33%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
1,616
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Millard DHargood C(2023)NHT'23Proceedings of the 34th ACM Conference on Hypertext and Social Media10.1145/3603163.3610577(1-2)Online publication date: 4-Sep-2023
https://dl.acm.org/doi/10.1145/3603163.3610577
Ataguba G(2018)Exploring post-mortem storytelling applicationsProceedings of the 32nd International BCS Human Computer Interaction Conference10.14236/ewic/HCI2018.197(1-7)Online publication date: 4-Jul-2018
https://dl.acm.org/doi/10.14236/ewic/HCI2018.197
Thomas B(2012)A survey of visual, mixed, and augmented reality gamingComputers in Entertainment10.1145/2381876.238187910:1(1-33)Online publication date: 6-Dec-2012
https://dl.acm.org/doi/10.1145/2381876.2381879
Signer BNorrie M(2011)A model and architecture for open cross-media annotation and link servicesInformation Systems10.1016/j.is.2010.08.00236:3(538-550)Online publication date: 1-May-2011
https://dl.acm.org/doi/10.1016/j.is.2010.08.002
van Doorn Mvan Loenen Ede Vries ALiang BWhitaker R(2008)Deconstructing ambient intelligence into ambient narrativesProceedings of the 1st international conference on Ambient media and systems10.5555/1363163.1363171(1-8)Online publication date: 11-Feb-2008
https://dl.acm.org/doi/10.5555/1363163.1363171
Signer BNorrie M(2007)As we may linkProceedings of the 26th international conference on Conceptual modeling10.5555/1784489.1784522(359-374)Online publication date: 5-Nov-2007
https://dl.acm.org/doi/10.5555/1784489.1784522
Schwieren JVossen G(2007)Implementing Physical Hyperlinks for Mobile Applications Using RFID Tags11th International Database Engineering and Applications Symposium (IDEAS 2007)10.1109/IDEAS.2007.4318100(154-162)Online publication date: Sep-2007
https://doi.org/10.1109/IDEAS.2007.4318100
Franceschet MMontanari AGubiani D(2007)Modeling and Validating Spatio-Temporal Conceptual Schemas in XML SchemaProceedings of the 18th International Conference on Database and Expert Systems Applications10.1109/DEXA.2007.105(25-29)Online publication date: 3-Sep-2007
https://dl.acm.org/doi/10.1109/DEXA.2007.105
Challiol CRossi GGordillo SDe CristÓfolo V(2007)Systematic Development of Physical Hypermedia ApplicationsInternational Journal of Web Information Systems10.1108/174400807800003032:3/4(232-246)Online publication date: 27-Sep-2007
https://doi.org/10.1108/17440080780000303
Signer BNorrie M(2007)As We May Link: A General Metamodel for Hypermedia SystemsConceptual Modeling - ER 200710.1007/978-3-540-75563-0_25(359-374)Online publication date: 2007
https://doi.org/10.1007/978-3-540-75563-0_25
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Contextual information access and storytelling in mixed reality using hypermedia

Natural embedding of live actors and entities into 360° virtual reality scenes

A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues

Reviews

Access critical reviews of Computing literature here