research-article

What is Mixed Reality?

Authors:

Maximilian Speicher,

Michael NebelingAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 537, Pages 1 - 15

https://doi.org/10.1145/3290605.3300767

Published: 02 May 2019 Publication History

Abstract

What is Mixed Reality (MR)? To revisit this question given the many recent developments, we conducted interviews with ten AR/VR experts from academia and industry, as well as a literature survey of 68 papers. We find that, while there are prominent examples, there is no universally agreed on, one-size-fits-all definition of MR. Rather, we identified six partially competing notions from the literature and experts' responses. We then started to isolate the different aspects of reality relevant for MR experiences, going beyond the primarily visual notions and extending to audio, motion, haptics, taste, and smell. We distill our findings into a conceptual framework with seven dimensions to characterize MR applications in terms of the number of environments, number of users, level of immersion, level of virtuality, degree of interaction, input, and output. Our goal with this paper is to support classification and discussion of MR applications' design and provide a better means to researchers to contextualize their work within the increasingly fragmented MR landscape.

Supplementary Material

MP4 File (paper537.mp4)

Download
245.52 MB

References

[1]

M. Al-Kalbani, I. Williams, and M. Frutos-Pascual. 2016. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 84--93.

[2]

Sasha Barab and Kurt Squire. 2004. Design-based research: Putting a stake in the ground. The journal of the learning sciences 13, 1 (2004), 1--14.

[3]

E. Barba and R. Z. Marroquin. 2017. A Primer on Spatial Scale and Its Application to Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 100--110.

[4]

Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju RowFarr. 2006. Can You See Me Now? ACM Trans. Comput.-Hum. Interact. 13, 1 (March 2006), 100--133.

Digital Library

[5]

Steve Benford and Gabriella Giannachi. 2011. Performing Mixed Reality. The MIT Press.

Digital Library

[6]

Steve Benford, Chris Greenhalgh, Gail Reynard, Chris Brown, and Boriana Koleva. 1998. Understanding and Constructing Shared Spaces with Mixed-reality Boundaries. ACM Trans. Comput.-Hum. Interact. 5, 3 (Sept. 1998), 185--223.

Digital Library

[7]

Mark Billinghurst. 2017. What is Mixed Reality? https://medium.com/@marknb00/what-is-mixed-reality-60e5cc284330.

[8]

Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Foundations and Trends® in Human--Computer Interaction 8, 2--3 (2015), 73--272.

[9]

Mark Billinghurst and Hirokazu Kato. 1999. Collaborative mixed reality. In Proceedings of the First International Symposium on Mixed Reality. 261--284.

[10]

Elizabeth M. Bonsignore, Derek L. Hansen, Zachary O. Toups, Lennart E. Nacke, Anastasia Salter, and Wayne Lutters. 2012. Mixed Reality Games. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion (CSCW '12). ACM, New York, NY, USA, 7--8.

Digital Library

[11]

Brandon Bray and Matt Zeller. 2018. What is mixed reality? https://docs.microsoft.com/en-us/windows/mixed-reality/mixed-reality.

[12]

J. P. Cater. 1994. Smell/taste: odors in reality. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, Vol. 2.

[13]

Anil Çamc?, Kristine Lee, Cody J. Roberts, and Angus G. Forbes. 2017. INVISO: A Cross-platform User Interface for Creating Virtual Sonic Environments. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 507--518.

Digital Library

[14]

J. C. P. Chan, H. Leung, J. K. T. Tang, and T. Komura. 2011. A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies 4, 2 (April 2011), 187--195.

Digital Library

[15]

L. Chen, T. W. Day, W. Tang, and N. W. John. 2017. Recent Developments and Future Challenges in Medical Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 123--135.

[16]

A. Dey, M. Billinghurst, R. W. Lindeman, and J. E. Swan II. 2017. A Systematic Review of Usability Studies in Augmented Reality between 2005 and 2014. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)(ISMARW), Vol. 00. 49--50.

[17]

Alan Dix, Adrian Friday, Boriana Koleva, Tom Rodden, Henk Muller, Cliff Randell, and Anthony Steed. 2005. Multiple spaces. In Spaces, Spatiality and Technology. Springer, 151--172.

[18]

Daniel Dobler, Michael Haller, and Philipp Stampfl. 2002. ASR: Augmented Sound Reality. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (SIGGRAPH '02). ACM, New York, NY, USA, 148--148.

Digital Library

[19]

Clarence A Ellis, Simon J Gibbs, and Gail Rein. 1991. Groupware: some issues and experiences. Commun. ACM 34, 1 (1991), 39--58.

Digital Library

[20]

Steven K. Feiner. 2002. Augmented Reality: a New Way of Seeing. Scientific American 286, 4 (2002), 48--55. http://www.jstor.org/stable/

[21]

Maribeth Gandy and Blair MacIntyre. 2014. Designer's Augmented Reality Toolkit, Ten Years Later: Implications for New Media Authoring Tools. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 627--636.

Digital Library

[22]

Çalar Genç, Shoaib Soomro, Yalçn Duyan, Selim Ölçer, Fuat Balc, Hakan Ürey, and Oguzhan Özcan. 2016. Head Mounted Projection Display & Visual Attention: Visual Attentional Processing of Head Referenced Static and Dynamic Displays While in Motion and Standing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1538--1547.

Digital Library

[23]

Perttu Hämäläinen, Joe Marshall, Raine Kajastila, Richard Byrne, and Florian "Floyd" Mueller. 2015. Utilizing Gravity in Movement-Based Games and Play. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 67--77.

Digital Library

[24]

Vinzenz Hediger and Alexandra Schneider. 2005. The Deferral of Smell: Cinema, Modernity and the Reconfiguration of the Olfactory Experience. In I cinque sensi del cinema/The Five Senses of Cinema, eds. Alice Autelitano, Veronica Innocenti, Valentina Re (Udine: Forum, 2005). 243--252.

[25]

Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3D Interactions with a Situated Seethrough Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2421--2430.

Digital Library

[26]

G. Hough, I. Williams, and C. Athwal. 2014. Measurements of live actor motion in mixed reality interaction. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 99--104.

[27]

Intel. 2018. Demystifying the Virtual Reality Landscape. https://www.intel.com/content/www/us/en/tech-tips-and-tricks/ virtual-reality-vs-augmented-reality.html.

[28]

Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2016. SkyAnchor: Optical Design for Anchoring Mid-air Images Onto Physical Objects. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 415--423.

Digital Library

[29]

M. Kersten-Oertel, P. Jannin, and D. L. Collins. 2012. DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery. IEEE Transactions on Visualization and Computer Graphics 18, 2 (Feb 2012), 332--352.

Digital Library

[30]

Boriana Koleva, Steve Benford, and Chris Greenhalgh. 1999. The Properties of Mixed Reality Boundaries. Springer Netherlands, Dordrecht, 119--137.

[31]

Martijn J.L. Kors, Gabriele Ferri, Erik D. van der Spek, Cas Ketel, and Ben A.M. Schouten. 2016. A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 91--104.

Digital Library

[32]

A. Lassagne, A. Kemeny, J. Posselt, and F. Merienne. 2018. Performance Evaluation of Passive Haptic Feedback for Tactile HMI Design in CAVEs. IEEE Transactions on Haptics 11, 1 (Jan 2018), 119--127.

[33]

C. Lee, G. A. Rincon, G. Meyer, T. Höllerer, and D. A. Bowman. 2013. The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation. IEEE Transactions on Visualization and Computer Graphics 19, 4 (April 2013), 547--556.

Digital Library

[34]

@LenaRogl. 2017. Was die Hololens macht ist übrigens weder #AR noch #VR, sondern #MixedReality :) {By the way, what HoloLens does is neither #AR nor #VR, but #MixedReality :)}. Tweet. Retrieved May 28, 2018 from https://twitter.com/LenaRogl/status/869851941966290945.

[35]

David Lindlbauer and Andy D. Wilson. 2018. Remixed Reality: Manipulating Space and Time in Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 129, 13 pages.

Digital Library

[36]

Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games Using Electrical Muscle Stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 446, 13 pages.

Digital Library

[37]

Laura Lotti. 2013. Through the Augmenting-Glass: The Rhetorics of Augmented Reality Between Code and Interface. Itineration: CrossDisciplinary Studies in Rhetoric, Media, and Culture (March 2013).

[38]

Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). ACM, New York, NY, USA, 197--206.

Digital Library

[39]

Laura Malinverni, Julian Maya, Marie-Monique Schaper, and Narcis Pares. 2017. The World-as-Support: Embodied Exploration, Understanding and Meaning-Making of the Augmented World. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5132--5144.

Digital Library

[40]

D. Mandl, K. M. Yi, P. Mohr, P. M. Roth, P. Fua, V. Lepetit, D. Schmalstieg, and D. Kalkofen. 2017. Learning Lightprobes for Mixed Reality Illumination. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 82--89.

[41]

Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5655--5668.

Digital Library

[42]

David McGookin, Koray Tahirolu, Tuomas Vaittinen, Mikko Kytö, Beatrice Monastero, and Juan Carlos Vasquez. 2017. Exploring Seasonality in Mobile Cultural Heritage. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6101--6105.

Digital Library

[43]

Paul Milgram and Herman Colquhoun Jr. 1999. A Taxonomy of Real and Virtual World Display Integration.

[44]

Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Trans. Information and Systems 77, 12 (1994), 1321--1329.

[45]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and telepresence technologies, Vol. 2351. 282--293.

[46]

Takashi Miyaki and Jun Rekimoto. 2016. LiDARMAN: Reprogramming Reality with Egocentric Laser Depth Scanning. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH '16). ACM, New York, NY, USA, Article 15, 2 pages.

Digital Library

[47]

Thomas B. Moeslund and Erik Granum. 2001. A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding 81, 3 (2001), 231 -- 268.

Digital Library

[48]

C. Morales, T. Oishi, and K. Ikeuchi. 2014. {Poster} Turbidity-based aerial perspective rendering for mixed reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 283--284.

[49]

Jens Müller, Roman Rädle, and Harald Reiterer. 2016. Virtual Objects As Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1245--1249.

Digital Library

[50]

Jens Müller, Roman Rädle, and Harald Reiterer. 2017. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6481--6486.

Digital Library

[51]

Elizabeth D. Mynatt, Maribeth Back, Roy Want, and Ron Frederick. 1997. Audio Aura: Light-weight Audio Augmented Reality. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97). ACM, New York, NY, USA, 211--212.

Digital Library

[52]

Arinobu Niijima and Takefumi Ogawa. 2016. Study on Control Method of Virtual Food Texture by Electrical Muscle Stimulation. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 199--200.

Digital Library

[53]

M. Ohta, S. Nagano, H. Niwa, and K. Yamashita. 2015. {POSTER} MixedReality Store on the Other Side of a Tablet. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 192--193.

Digital Library

[54]

Leif Oppermann, Clemens Putschli, Constantin Brosda, Oleksandr Lobunets, and Fabien Prioville. 2015. The Smartphone Project: An Augmented Dance Performance. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2569--2572.

Digital Library

[55]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 741--754.

Digital Library

[56]

Clément Pillias, Raphaël Robert-Bouchard, and Guillaume Levieux. 2014. Designing Tangible Video Games: Lessons Learned from the Sifteo Cubes. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3163--3166.

Digital Library

[57]

Thammathip Piumsomboon, Arindam Day, Barrett Ens, Youngho Lee, Gun Lee, and Mark Billinghurst. 2017. Exploring Enhancements for Remote Mixed Reality Collaboration. In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA '17). ACM, New York, NY, USA, Article 16, 5 pages.

Digital Library

[58]

Thammathip Piumsomboon, Gun A. Lee, Jonathon D. Hart, Barrett Ens, Robert W. Lindeman, Bruce H. Thomas, and Mark Billinghurst. 2018. Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 46, 13 pages.

Digital Library

[59]

Belma Ramic-Brkic and Alan Chalmers. 2010. Virtual Smell: Authentic Smell Diffusion in Virtual Environments. In Proceedings of the 7th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (AFRIGRAPH '10). ACM, New York, NY, USA, 45--52.

Digital Library

[60]

Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Virtual Sweet: Simulating Sweet Sensation Using Thermal Stimulation on the Tip of the Tongue. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 127--128.

Digital Library

[61]

Stuart Reeves, Christian Greiffenhagen, Martin Flintham, Steve Benford, Matt Adams, Ju Row Farr, and Nicholas Tandavantij. 2015. I'D Hide You: Performing Live Broadcasting in Public. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2573--2582.

Digital Library

[62]

H. Regenbrecht, K. Meng, A. Reepen, S. Beck, and T. Langlotz. 2017. Mixed Voxel Reality: Presence and Embodiment in Low Fidelity, Visually Coherent, Mixed Reality Environments. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 90--99.

[63]

Derek Reilly, Andy Echenique, Andy Wu, Anthony Tang, and W. Keith Edwards. 2015. Mapping out Work in a Mixed Reality Project Room. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 887--896.

Digital Library

[64]

T. Richter-Trummer, D. Kalkofen, J. Park, and D. Schmalstieg. 2016. Instant Mixed Reality Lighting from Casual Scanning. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 27--36.

[65]

Yvonne Rogers, Mike Scaife, Silvia Gabrielli, Hilary Smith, and Eric Harris. 2002. A Conceptual Framework for Mixed Reality Environments: Designing Novel Learning Activities for Young Children. Presence: Teleoperators and Virtual Environments 11, 6 (2002), 677--686.

Digital Library

[66]

K. Rohmer, W. Büschel, R. Dachselt, and T. Grosch. 2014. Interactive near-field illumination for photorealistic augmented reality on mobile devices. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 29--38.

[67]

C. Rolim, D. Schmalstieg, D. Kalkofen, and V. Teichrieb. 2015. {POSTER} Design Guidelines for Generating Augmented Reality Instructions. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 120--123.

Digital Library

[68]

Joan Sol Roo, Jean Basset, Pierre-Antoine Cinquin, and Martin Hachet. 2018. Understanding Users' Capability to Transfer Information Between Mixed and Virtual Reality: Position Estimation Across Modalities and Perspectives. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 363, 12 pages.

Digital Library

[69]

Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner Garden: Connecting Inner States to a Mixed Reality Sandbox for Mindfulness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1459--1470.

Digital Library

[70]

Joan Sol Roo and Martin Hachet. 2017. One Reality: Augmenting How the Physical World is Experienced by Combining Multiple Mixed Reality Modalities. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 787--795.

Digital Library

[71]

J. K. Salisbury and M. A. Srinivasan. 1997. Phantom-based haptic interaction with virtual objects. IEEE Computer Graphics and Applications 17, 5 (Sept 1997), 6--10.

Digital Library

[72]

T. Schwandt and W. Broll. 2016. A Single Camera Image Based Approach for Glossy Reflections in Mixed Reality Applications. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 37--43.

[73]

Hitesh Nidhi Sharma, Sultan A. Alharthi, Igor Dolgov, and Zachary O. Toups. 2017. A Framework Supporting Selecting Space to Make Place in Spatial Mixed Reality Play. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17). ACM, New York, NY, USA, 83--100.

Digital Library

[74]

Hitesh Nidhi Sharma, Zachary O. Toups, Igor Dolgov, Andruid Kerne, and Ajit Jain. 2016. Evaluating Display Modalities Using a Mixed Reality Game. In Proceedings of the 2016 Annual Symposium on ComputerHuman Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 65--77.

Digital Library

[75]

Hitesh Nidhi Sharma, Zachary O. Toups, Ajit Jain, and Andruid Kerne. 2015. Designing to Split Attention in a Mixed Reality Game. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 691--696.

Digital Library

[76]

Maximilian Speicher, Brian D. Hall, Ao Yu, Bowen Zhang, Haihua Zhang, Janet Nebeling, and Michael Nebeling. 2018. XD-AR: Challenges and Opportunities in Cross-Device Augmented Reality Application Development. Proc. ACM Hum.-Comput. Interact. 2, EICS, Article 7 (June 2018), 24 pages.

Digital Library

[77]

D. Stanton, C. O'Malley, K. Huing, M. Fraser, and S. Benford. 2003. Situating Historical Events Through Mixed Reality. Springer Netherlands, Dordrecht, 293--302.

[78]

Ivan E. Sutherland. 1965. The Ultimate Display. In Proceedings of the IFIP Congress. 506--508.

[79]

F. Tecchia, G. Avveduto, M. Carrozzino, R. Brondi, M. Bergamasco, and L. Alem. 2014. {Poster} Interacting with your own hands in a fully immersive MR system. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 313--314.

[80]

P. Tiefenbacher, A. Pflaum, and G. Rigoll. 2014. {Poster} Touch gestures for improved 3D object manipulation in mobile augmented reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 315--316.

[81]

Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39, 3.4 (2000), 915--931.

Digital Library

[82]

D. R. Walton, D. Thomas, A. Steed, and A. Sugimoto. 2017. Synthesis of Environment Maps for Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 72--81.

[83]

X. Wang, S. Habert, M. Ma, C. H. Huang, P. Fallavollita, and N. Navab. 2015. {POSTER} RGB-D/C-arm Calibration and Application in Medical Augmented Reality. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 100--103.

Digital Library

[84]

Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. 2014. MixFab: A Mixed-reality Environment for Personal Fabrication. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3855--3864.

Digital Library

[85]

Po-Chen Wu, Robert Wang, Kenrick Kin, Christopher Twigg, Shangchen Han, Ming-Hsuan Yang, and Shao-Yi Chien. 2017. DodecaPen: Accurate 6DoF Tracking of a Passive Stylus. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 365--374.

Digital Library

[86]

P. Yang, I. Kitahara, and Y. Ohta. 2015. {POSTER} Remote Mixed Reality System Supporting Interactions with Virtualized Objects. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 64--67.

Digital Library

[87]

Nesra Yannier, Kenneth R. Koedinger, and Scott E. Hudson. 2015. Learning from Mixed-Reality Games: Is Shaking a Tablet As Effective As Physical Observation?. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1045--1054.

Digital Library

[88]

Ya-Ting Yue, Yong-Liang Yang, Gang Ren, and Wenping Wang. 2017. SceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 427--436.

Digital Library

[89]

Ya-Ting Yue, Xiaolong Zhang, Yongliang Yang, Gang Ren, Yi-King Choi, and Wenping Wang. 2017. WireDraw: 3D Wire Sculpturing Guided with Mixed Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3693--3704.

Digital Library

[90]

Daniel Yule, Bonnie MacKay, and Derek Reilly. 2015. Operation Citadel: Exploring the Role of Docents in Mixed Reality. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 285--294.

Digital Library

[91]

Feng Zhou, Henry Been-Lirn Duh, and Mark Billinghurst. 2008. Trends in Augmented Reality Tracking, Interaction and Display: A Review of Ten Years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '08). IEEE Computer Society, Washington, DC, USA, 193--202.

Digital Library

Cited By

Baltezarević IBaltezarević R(2024)The role of mixed reality in the education sectorBastina10.5937/bastina34-48803(471-479)Online publication date: 2024
https://doi.org/10.5937/bastina34-48803
Anwar SSanober A(2024)MetaBlock: A Revolutionary System for Healthcare Industry Fusing Metaverse and BlockchainJournal of Metaverse10.57019/jmv.1513886Online publication date: 16-Oct-2024
https://doi.org/10.57019/jmv.1513886
Choudhury SDutta I(2024)Mapping Educators’ Knowledge, Perceptions, and Readiness (KPR) towards the Adoption of Extended Reality (XR) Technologies in the Classroom (KPR-XR): Scale Development and ValidationInternational Journal of Experimental Research and Review10.52756/ijerr.2024.v45spl.02545:Spl Vol(313-327)Online publication date: 30-Nov-2024
https://doi.org/10.52756/ijerr.2024.v45spl.025
Show More Cited By

Index Terms

What is Mixed Reality?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

The Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

A common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

395
Total Citations
View Citations
10,189
Total Downloads

Downloads (Last 12 months)2,446
Downloads (Last 6 weeks)351

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Baltezarević IBaltezarević R(2024)The role of mixed reality in the education sectorBastina10.5937/bastina34-48803(471-479)Online publication date: 2024
https://doi.org/10.5937/bastina34-48803
Anwar SSanober A(2024)MetaBlock: A Revolutionary System for Healthcare Industry Fusing Metaverse and BlockchainJournal of Metaverse10.57019/jmv.1513886Online publication date: 16-Oct-2024
https://doi.org/10.57019/jmv.1513886
Choudhury SDutta I(2024)Mapping Educators’ Knowledge, Perceptions, and Readiness (KPR) towards the Adoption of Extended Reality (XR) Technologies in the Classroom (KPR-XR): Scale Development and ValidationInternational Journal of Experimental Research and Review10.52756/ijerr.2024.v45spl.02545:Spl Vol(313-327)Online publication date: 30-Nov-2024
https://doi.org/10.52756/ijerr.2024.v45spl.025
Anwar RAzhar S(2024)Mixed Reality in Building Construction Inspection and Monitoring: A Systematic ReviewVirtual Worlds10.3390/virtualworlds30300173:3(319-332)Online publication date: 13-Aug-2024
https://doi.org/10.3390/virtualworlds3030017
Pinkl JVillegas JCohen M(2024)Multimodal Drumming Education Tool in Mixed RealityMultimodal Technologies and Interaction10.3390/mti80800708:8(70)Online publication date: 5-Aug-2024
https://doi.org/10.3390/mti8080070
Vrontos ANitsch VBrandl C(2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
https://doi.org/10.3390/mti8020007
Sin JKim A(2024)Mixed Reality in Clinical Settings for Pediatric Patients and Their Families: A Literature ReviewInternational Journal of Environmental Research and Public Health10.3390/ijerph2109118521:9(1185)Online publication date: 5-Sep-2024
https://doi.org/10.3390/ijerph21091185
In NWakamatsu RMiyakawa HKushima CChen XTomisawa T(2024)Development and Educational Effectiveness of a Mixed Reality (MR) Program to Support Clinical Judgment in the Observation of Postoperative PatientsHealthcare10.3390/healthcare1223235712:23(2357)Online publication date: 25-Nov-2024
https://doi.org/10.3390/healthcare12232357
Zhang JChen TGong WLiu JChen J(2024)Exploring Data Input Problems in Mixed Reality Environments: Proposal and Evaluation of Natural Interaction TechniquesFuture Internet10.3390/fi1605015016:5(150)Online publication date: 27-Apr-2024
https://doi.org/10.3390/fi16050150
Zhao XTao YBao YSun ZWu SLi WFan X(2024)Mixed Reality-Based Inspection Method for Underground Water Supply Network with Multi-Source Information IntegrationElectronics10.3390/electronics1322447913:22(4479)Online publication date: 14-Nov-2024
https://doi.org/10.3390/electronics13224479
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents