research-article

Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite Videos

Authors:

Daniel Medeiros,

Julie Williamson,

Katharina Pöhlmann,

Mark McGillAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 7, Issue 3

Article No.: 113, Pages 1 - 25

https://doi.org/10.1145/3610923

Published: 27 September 2023 Publication History

Abstract

Augmented Reality (AR) headsets could significantly improve the passenger experience, freeing users from the restrictions of physical smartphones, tablets and seatback displays. However, the confined space of public transport and the varying proximity to other passengers may restrict what interaction techniques are deemed socially acceptable for AR users - particularly considering current reliance on mid-air interactions in consumer headsets. We contribute and utilize a novel approach to social acceptability video surveys, employing mixed reality composited videos to present a real user performing interactions across different virtual transport environments. This approach allows for controlled evaluation of perceived social acceptability whilst freeing researchers to present interactions in any simulated context. Our resulting survey (N=131) explores the social comfort of body, device, and environment-based interactions across seven transit seating arrangements. We reflect on the advantages of discreet inputs over mid-air and the unique challenges of face-to-face seating for passenger AR.

Supplemental Material

ZIP File - medeiros

Supplemental movie, appendix, image and software files for, Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite Videos

Download
54.61 MB

References

[1]

2014. Inflight VR. https://inflight-vr.com

[2]

2021. Nreal Light -- Ready-to-wear Mixed Reality Glasses. https://www.nreal.ai/light/

[3]

David Ahlström, Khalad Hasan, and Pourang Irani. 2014. Are You Comfortable Doing That? Acceptance Studies of around-Device Gestures in and for Public Settings. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). https://doi.org/10/gjbvvs

Digital Library

[4]

Fouad Alallah, Ali Neshati, Yumiko Sakamoto, Khalad Hasan, Edward Lank, Andrea Bunt, and Pourang Irani. 2018. Performer vs. observer: whose comfort level should we consider when examining the social acceptability of input modalities for head-worn display?. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. 1--9.

Digital Library

[5]

Fouad Alallah, Ali Neshati, Nima Sheibani, Yumiko Sakamoto, Andrea Bunt, Pourang Irani, and Khalad Hasan. 2018. Crowdsourcing vs Laboratory-Style Social Acceptability Studies?: Examining the Social Acceptability of Spatial User Interactions for Head-Worn Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. https://doi.org/10/gmnqdh

Digital Library

[6]

Jason Alexander, Teng Han, William Judd, Pourang Irani, and Sriram Subramanian. 2012. Putting your best foot forward: investigating real-world mappings for foot-based gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1229--1238.

Digital Library

[7]

Rafael Kuffner dos Anjos, Maurício Sousa, Daniel Mendes, Daniel Medeiros, Mark Billinghurst, Craig Anslow, and Joaquim Jorge. 2019. Adventures in hologram space: exploring the design space of eye-to-eye volumetric telepresence. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology. 1--5.

Digital Library

[8]

Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf. 2015. Informing the design of novel input methods with muscle coactivation clustering. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 6 (2015), 1--25.

Digital Library

[9]

Laura Bajorunaite, Stephen Brewster, and Julie R. Williamson. 2021. Virtual Reality in Transit: How Acceptable Is VR Use on Public Transport?. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). https://doi.org/10/gmf8tr

[10]

Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using Lme4. Journal of Statistical Software (2015). https://doi.org/10.18637/jss.v067.i01

[11]

Doug A Bowman, Ryan P McMahan, and Eric D Ragan. 2012. Questioning naturalism in 3D user interfaces. Commun. ACM 55, 9 (2012), 78--88.

Digital Library

[12]

Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 255--260.

Digital Library

[13]

David M Cook, Derani Dissanayake, and Kulwinder Kaur. 2019. Virtual Reality and Older Hands: Dexterity and accessibility in hand-held VR Control. In Proceedings of the 5th International ACM In-Cooperation HCI and UX Conference. 147--151.

Digital Library

[14]

Andrew Crossan, Stephen Brewster, and Alexander Ng. 2010. Foot tapping for mobile interaction. Proceedings of HCI 2010 24 (2010), 418--422.

[15]

Sebastian Deterding, Andrés Lucero, Jussi Holopainen, Chulhong Min, Adrian Cheok, Annika Waern, and Steffen Walz. 2015. Embarrassing Interactions. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). https://doi.org/10/f3nc8z

[16]

Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. PalmRC: imaginary palm-based remote control for eyes-free television interaction. In Proceedings of the 10th European conference on Interactive tv and video. 27--34.

Digital Library

[17]

David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2017. PocketThumb: A wearable dual-sided touch interface for cursor-based control of smart-eyewear. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1--17.

Digital Library

[18]

Lucy E. Dunne, Halley Profita, Clint Zeagler, James Clawson, Scott Gilliland, Ellen Yi-Luen Do, and Jim Budd. 2014. The Social Comfort of Wearable Technology and Gestural Interaction. In 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. https://doi.org/10/gmqktb

[19]

Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining ring input with hand tracking for precise, natural interaction with spatial analytic interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction. 99--102.

Digital Library

[20]

Gary W. Evans and Richard E. Wener. 2007. Crowding and Personal Space Invasion on the Train: Please Don't Make Me Sit in the Middle. Journal of Environmental Psychology 1 (2007). https://doi.org/10/fkhbb8

[21]

Fredrick P Garcia and Kim-Phuong L Vu. 2011. Effectiveness of hand-and foot-operated secondary input devices for word-processing tasks before and after training. Computers in Human Behavior 27, 1 (2011), 285--295.

Digital Library

[22]

Travis Gesslein, Verena Biener, Philipp Gagel, Daniel Schneider, Per Ola Kristensson, Eyal Ofek, Michel Pahud, and Jens Grubert. 2020. Pen-based interaction with spreadsheets in mobile virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 361--373.

[23]

Tovi Grossman, Xiang Anthony Chen, and George Fitzmaurice. 2015. Typing on glasses: Adapting text entry to smart eyewear. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 144--152.

Digital Library

[24]

Jan Gugenheimer. 2016. Nomadic Virtual Reality: Exploring New Interaction Concepts for Mobile Virtual Reality Head-Mounted Displays. (2016).

[25]

Jan Gugenheimer, Christian Mai, Mark McGill, Julie Williamson, Frank Steinicke, and Ken Perlin. 2019. Challenges Using Head-Mounted Displays in Shared and Social Spaces. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (2019). https://doi.org/10/ghwfrq

[26]

Sean Gustafson, Christian Holz, and Patrick Baudisch. 2011. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 283--292. https://doi.org/10.1145/2047196.2047233

Digital Library

[27]

Aaron Gutiérrez, Daniel Miravet, and Antoni Domènech. 2020. COVID-19 and Urban Public Transport Services: Emerging Challenges and Research Agenda. Cities & Health 0 (2020). https://doi.org/10/ghpwqj

[28]

Jonas Haeling, Christian Winkler, Stephan Leenders, Daniel Keßelheim, Axel Hildebrand, and Marc Necker. 2018. In-Car 6-DoF Mixed Reality for Rear-Seat and Co-Driver Entertainment. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). https://doi.org/10.1109/VR.2018.8446461

[29]

Jooyeun Ham, Jonggi Hong, Youngkyoon Jang, Seung Hwan Ko, and Woontack Woo. 2014. Smart wristband: Touch-and-motion--tracking wearable 3D input device for smart glasses. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 109--118.

[30]

Chris Harrison, Hrvoje Benko, and Andrew D Wilson. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 441--450.

Digital Library

[31]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1063--1072.

Digital Library

[32]

Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling in-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. https://doi.org/10/gj3dr2

Digital Library

[33]

Errol R Hoffmann. 1991. A comparison of hand and foot movement times. Ergonomics 34, 4 (1991), 397--406.

[34]

Paul Holleis, Albrecht Schmidt, Susanna Paasovaara, Arto Puikkonen, and Jonna Häkkilä. 2008. Evaluating capacitive touch input on clothes. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. 81--90.

Digital Library

[35]

Christian P. Janssen, Andrew L. Kun, Stephen Brewster, Linda Ng Boyle, Duncan P. Brumby, and Lewis L. Chuang. 2019. Exploring the Concept of the (Future) Mobile Office. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (AutomotiveUI '19). https://doi.org/10.1145/3349263.3349600

Digital Library

[36]

Erik Jenelius and Matej Cebecauer. 2020. Impacts of COVID-19 on Public Transport Ridership in Sweden: Analysis of Ticket Validations, Sales and Passenger Counts. Transportation Research Interdisciplinary Perspectives (2020). https://doi.org/10/gh7gck

[37]

Mahdokht Kalantari and Philipp Rauschnabel. 2018. Exploring the early adopters of augmented reality smart glasses: The case of Microsoft HoloLens. In Augmented reality and virtual reality. Springer, 229--245.

[38]

Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1313--1322.

Digital Library

[39]

Norene Kelly and Stephen B Gilbert. 2018. The wearer, the device, and its use: Advances in understanding the social acceptability of wearables. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications Sage CA: Los Angeles, CA, 1027--1031.

[40]

Marion Koelle. 2023. What Makes Wearable Technologies Socially Acceptable? XRDS: Crossroads, The ACM Magazine for Students 2 (2023). https://doi.org/10.1145/3571299

Digital Library

[41]

Marion Koelle, Swamy Ananthanarayan, and Susanne Boll. 2020. Social Acceptability in HCI: A Survey of Methods, Measures, and Design Strategies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10/gh3xj9

Digital Library

[42]

Luv Kohli and Mary Whitton. 2005. The haptic hand: providing user interface feedback with the non-dominant hand in virtual environments. In Proceedings of Graphics Interface 2005. 1--8.

[43]

Joseph J LaViola Jr, Ernst Kruijff, Ryan P McMahan, Doug Bowman, and Ivan P Poupyrev. 2017. 3D user interfaces: theory and practice. Addison-Wesley Professional.

Digital Library

[44]

DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing socially acceptable hand-to-face input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 711--723.

Digital Library

[45]

Lik-Hang Lee and Pan Hui. 2018. Interaction methods for smart glasses: A survey. IEEE access 6 (2018), 28712--28732.

[46]

Laura Lewis, Harshada Patel, Mirabelle D'Cruz, and Sue Cobb. 2017. What Makes a Space Invader? Passenger Perceptions of Personal Space Invasion in Aircraft Travel. Ergonomics 11 (2017). https://doi.org/10/gj3dwc

[47]

Jingyi Li, Ceenu George, Andrea Ngao, Kai Holländer, Stefan Mayer, and Andreas Butz. 2021. Rear-Seat Productivity in Virtual Reality: Investigating VR Interaction in the Confined Space of a Car. Multimodal Technologies and Interaction 4 (2021). https://doi.org/10/gj3dh7

[48]

Jingyi Li, Yong Ma, Puzhen Li, and Andreas Butz. 2021. A Journey Through Nature: Exploring Virtual Restorative Environments as a Means to Relax in Confined Spaces. In Creativity and Cognition (C&C '21). https://doi.org/10.1145/3450741.3465248

Digital Library

[49]

Jingyi Li, Luca Woik, and Andreas Butz. 2022. Designing Mobile MR Workspaces: Effects of Reality Degree and Spatial Configuration During Passenger Productivity in HMDs. Proceedings of the ACM on Human-Computer Interaction MHCI (2022). https://doi.org/10. 1145/3546716

Digital Library

[50]

Jiandong Liang and Mark Green. 1994. JDCAD: A highly interactive 3D modeling system. Computers & graphics 18, 4 (1994), 499--506.

[51]

Daniel Lopes, Filipe Relvas, Soraia Paulo, Yosra Rekik, Laurent Grisoni, and Joaquim Jorge. 2019. FEETICHE: FEET Input for Contactless Hand GEsture Interaction. In The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry (Brisbane, QLD, Australia) (VRCAI '19). Association for Computing Machinery, New York, NY, USA, Article 29, 10 pages. https://doi.org/10.1145/3359997.3365704

Digital Library

[52]

Julie Lorah. 2018. Effect Size Measures for Multilevel Models: Definition, Interpretation, and TIMSS Example. Large-scale Assessments in Education 1 (2018). https://doi.org/10.1186/s40536-018-0061-2

[53]

Katsutoshi Masai, Yuta Sugiura, and Maki Sugimoto. 2018. Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. In Proceedings of the 9th Augmented Human International Conference. 1--5.

Digital Library

[54]

Florian Mathis, Xuesong Zhang, Joseph O'Hagan, Daniel Medeiros, Pejman Saeghe, Mark McGill, Stephen Brewster, and Mohamed Khamis. 2021. Remote XR Studies: The Golden Future of HCI Research?. In Proceedings of the CHI 2021 Workshop on XR Remote Research. http://www.mat.qmul.ac.uk/xr-chi-2021.

[55]

Mark Mcgill, Aidan Kehoe, Euan Freeman, and Stephen Brewster. 2020. Expanding the Bounds of Seated Virtual Workspaces. ACM Transactions on Computer-Human Interaction 3 (2020). https://doi.org/10/ghwfhx

[56]

Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. Association for Computing Machinery, New York, NY, USA, 5655--5668. https://doi.org/10.1145/3025453.3026046

Digital Library

[57]

Mark McGill, Julie Williamson, Alexander Ng, Frank Pollick, and Stephen Brewster. 2019. Challenges in passenger use of mixed reality headsets in cars and other transportation. Virtual Reality (2019), 1--21.

Digital Library

[58]

Mark McGill, Graham Wilson, Daniel Medeiros, and Stephen Brewster. 2022. PassengXR: A Low Cost Platform for Any-Car, Multi-User, Motion-Based Passenger XR Experiences. In To Appear In: ACM Symposium on User Interface Software and Technology (UIST 2022). https://eprints.gla.ac.uk/277035/

[59]

Ryan P McMahan, Doug A Bowman, David J Zielinski, and Rachael B Brady. 2012. Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE transactions on visualization and computer graphics 18, 4 (2012), 626--633.

Digital Library

[60]

Daniel Medeiros, Rafael dos Anjos, Nadia Pantidi, Kun Huang, Maurício Sousa, Craig Anslow, and Joaquim Jorge. 2021. Promoting Reality Awareness in Virtual Reality through Proxemics. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 21--30. https://doi.org/10.1109/VR50410.2021.00022

[61]

Daniel Medeiros, Rafael K. dos Anjos, Daniel Mendes, João Madeiras Pereira, Alberto Raposo, and Joaquim Jorge. 2018. Keep My Head on My Shoulders! Why Third-Person is Bad for Navigation in VR. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST '18). Association for Computing Machinery, New York, NY, USA, Article 16, 10 pages. https://doi.org/10.1145/3281505.3281511

Digital Library

[62]

Daniel Medeiros, Mark McGill, Alexander Ng, Robert McDermid, Nadia Pantidi, Julie Williamson, and Stephen Brewster. 2022. From Shielding to Avoidance: Passenger Augmented Reality and the Layout of Virtual Displays for Productivity in Shared Transit. IEEE Transactions on Visualization and Computer Graphics (2022). https://doi.org/10.1109/TVCG.2022.3203002

[63]

Daniel Medeiros, Graham Wilson, Mark Mcgill, and Stephen Anthony Brewster. 2023. The Benefits of Passive Haptics and Perceptual Manipulation for Extended Reality Interactions in Constrained Passenger Spaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). https://doi.org/10.1145/3544548.3581079

Digital Library

[64]

Cameron S Miner, Denise M Chan, and Christopher Campbell. 2001. Digital jewelry: wearable technology for everyday life. In CHI'01 extended abstracts on Human factors in computing systems. 45--46.

Digital Library

[65]

Florian Müller, Niloofar Dezfuli, Max Mühlhäuser, Martin Schmitz, and Mohammadreza Khalilbeigi. 2015. Palm-based interaction with head-mounted displays. In Proceedings of the 17th international conference on human-computer interaction with mobile devices and services adjunct. 963--965.

Digital Library

[66]

Florian Müller, Joshua McManus, Sebastian Günther, Martin Schmitz, Max Mühlhäuser, and Markus Funk. 2019. Mind the tap: Assessing foot-taps for interacting with head-mounted displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[67]

Florian Müller, Martin Schmitz, Daniel Schmitt, Sebastian Günther, Markus Funk, and Max Mühlhäuser. 2020. Walk The Line: Leveraging Lateral Shifts of the Walking Path as an Input Modality for Head-Mounted Displays. Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3313831.3376852

Digital Library

[68]

Alexander Ng, Daniel Medeiros, Mark McGill, Julie Williamson, and Stephen Brewster. 2021. The Passenger Experience of Mixed Reality Virtual Display Layouts in Airplane Environments. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). https://doi.org/10.1109/ISMAR52148.2021.00042

[69]

Masa Ogata, Yuta Sugiura, Yasutoshi Makino, Masahiko Inami, and Michita Imai. 2013. SenSkin: adapting skin as a soft interface. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 539--544.

Digital Library

[70]

Joseph O'Hagan, Pejman Saeghe, Jan Gugenheimer, Daniel Medeiros, Karola Marky, Mohamed Khamis, and Mark McGill. 2023. Privacy-Enhancing Technology and Everyday Augmented Reality: Understanding Bystanders' Varying Needs for Awareness and Consent. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (2023). https://doi.org/10.1145/3569501

Digital Library

[71]

Joseph O'Hagan, Pejman Saeghe, Jan Gugenheimer, Daniel Medeiros, Karola Marky, Mohamed Khamis, and Mark McGill. 2023. Privacy-Enhancing Technology and Everyday Augmented Reality: Understanding Bystanders' Varying Needs for Awareness and Consent. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--35.

Digital Library

[72]

Humphry Osmond. 1957. Function as the Basis of Psychiatric Ward Design. Psychiatric Services 4 (1957). https://doi.org/10/gmpqz3

[73]

Harshada Patel and Mirabelle D'Cruz. 2018. Passenger-Centric Factors Influencing the Experience of Aircraft Comfort. Transport Reviews 2 (2018). https://doi.org/10/gj3dv9

[74]

Leonardo Pavanatto, Chris North, Doug A. Bowman, Carmen Badea, and Richard Stoakley. 2021. Do We Still Need Physical Monitors? An Evaluation of the Usability of AR Virtual Monitors for Productivity Work. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). https://doi.org/10/gj3dh5

[75]

Henning Pohl, Andreea Muresan, and Kasper Hornbñk. 2019. Charting Subtle Interaction in the HCI Literature. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300648

Digital Library

[76]

Oculus Creators Portal. [n.d.]. Mixed Reality Content Tool. https://creator.oculus.com/mrc/

[77]

Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K. Kane. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. https://doi.org/10/gdtm3t

[78]

Halley P Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don't mind me touching my wrist: a case study of interacting with on-body technology in public. In Proceedings of the 2013 International Symposium on Wearable Computers. 89--96.

Digital Library

[79]

Philipp A Rauschnabel and Young K Ro. 2016. Augmented reality smart glasses: An investigation of technology acceptance drivers. International Journal of Technology Marketing 11, 2 (2016), 123--148.

[80]

Stuart Reeves, Steve Benford, Claire O'Malley, and Mike Fraser. 2005. Designing the Spectator Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1054972.1055074

Digital Library

[81]

Jun Rekimoto. 2001. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Proceedings Fifth International Symposium on Wearable Computers. IEEE, 21--27.

[82]

Julie Rico and Stephen Brewster. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 887--896.

Digital Library

[83]

Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. (2010). https://doi.org/10/fphdgw

[84]

Andreas Riegler, Andreas Riener, and Clemens Holzmann. 2021. Augmented Reality for Future Mobility: Insights from a Literature Review and HCI Workshop. i-com 3 (2021). https://doi.org/10.1515/icom-2021-0029

[85]

Yvonne Rogers, Kay Connelly, Lenore Tedesco, William Hazlewood, Andrew Kurtz, Robert E. Hall, Josh Hursey, and Tammy Toscos. 2007. Why It's Worth the Hassle: The Value of in-Situ Studies When Designing Ubicomp. In 9th International Conference on Ubiquitous Computing, J. Krumm, G. D. Abowd, A. Seneviratne, and T. Strang (Eds.). http://oro.open.ac.uk/15665/

[86]

Sami Ronkainen, Jonna Häkkilä, Saana Kaleva, Ashley Colley, and Jukka Linjama. 2007. Tap Input as an Embedded Interaction Method for Mobile Devices. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). https://doi.org/10/frgff6

Digital Library

[87]

Tomás Rossetti and Ricardo Hurtubia. 2020. An assessment of the ecological validity of immersive videos in stated preference surveys. Journal of Choice Modelling 34 (2020), 100198. https://doi.org/10.1016/j.jocm.2019.100198

[88]

William Saunders and Daniel Vogel. 2016. Tap-kick-click: Foot interaction for a standing desk. In Proceedings of the 2016 ACM conference on designing interactive systems. 323--333.

Digital Library

[89]

Thereza Schmelter and Kristian Hildebrand. 2020. Analysis of interaction spaces for vr in public transport systems. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 279--280.

[90]

Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 108--115.

Digital Library

[91]

Valentin Schwind, Jens Reinhardt, Rufat Rzayev, Niels Henze, and Katrin Wolf. [n.d.]. On the Need for Standardized Methods to Study the Social Acceptability of Emerging Technologies. ([n. d.]).

[92]

Valentin Schwind, Jens Reinhardt, Rufat Rzayev, Niels Henze, and Katrin Wolf. 2018. Virtual reality on the go? a study on social acceptance of VR glasses. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. 111--118.

Digital Library

[93]

Marcos Serrano, Barrett M Ens, and Pourang P Irani. 2014. Exploring the use of hand-to-face input for interacting with head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3181--3190.

Digital Library

[94]

Adalberto L Simeone, Eduardo Velloso, Jason Alexander, and Hans Gellersen. 2014. Feet movement in desktop 3D interaction. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 71--74.

[95]

Robert Sommer. 1969. Personal Space. The Behavioral Basis of Design. (1969).

[96]

National Statistics. [n.d.]. Transport Statistics Great Britain 2020. ([n. d.]). https://www.gov.uk/government/statistics/transport-statistics-great-britain-2020

[97]

Anthony Steed, Francisco R Ortega, Adam S Williams, Ernst Kruijff, Wolfgang Stuerzlinger, Anil Ufuk Batmaz, Andrea Stevenson Won, Evan Suma Rosenberg, Adalberto L Simeone, and Aleshia Hayes. 2020. Evaluating immersive experiences during Covid-19 and beyond. interactions 27, 4 (2020), 62--67.

[98]

Bruce Thomas, Karen Grimmer, Joanne Zucco, and Steve Milanese. 2002. Where does the mouse go? An investigation into the placement of a body-attached touchpad mouse for wearable computers. Personal and Ubiquitous computing 6, 2 (2002), 97--112.

[99]

Jared Austin Peter Kay Thomas. 2009. The Social Environment of Public Transport. (2009). http://researcharchive.vuw.ac.nz/handle/ 10063/1095

[100]

Henry Togwell, Mark McGill, Graham Wilson, Daniel Medeiros, and Stephen Anthony Brewster. 2022. In-cAR Gaming: Exploring the Use of AR Headsets to Leverage Passenger Travel Environments for Mixed Reality Gameplay. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA '22). https://doi.org/10.1145/3491101.3519741

Digital Library

[101]

Wen-Jie Tseng, Samuel Huron, Eric Lecolinet, and Jan Gugenheimer. 2023. FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). https://doi.org/10.1145/3544548.3580736

Digital Library

[102]

Ying-Chao Tung, Chun-Yen Hsu, Han-Yu Wang, Silvia Chyou, Jhe-Wei Lin, Pei-Jung Wu, Andries Valstar, and Mike Y Chen. 2015. User-defined game input for smart glasses in public space. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3327--3336.

Digital Library

[103]

Kentaro Ueda, Tsutomu Terada, and Masahiko Tsukamoto. 2019. Input Interface Using Wrinkles on Clothes for Wearable Computing. Journal of Information Processing 27 (2019), 96--105.

[104]

Eduardo Velloso, Jason Alexander, Andreas Bulling, and Hans Gellersen. 2015. Interactions under the desk: A characterisation of foot movements for input in a seated position. In IFIP Conference on Human-Computer Interaction. Springer, 384--401.

Digital Library

[105]

Maurizio Vergari, Tanja Kojić, Francesco Vona, Franca Garzotto, Sebastian Möller, and Jan-Niklas Voigt-Antons. 2021. Influence of Interactivity and Social Environments on User Experience and Social Acceptability in Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). https://doi.org/10/gk6nfp

[106]

Roger Vickerman. 2021. Will Covid-19 Put the Public Back in Public Transport? A UK Perspective. Transport Policy (2021). https://doi.org/10/gh6cdv

[107]

G Stewart Von Itzstein, Mark Billinghurst, Ross T Smith, and Bruce H Thomas. 2019. Augmented Reality Entertainment: Taking Gaming Out of the Box.

[108]

Julie Wagner, Mathieu Nancel, Sean G Gustafson, Stephane Huot, and Wendy E Mackay. 2013. Body-centric design space for multi-surface interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1299--1308.

Digital Library

[109]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y Chen. 2015. PalmType: Using palms as keyboards for smart glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 153--160.

Digital Library

[110]

Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y Chen. 2015. PalmGesture: Using palms as gesture interfaces for eyes-free input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 217--226.

Digital Library

[111]

Gavin White, Lawrie McKay, and Frank Pollick. 2007. Motion and the uncanny valley. Journal of Vision 7, 9 (2007), 477--477.

[112]

Michał Wielechowski, Katarzyna Czech, and Łukasz Grzęda. 2020. Decline in Mobility: Public Transport in Poland in the Time of the COVID-19 Pandemic. Economies 4 (2020). https://doi.org/10/gj46r5

[113]

Julie R. Williamson, Andrew Crossan, Stephen Brewster, and Human Factors. 2011. Multimodal Mobile Interactions: Usability Studies in Real World Settings. In In ICMI 2011. https://doi.org/10/b3nvfk

Digital Library

[114]

Julie R Williamson, Mark McGill, and Khari Outram. 2019. Planevr: social acceptability of virtual reality for aeroplane passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.

Digital Library

[115]

Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019). https://doi.org/10/gf3kx7

Digital Library

[116]

Graham Wilson, Mark McGill, Daniel Medeiros, and Stephen Brewster. 2023. A Lack of Restraint: Comparing Virtual Reality Interaction Techniques for Constrained Transport Seating. IEEE Transactions on Visualization and Computer Graphics 5 (2023). https://doi.org/10.1109/TVCG.2023.3247084

Digital Library

[117]

Robert Xiao, Julia Schwarz, Nick Throm, Andrew D Wilson, and Hrvoje Benko. 2018. MRTouch: Adding touch input to head-mounted mixed reality. IEEE transactions on visualization and computer graphics 24, 4 (2018), 1653--1660.

Digital Library

[118]

Xuhai Xu, Alexandru Dancu, Pattie Maes, and Suranga Nanayakkara. 2018. Hand range interface: Information always at hand with a body-centric mid-air input surface. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--12.

Digital Library

[119]

Tetsuya Yamamoto, Masahiko Tsukamoto, and Tomoki Yoshihisa. 2008. Foot-step input method for operating information devices while jogging. In 2008 International Symposium on Applications and the Internet. IEEE, 173--176.

Digital Library

[120]

Koki Yamashita, Takashi Kikuchi, Katsutoshi Masai, Maki Sugimoto, Bruce H Thomas, and Yuta Sugiura. 2017. CheekInput: turning your cheek into an input surface by embedded optical sensors on a head-mounted display. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1--8.

Digital Library

[121]

Shanhe Yi, Zhengrui Qin, Ed Novak, Yafeng Yin, and Qun Li. 2016. Glassgesture: Exploring head gesture interface of smart glasses. In IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications. IEEE, 1--9.

Digital Library

[122]

Sang Ho Yoon, Ke Huo, Vinh P Nguyen, and Karthik Ramani. 2015. TIMMi: Finger-worn textile input device with multimodal sensing in mobile interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. 269--272.

Digital Library

[123]

Difeng Yu, Xueshi Lu, Rongkai Shi, Hai-Ning Liang, Tilman Dingler, Eduardo Velloso, and Jorge Goncalves. 2021. Gaze-Supported 3D Object Manipulation in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[124]

Ezequiel Roberto Zorzal, José Miguel Campos Gomes, Maurício Sousa, Pedro Belchior, Pedro Garcia da Silva, Nuno Figueiredo, Daniel Simões Lopes, and Joaquim Jorge. 2020. Laparoscopy with augmented reality adaptations. Journal of biomedical informatics 107 (2020), 103463.

Cited By

Hunter MKwon H(2024)Enhancing Existing Reality: A Theoretical Analysis of User-focused Mixed Reality ResearchArchives of Design Research10.15187/adr.2024.11.37.5.24537:5(245-268)Online publication date: 30-Nov-2024
https://doi.org/10.15187/adr.2024.11.37.5.245
Bajorunaite LWilliamson JBrewster S(2024)VR Headsets In-The-Wild: Qualitative Insights on Safety, Awareness, and Social Challenges from Real Train JourneysProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701576(82-94)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701576
Cools RVenema REsteves ASimeone A(2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682099
Show More Cited By

Index Terms

Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite Videos
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Experiencing Social Augmented Reality in Public Spaces
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers

We present various views on the future use of augmented reality in public spaces. The views address enhanced walking, social activity, appropriation of public spaces, and futuristic social aspects of future outdoor augmented reality. Although we often ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Experiencing 3D interactions in virtual reality and augmented reality
EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligence

We demonstrate basic 2D and 3D interactions in both a Virtual Reality (VR) system, called the Personal Space Station, and an Augmented Reality (AR) system, called the Visual Interaction Platform. Since both platforms use identical (optical) tracking ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 7, Issue 3

September 2023

1734 pages

EISSN:2474-9567

DOI:10.1145/3626192

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2023

Published in IMWUT Volume 7, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

European Research Council

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
449
Total Downloads

Downloads (Last 12 months)257
Downloads (Last 6 weeks)17

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hunter MKwon H(2024)Enhancing Existing Reality: A Theoretical Analysis of User-focused Mixed Reality ResearchArchives of Design Research10.15187/adr.2024.11.37.5.24537:5(245-268)Online publication date: 30-Nov-2024
https://doi.org/10.15187/adr.2024.11.37.5.245
Bajorunaite LWilliamson JBrewster S(2024)VR Headsets In-The-Wild: Qualitative Insights on Safety, Awareness, and Social Challenges from Real Train JourneysProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701576(82-94)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701576
Cools RVenema REsteves ASimeone A(2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682099
Li ZGebhardt CInglin YSteck NStreli PHolz C(2024)SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM ReasoningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676470(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676470
Mo WDechant MMarquardt NAyobi ASingh AHolloway C(2024)Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul FlightsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661560(2267-2285)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661560
Medeiros DWilson GSousa MPantidi NMcGill MDrago DBrewster S(2024)Exploring User Placement for VR Remote Collaboration in a Constrained Passenger SpaceProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687722(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687722
Mo WDechant MMarquardt NAyobi ASingh AHolloway C(2024)Knowledge Work on Airplanes: Challenges, Workarounds, and Design ImplicationsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650873(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650873
Stellmacher CMathis FWeiss YLoerakker MWagener NSchöning J(2024)Exploring Mobile Devices as Haptic Interfaces for Mixed RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642176(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642176
Medeiros DWilson GBrewster SMcGill M(2024)The Social Impact of Extended Reality Spatial Productivity in Constrained, Public and Passenger Spaces2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00129(659-661)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00129
Jackson BLor LHeggeseth B(2024)Workspace Guardian: Investigating Awareness of Personal Workspace Between Co-Located Augmented Reality UsersIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337207330:5(2724-2733)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372073
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents