skip to main content
10.1145/3411764.3445349acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Open access

XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces

Published: 07 May 2021 Publication History

Abstract

Arm discomfort is a common issue in Cross Reality applications involving prolonged mid-air interaction. Solving this problem is difficult because of the lack of tools and guidelines for 3D user interface design. Therefore, we propose a method to make existing ergonomic metrics available to creators during design by estimating the interaction cost at each reachable position in the user’s environment. We present XRgonomics, a toolkit to visualize the interaction cost and make it available at runtime, allowing creators to identify UI positions that optimize users’ comfort. Two scenarios show how the toolkit can support 3D UI design and dynamic adaptation of UIs based on spatial constraints. We present results from a walkthrough demonstration, which highlight the potential of XRgonomics to make ergonomics metrics accessible during the design and development of 3D UIs. Finally, we discuss how the toolkit may address design goals beyond ergonomics.

Supplementary Material

VTT File (3411764.3445349_videofigurecaptions.vtt)
VTT File (3411764.3445349_videopreviewcaptions.vtt)
Supplementary Materials (3411764.3445349_supplementalmaterials.zip)
MP4 File (3411764.3445349_videofigure.mp4)
Supplemental video
MP4 File (3411764.3445349_videopreview.mp4)
Preview video

References

[1]
Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376722
[2]
Myroslav Bachynskyi, Antti Oulasvirta, Gregorio Palmas, and Tino Weinkauf. 2014. Is Motion Capture-Based Biomechanical Simulation Valid for HCI Studies? Study and Implications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3215–3224. https://doi.org/10.1145/2556288.2557027
[3]
Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf. 2015. Informing the Design of Novel Input Methods with Muscle Coactivation Clustering. ACM Trans. Comput.-Hum. Interact. 21, 6, Article 30 (Jan. 2015), 25 pages. https://doi.org/10.1145/2687921
[4]
Gilles Bailly, Antti Oulasvirta, Timo Kötzing, and Sabrina Hoppe. 2013. MenuOptimizer: Interactive Optimization of Menu Systems. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 331–342. https://doi.org/10.1145/2501988.2502024
[5]
Norbert Beckmann, Hans-Peter Kriegel, Ralf Schneider, and Bernhard Seeger. 1990. The R*-Tree: An Efficient and Robust Access Method for Points and Rectangles. SIGMOD Rec. 19, 2 (May 1990), 322–331. https://doi.org/10.1145/93605.98741
[6]
Gunnar Borg. 1990. Psychophysical scaling with applications in physical work and the perception of exertion. Scandinavian Journal of Work, Environment & Health 16 (1990), 55–58. http://www.jstor.org/stable/40965845
[7]
Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853
[8]
James Carifio and Rocco J Perla. 2007. Ten common misunderstandings, misconceptions, persistent myths and urban legends about Likert scales and Likert response formats and their antidotes. Journal of social sciences 3, 3 (2007), 106–116.
[9]
Mario Cifrek, Vladimir Medved, Stanko Tonković, and Saša Ostojić. 2009. Surface EMG based muscle fatigue evaluation in biomechanics. Clinical Biomechanics 24, 4 (2009), 327 – 340. https://doi.org/10.1016/j.clinbiomech.2009.01.010
[10]
Perkins Coie. 2020. 2020 Augmented and Virtual Reality Survey Report. https://www.perkinscoie.com/en/ar-vr-survey-results/2020-augmented-and-virtual-reality-survey-results.html. Accessed: 2020-06-16.
[11]
Joachim Deisinger, Ralf Breining, and Andreas Rößler. 2000. ERGONAUT: A Tool for Ergonomic Analyses in Virtual Environments. In Virtual Environments 2000, Jurriaan Mulder and Robert van Liere (Eds.). Springer Vienna, Vienna, 167–176.
[12]
Scott L Delp, Frank C Anderson, Allison S Arnold, Peter Loan, Ayman Habib, Chand T John, Eran Guendelman, and Darryl G Thelen. 2007. OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement. IEEE Transactions on Biomedical Engineering 54, 11 (2007), 1940–1950.
[13]
Stephen DiVerdi, Tobias Hollerer, and Richard Schreyer. 2004. Level of detail interfaces. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, New York, NY, USA, 300–301.
[14]
Andreas Fender, Philipp Herholz, Marc Alexa, and Jörg Müller. 2018. OptiSpace: Automated Placement of Interactive 3D Projection Mapping Content. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173843
[15]
Tiare Feuchtner and Jörg Müller. 2018. Ownershift: Facilitating Overhead Interaction in Virtual Reality with an Ownership-Preserving Hand Space Shift. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 31–43. https://doi.org/10.1145/3242587.3242594
[16]
Krzysztof Z. Gajos, Daniel S. Weld, and Jacob O. Wobbrock. 2010. Automatically generating personalized user interfaces with Supple. Artificial Intelligence 174, 12 (2010), 910 – 950.
[17]
Ran Gal, Lior Shapira, Eyal Ofek, and Pushmeet Kohli. 2014. FLARE: Fast layout for augmented reality applications. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, NY, USA, 207–212.
[18]
Claire C Gordon, Thomas Churchill, Charles E Clauser, Bruce Bradtmiller, and John T McConville. 1989. Anthropometric survey of US army personnel: methods and summary statistics 1988. Technical Report. Anthropology Research Project Inc Yellow Springs OH.
[19]
Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2017. Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 23, 6(2017), 1706–1724.
[20]
Wenkai Han and Hans-Jörg Schulz. 2020. Beyond Trust Building – Calibrating Trust in Visual Analytics. In Proceedings of the Workshop on TRust and EXperience in Visual Analytics (TREX). IEEE, New York, NY, USA, 9–15. to appear.
[21]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. Elsevier (North Holland Publishing Co.), Amsterdam, Netherlands, 139 – 183. https://doi.org/10.1016/S0166-4115(08)62386-9
[22]
Jennifer L. Hicks, Thomas K. Uchida, Ajay Seth, Apoorva Rajagopal, and Scott L. Delp. 2015. Is My Model Good Enough? Best Practices for Verification and Validation of Musculoskeletal Models and Simulations of Movement. Journal of Biomechanical Engineering 137, 2 (02 2015), 24. https://doi.org/10.1115/1.4029304 arXiv:https://asmedigitalcollection.asme.org/biomechanical/article-pdf/137/2/020905/6091748/bio_137_02_020905.pdf020905.
[23]
Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1063–1072. https://doi.org/10.1145/2556288.2557130
[24]
Verne T Inman, JB deC M Saunders, and LeRoy C Abbott. 1944. Observations on the function of the shoulder joint. The Journal of Bone and Joint Surgery 26, 1 (1944), 1–30.
[25]
Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523
[26]
Simon Julier, Marco Lanzagorta, Yohan Baillot, Lawrence Rosenblum, Steven Feiner, Tobias Hollerer, and Sabrina Sestito. 2000. Information filtering for mobile augmented reality. In Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000). IEEE, New York, NY, USA, 3–11.
[27]
Janin Koch, Andrés Lucero, Lena Hegemann, and Antti Oulasvirta. 2019. May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300863
[28]
Joseph J LaViola Jr, Ernst Kruijff, Ryan P McMahan, Doug Bowman, and Ivan P Poupyrev. 2017. 3D user interfaces: theory and practice. Addison-Wesley Professional, Boston, MA, USA.
[29]
David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, Article 36, 17 pages. https://doi.org/10.1145/3173574.3173610
[30]
David Lindlbauer, Anna Maria Feit, and Otmar Hilliges. 2019. Context-Aware Online Adaptation of Mixed Reality Interfaces. In Proceedings of the 32Nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). ACM, New York, NY, USA, 147–160. https://doi.org/10.1145/3332165.3347945
[31]
Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle Arms-down Mid-Air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 63–71. https://doi.org/10.1145/2807442.2807489
[32]
Lynn McAtamney and E Nigel Corlett. 1993. RULA: a survey method for the investigation of work-related upper limb disorders. Applied ergonomics 24, 2 (1993), 91–99.
[33]
Roberto A. Montano Murillo, Sriram Subramanian, and Diego Martinez Plasencia. 2017. Erg-O: Ergonomic Optimization of Immersive Virtual Environments. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 759–771. https://doi.org/10.1145/3126594.3126605
[34]
Brad Myers, Scott E. Hudson, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 3–28.
[35]
Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1233–1244. https://doi.org/10.1145/2858036.2858250
[36]
Antti Oulasvirta, Niraj Ramesh Dayama, Morteza Shiripour, Maximilian John, and Andreas Karrenbauer. 2020. Combinatorial Optimization of Graphical User Interface Designs. Proc. IEEE 108, 3 (March 2020), 434–464.
[37]
David A. Rosenbaum. 2010. Chapter 2 - Core Problems. In Human Motor Control (Second Edition)(second edition ed.), David A. Rosenbaum (Ed.). Academic Press, San Diego, 11 – 41. https://doi.org/10.1016/B978-0-12-374226-1.00002-4
[38]
Katherine R. Saul, Xiao Hu, Craig M. Goehler, Meghan E. Vidt, Melissa Daly, Anca Velisar, and Wendy M. Murray. 2015. Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model. Computer Methods in Biomechanics and Biomedical Engineering 18, 13(2015), 1445–1458.
[39]
Suzanne C. Segerstrom and Lise Solberg Nes. 2007. Heart Rate Variability Reflects Self-Regulatory Strength, Effort, and Fatigue. Psychological Science 18, 3 (2007), 275–281. https://doi.org/10.1111/j.1467-9280.2007.01888.x 17444926.
[40]
Gisela Sjøgaard, Gabrielle Savard, and Carsten Juel. 1988. Muscle blood flow during isometric activity and its relation to muscle fatigue. European journal of applied physiology and occupational physiology 57, 3(1988), 327–335.
[41]
Markus Tatzgern, Valeria Orso, Denis Kalkofen, Giulio Jacucci, Luciano Gamberini, and Dieter Schmalstieg. 2016. Adaptive information density for augmented reality displays. In 2016 IEEE Virtual Reality (VR). IEEE, New York, NY, USA, 83–92.
[42]
Kashyap Todi, Daryl Weir, and Antti Oulasvirta. 2016. Sketchplore: Sketch and Explore with a Layout Optimiser. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS ’16). Association for Computing Machinery, New York, NY, USA, 543–555. https://doi.org/10.1145/2901790.2901817
[43]
Deepak Tolani and Norman I Badler. 1996. Real-Time Inverse Kinematics of the Human Arm. Presence: Teleoperators and Virtual Environments 5, 4(1996), 393–401. https://doi.org/10.1162/pres.1996.5.4.393
[44]
Franziska Zacharias, Christoph Borst, and Gerd Hirzinger. 2007. Capturing robot workspace structure: representing robot capabilities. In 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, New York, NY, USA, 3229–3236.

Cited By

View all

Index Terms

  1. XRgonomics: Facilitating the Creation of Ergonomic 3D Interfaces
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
          May 2021
          10862 pages
          ISBN:9781450380966
          DOI:10.1145/3411764
          This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 07 May 2021

          Check for updates

          Badges

          • Best Paper

          Author Tags

          1. 3D User Interfaces
          2. Adaptive User Interfaces
          3. Computational Interaction
          4. Ergonomics
          5. Mid-air Interaction
          6. Optimization
          7. Toolkit

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Funding Sources

          • European Research Council (ERC)
          • Innovation Fund Denmark

          Conference

          CHI '21
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

          Upcoming Conference

          CHI 2025
          ACM CHI Conference on Human Factors in Computing Systems
          April 26 - May 1, 2025
          Yokohama , Japan

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)1,156
          • Downloads (Last 6 weeks)172
          Reflects downloads up to 22 Dec 2024

          Other Metrics

          Citations

          Cited By

          View all

          View Options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media