skip to main content
10.1145/3565066.3608250acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
demonstration

INTERACT: An authoring tool that facilitates the creation of human centric interaction with 3d objects in virtual reality

Published: 26 September 2023 Publication History

Abstract

A widespread adoption of Virtual, Augmented, and Mixed Reality (VR/AR/MR), collectively referred to as Extended Reality (XR), has become a tangible possibility to revolutionize educational and training scenarios by offering immersive, interactive experiences. In this paper we present INTERACT, an authoring tool for creating advanced 3D physics-based Intelligent Tutoring Systems (ITS) by individual developers or small-scale development teams. INTERACT is based on a cutting edge physics engine allowing realistic interactions such as collision detection and ergonomic evaluations. We demonstrate the benefits of INTERACT by developing a set of training scenarios for a use case of a Laser cutting machine. The use case illustrates the numerous possibilities such as creating interaction with objects, ease of configuring a scenario and how to design the visual effects to the machine.

Supplementary Material

MP4 File (20230804_XR2Learn_Short.mp4)
additional video for the madness session (1 min max)

References

[1]
Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376722
[2]
Pierre Bégout, Thierry Duval, Sébastien Kubicki, Bertrand Charbonnier, and Emmanuel Bricard. 2020. WAAT: A Workstation AR Authoring Tool for Industry 4.0. In Augmented Reality, Virtual Reality, and Computer Graphics, Lucio Tommaso De Paolis and Patrick Bourdot (Eds.). Springer International Publishing, Cham, 304–320.
[3]
Ioannis Chatzigiannakis, Georgios Mylonas, Panagiotis Kokkinos, Orestis Akribopoulos, Marios Logaras, and Irene Mavrommati. 2011. Implementing multiplayer pervasive installations based on mobile sensing devices: Field experience and user evaluation from a public showcase. Journal of Systems and Software 84, 11 (2011), 1989–2004.
[4]
Ioannis Chatzigiannakis, Georgios Mylonas, and Andrea Vitaletti. 2011. Urban pervasive applications: Challenges, scenarios and case studies. Computer Science Review 5, 1 (2011), 103–118.
[5]
John Ahmet Erkoyuncu, Iñigo Fernández del Amo, Michela Dalle Mura, Rajkumar Roy, and Gino Dini. 2017. Improving efficiency of industrial maintenance with context aware adaptive authoring in augmented reality. Cirp Annals 66, 1 (2017), 465–468.
[6]
Michele Gattullo, Giulia Wally Scurati, Michele Fiorentino, Antonio Emmanuele Uva, Francesco Ferrise, and Monica Bordegoni. 2019. Towards augmented reality manuals for industry 4.0: A methodology. Robotics and Computer-Integrated Manufacturing 56 (2019), 276–286.
[7]
Tom Murray. 2016. Coordinating the complexity of tools, tasks, and users: On theory-based approaches to authoring tool usability. International Journal of Artificial Intelligence in Education 26 (2016), 37–71.
[8]
Michael Nebeling and Maximilian Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 333–337. https://doi.org/10.1109/ISMAR-Adjunct.2018.00098
[9]
Scott Ososky. 2016. Practical requirements for ITS authoring tools from a user experience perspective. In Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience: 10th International Conference, AC 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings, Part II 10. Springer, 55–66.
[10]
Miriam Saviano, Viktor Malakuczi, and Lorenzo Imbesi. 2023. Visor-less XR in museums. A Content Management System for Immersive Installations. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 551–556. https://doi.org/10.1109/VRW58643.2023.00122
[11]
Dieter Schmalstieg, Anton Fuhrmann, Gerd Hesina, Zsolt Szalavári, L. Miguel Encarnação, Michael Gervautz, and Werner Purgathofer. 2002. The Studierstube Augmented Reality Project. Presence: Teleoperators and Virtual Environments 11, 1 (02 2002), 33–54. https://doi.org/10.1162/105474602317343640 arXiv:https://direct.mit.edu/pvar/article-pdf/11/1/33/1623621/105474602317343640.pdf
[12]
Lei Zhang and Steve Oney. 2020. FlowMatic: An Immersive Authoring Tool for Creating Interactive Scenes in Virtual Reality. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 342–353. https://doi.org/10.1145/3379337.3415824
[13]
Åsa Fast-Berglund, Liang Gong, and Dan Li. 2018. Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manufacturing 25 (2018), 31–38. https://doi.org/10.1016/j.promfg.2018.06.054 Proceedings of the 8th Swedish Production Symposium (SPS 2018).

Index Terms

  1. INTERACT: An authoring tool that facilitates the creation of human centric interaction with 3d objects in virtual reality

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        MobileHCI '23 Companion: Proceedings of the 25th International Conference on Mobile Human-Computer Interaction
        September 2023
        256 pages
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 26 September 2023

        Check for updates

        Author Tags

        1. Authoring Tools
        2. Human-centric interaction
        3. Intelligent Tutoring Systems (ITS)
        4. Unity
        5. Virtual Reality

        Qualifiers

        • Demonstration
        • Research
        • Refereed limited

        Funding Sources

        Conference

        MobileHCI '23
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 202 of 906 submissions, 22%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 100
          Total Downloads
        • Downloads (Last 12 months)53
        • Downloads (Last 6 weeks)5
        Reflects downloads up to 09 Jan 2025

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media