Pervasive Augmented Reality for Industry Scenarios: Lessons Learned and Insights Gained from a Comparative User Study
Authors: 
Rafael Maio, Tiago Araújo, Bernardo Marques, Pedro Ramalho, Andre Santos, Duarte Almeida, Paulo Dias, Beatriz Sousa SantosAuthors Info & Claims
Rafael Maio, Tiago Araújo, Bernardo Marques, Pedro Ramalho, Andre Santos, Duarte Almeida, Paulo Dias, Beatriz Sousa SantosAuthors Info & ClaimsPages 246 - 255
Abstract
The use of Pervasive Augmented Reality (AR) in industrial settings, particularly in the context of Industry 4.0, is a growing area of research. Industry 4.0 is characterized by the integration of advanced technologies, including AR, to enable smart, connected, and autonomous systems in manufacturing and other industries. This study focuses on two systems that use Pervasive AR for logistics and data monitoring on assembly lines. Such systems were designed using cooperative Human-Centered Design (HCD) methodologies in collaboration with partners from the industry sector. We report lessons learned and guidelines on the development of AR systems for industrial environments. In addition, a user study based on a data monitoring laboratory realistic procedure with 8 participants is described. The study compares the usability and effectiveness of a dashboard on Pervasive AR and a web tablet. Overall, results emphasize that AR was better suited when requiring spatial awareness and interventions, while traditional web tablet was better for tasks that require more interaction with the content and faster data monitoring. These findings had implications for the design of industrial tools, such as prototype improvements and idealize new methods, which can guide future efforts to develop and deploy AR applications.
References
[1]
Sara Salman Hassan Al-Maeeni, Christopher Kuhnhen, Bernd Engel, and Michael Schiller. 2020. Smart retrofitting of machine tools in the context of industry 4.0. Procedia CIRP 88 (2020), 369–374.
[2]
Joao Bernardo Alves, Bernardo Marques, Paulo Dias, and Beatriz Sousa Santos. 2021. Using augmented reality for industrial quality assurance: a shop floor user study. The International Journal of Advanced Manufacturing Technology 115, 1-2 (2021), 105–116.
[3]
Surajit Bag and Jan Harm Christiaan Pretorius. 2022. Relationships between industry 4.0, sustainable manufacturing and circular economy: proposal of a research framework. International Journal of Organizational Analysis 30, 4 (2022), 864–898.
[4]
Jonas Blattgerste, Patrick Renner, Benjamin Strenge, and Thies Pfeiffer. 2018. In-situ instructions exceed side-by-side instructions in augmented reality assisted assembly. In Proceedings of the 11th PErvasive technologies related to assistive environments conference. 133–140.
[5]
Eleonora Bottani and Giuseppe Vignali. 2019. Augmented reality technology in the manufacturing industry: A review of the last decade. Iise Transactions 51, 3 (2019), 284–310.
[6]
Martina Calzavara, Christoph H Glock, Eric H Grosse, and Fabio Sgarbossa. 2019. An integrated storage assignment method for manual order picking warehouses considering cost, workload and posture. International Journal of Production Research 57, 8 (2019), 2392–2408.
[7]
Wei Chen. 2020. Intelligent manufacturing production line data monitoring system for industrial internet of things. Computer communications 151 (2020), 31–41.
[8]
Francesco De Pace, Federico Manuri, and Andrea Sanna. 2018. Augmented reality in industry 4.0. Am. J. Comput. Sci. Inf. Technol 6, 1 (2018), 17.
[9]
Luís Fernando de Souza Cardoso, Flávia Cristina Martins Queiroz Mariano, and Ezequiel Roberto Zorzal. 2020. A survey of industrial augmented reality. Computers & Industrial Engineering 139 (2020), 106159.
[10]
Johannes Egger and Tariq Masood. 2020. Augmented reality in support of intelligent manufacturing–a systematic literature review. Computers & Industrial Engineering 140 (2020), 106195.
[11]
Krzysztof Ejsmont, Bartlomiej Gladysz, and Aldona Kluczek. 2020. Impact of industry 4.0 on sustainability—bibliometric literature review. Sustainability 12, 14 (2020), 5650.
[12]
Paula Fraga-Lamas, Tiago M Fernandez-Carames, Oscar Blanco-Novoa, and Miguel A Vilar-Montesinos. 2018. A review on industrial augmented reality systems for the industry 4.0 shipyard. IEEE Access 6 (2018), 13358–13375.
[13]
Markus Funk, Andreas Bächler, Liane Bächler, Thomas Kosch, Thomas Heidenreich, and Albrecht Schmidt. 2017. Working with augmented reality? A long-term analysis of in-situ instructions at the assembly workplace. In Proceedings of the 10th international conference on pervasive technologies related to assistive environments. 222–229.
[14]
Abir Gallala, Bassem Hichri, and Peter Plapper. 2019. Survey: The evolution of the usage of augmented reality in industry 4.0. In IOP Conference Series: Materials Science and Engineering, Vol. 521.
[15]
Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2016. Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics 23, 6 (2016), 1706–1724.
[16]
Robin Hanson, William Falkenström, and Mikael Miettinen. 2017. Augmented reality as a means of conveying picking information in kit preparation for mixed-model assembly. Computers & Industrial Engineering 113 (2017), 570–575.
[17]
Weiting Hou. 2019. Augmented reality museum visiting application based on the Microsoft HoloLens. In Journal of Physics: Conference Series, Vol. 1237. IOP Publishing, 052018.
[18]
Jung-Sing Jwo, Ching-Sheng Lin, and Cheng-Hsiung Lee. 2021. Smart technology–driven aspects for human-in-the-loop smart manufacturing. The International Journal of Advanced Manufacturing Technology 114 (2021), 1741–1752.
[19]
Bzhwen A Kadir, Ole Broberg, and Carolina Souza da Conceicao. 2019. Current research and future perspectives on human factors and ergonomics in Industry 4.0. Computers & Industrial Engineering 137 (2019), 106004.
[20]
Kai Klinker, Lisa Berkemeier, Benedikt Zobel, Hanna Wüller, Veronika Huck-Fries, Manuel Wiesche, Hartmut Remmers, Oliver Thomas, and Helmut Krcmar. 2018. Structure for innovations: A use case taxonomy for smart glasses in service processes. Multikonferenz Wirtschaftsinformatik Lüneburg, Deutschland (2018).
[21]
Iker Laskurain-Iturbe, Germán Arana-Landín, Beñat Landeta-Manzano, and Naiara Uriarte-Gallastegi. 2021. Exploring the influence of industry 4.0 technologies on the circular economy. Journal of Cleaner Production 321 (2021), 128944.
[22]
Rafael Maio, Bernardo Marques, João Alves, Beatriz Sousa Santos, Paulo Dias, and Nuno Lau. 2022. An Augmented Reality Serious Game for Learning Intelligent Wheelchair Control: Comparing Configuration and Tracking Methods. Sensors 22, 20 (2022), 7788.
[23]
Ivo Malỳ, David Sedláček, and Paulo Leitao. 2016. Augmented reality experiments with industrial robot in industry 4.0 environment. In IEEE conference on industrial informatics. 176–181.
[24]
Petra Maresova, Ivan Soukal, Libuse Svobodova, Martina Hedvicakova, Ehsan Javanmardi, Ali Selamat, and Ondrej Krejcar. 2018. Consequences of industry 4.0 in business and economics. Economies 6, 3 (2018), 46.
[25]
Bernardo Marques, Raphael Carvalho, Paulo Dias, and Beatriz S Santos. 2019. Pervasive augmented reality for indoor uninterrupted experiences: A user study. In ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the ACM International Symposium on Wearable Computers. 141–144.
[26]
Bernardo Marques, Beatriz Sousa Santos, Tiago Araújo, Nuno Cid Martins, João Bernardo Alves, and Paulo Dias. 2019. Situated visualization in the decision process through augmented reality. In 2019 23rd international conference information visualisation (IV). 13–18.
[27]
Bernardo Marques, Samuel Silva, João Alves, Tiago Araujo, Paulo Dias, and Beatriz Sousa Santos. 2021. A conceptual model and taxonomy for collaborative augmented reality. IEEE Transactions on Visualization and Computer Graphics 28, 12 (2021), 5113–5133.
[28]
Bernardo Marques, Samuel Silva, João Alves, António Rocha, Paulo Dias, and Beatriz Sousa Santos. 2022. Remote collaboration in maintenance contexts using augmented reality: Insights from a participatory process. International Journal on Interactive Design and Manufacturing (IJIDeM) (2022), 1–20.
[29]
Bernardo Marques, Samuel Silva, Paulo Dias, and Beatriz Sousa Santos. 2022. Do Hand-Held Devices have a future in Augmented Reality real-life remote tasks? Refections on impact/acceptance versus Head-Mounted Displays. In Proceedings of the European Conference on Computer-Supported Cooperative Work, ECSCW. 1–9.
[30]
Nuno Cid Martins, Bernardo Marques, João Alves, Tiago Araújo, Paulo Dias, and Beatriz Sousa Santos. 2022. Augmented reality situated visualization in decision-making. Multimedia Tools and Applications 81, 11 (2022), 14749–14772.
[31]
Nuno Cid Martins, Bernardo Marques, Paulo Dias, and Beatriz Sousa Santos. 2022. Augmenting the Reality of Situated Visualization. In 2022 26th International Conference Information Visualisation (IV). 54–60.
[32]
Nela Murauer, Florian Müller, Sebastian Günther, Dominik Schön, Nerina Pflanz, and Markus Funk. 2018. An analysis of language impact on augmented reality order picking training. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference. 351–357.
[33]
W Patrick Neumann, Sven Winkelhaus, Eric H Grosse, and Christoph H Glock. 2021. Industry 4.0 and the human factor–A systems framework and analysis methodology for successful development. International journal of production economics 233 (2021), 107992.
[34]
Margherita Peruzzini, Fabio Grandi, and Marcello Pellicciari. 2020. Exploring the potential of Operator 4.0 interface and monitoring. Computers & Industrial Engineering 139 (2020), 105600.
[35]
George Plakas, ST Ponis, K Agalianos, E Aretoulaki, and SP Gayialis. 2020. Augmented reality in manufacturing and logistics: Lessons learnt from a real-life industrial application. Procedia Manufacturing 51 (2020), 1629–1635.
[36]
Martina Porubčinová and Helena Fidlerová. 2020. Determinants of industry 4.0 technology adaption and human-Robot collaboration. Research Papers Faculty of Materials Science and Technology Slovak University of Technology 28, 46 (2020), 10–21.
[37]
Vule Reljić, Ivana Milenković, Slobodan Dudić, Jovan Šulc, and Brajan Bajči. 2021. Augmented reality applications in industry 4.0 environment. Applied Sciences 11, 12 (2021), 5592.
[38]
Gian Maria Santi, Alessandro Ceruti, Alfredo Liverani, and Francesco Osti. 2021. Augmented reality in industry 4.0 and future innovation programs. Technologies 9, 2 (2021), 33.
[39]
Beat A Schwendimann, Maria Jesus Rodriguez-Triana, Andrii Vozniuk, Luis P Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2016. Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies 10, 1 (2016), 30–41.
[40]
Bruno S Sergi, Elena G Popkova, Aleksei V Bogoviz, and Tatiana N Litvinova. 2019. Understanding industry 4.0: AI, the internet of things, and the future of work. Emerald Group Publishing.
[41]
Vasileios Sidiropoulos, Dimitrios Bechtsis, and Dimitrios Vlachos. 2021. An augmented reality symbiosis software tool for sustainable logistics activities. Sustainability 13, 19 (2021), 10929.
[42]
Regina Sousa, Rui Miranda, Ailton Moreira, Carlos Alves, Nicolas Lori, and José Machado. 2021. Software tools for conducting real-time information processing and visualization in industry: An up-to-date review. Applied Sciences 11, 11 (2021), 4800.
Index Terms
- Pervasive Augmented Reality for Industry Scenarios: Lessons Learned and Insights Gained from a Comparative User Study
Recommendations
Comparing Different Methods for Remote Configuration of Pervasive Augmented Reality Experiences: A User Study in Logistics Procedures
Virtual, Augmented and Mixed RealityAbstractAugmented Reality (AR) is a promising technology in Industry 4.0, improving industrial procedures and reducing errors. Using a Human-Centered Design methodology, a Pervasive AR tool was initially created to support logistics tasks in the shop ...
Pervasive Augmented Reality (AR) for Assistive Production: Comparing the use of a Head-Mounted Display (HMD) versus a Hand-Held Device (HHD)
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous MultimediaPervasive Augmented Reality (AR) has been explored to provide experiences that are continuous in space and time, while incorporating layers of contextual information. While most research efforts have been devoted to explore serious games, museums and ...
Pervasive augmented reality for indoor uninterrupted experiences: a user study
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable ComputersAugmented Reality (AR) adds additional layers of information on top of real environments. Recently, Pervasive AR extends this concept through an AR experience that is continuous in space, being aware of and responsive to the user's context and pose (...
Comments
Information & Contributors
Information
Published In
June 2024
465 pages
ISBN:9798400705038
DOI:10.1145/3639701
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Fundação para a Ciência e Tecnologia
- Augmented Humanity Project
Conference
IMX '24: ACM International Conference on Interactive Media Experiences
June 12 - 14, 2024
Stockholm, Sweden
Acceptance Rates
Overall Acceptance Rate 69 of 245 submissions, 28%
Upcoming Conference
IMX '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 229Total Downloads
- Downloads (Last 12 months)229
- Downloads (Last 6 weeks)49
Reflects downloads up to 18 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in