skip to main content
research-article

Mobile augmented reality for teaching structural analysis

Published: 01 October 2017 Publication History

Abstract

A marker-based AR application is developed for iOS-based tablet systems.Fiducial template markers are used to register virtual contents over a video.Blend shape morphing is used for 3D frame deflection visualization.The results indicate the potential of AR to contribute to students learning. Structural analysis is an introductory core course that is taught in every civil engineering program as well as in most architectural and construction engineering programs. Previous research unveils students' deficits in understanding the behavior of structural elements in a three-dimensional (3D) context due to the shortcomings of traditional lecturing approaches, which put too much emphasis on the analysis of individual structural members, thereby falling short in providing a solid, easy-to-follow, and holistic approach to analyzing complex structures with a large number of interconnected elements. In this paper, the authors introduce a new pedagogy for teaching structural analysis that incorporates mobile augmented reality (AR) and interactive 3D visualization technology. The goal of this study is to enhance the contents used in structural analysis textbooks and on worksheets by visualizing discrete structural members employing AR along with interactive 3D models in order to illustrate how the structures behave under different loading conditions. Students can interactively change the load and observe the reaction resulting from this change with the instant feedback provided by the AR interface. The feasibility of AR concepts and interaction metaphors, as well as the potential of using AR for teaching structural analysis are investigated, specifically by focusing on challenges regarding content integration and interaction. An AR application is designed and developed, and a pilot study is conducted in a junior level structural analysis class to assess the pedagogical impact and the design concepts employed by the AR tool. Control and test groups are deployed, and students performance is measured using pre- and post-tests. The results of the pilot study indicate that the utilized AR design concepts have potential to contribute to students learning by providing interactive and 3D visualization features, which support constructive engagement and retention of information in students.

References

[1]
J.F. Davalos, C.J. Moran, S.S. Kodkani, Neoclassical active learning approach for structural analysis, in: Proceedings of the 2003 American Society for Engineering Education Annual Conference & Exposition, 2003.
[2]
X.F. Yuan, J.G. Teng, Interactive Web-based package for computer-aided learning of structural behavior, Comp. Appl. Eng. Educ., 10 (2002) 121-136.
[3]
A. Webster, S. Feiner, B. MacIntyre, W. Massie, T. Krueger, Augmented reality in architectural construction, inspection and renovation, in: Proceedings of the ASCE Third Congress on Computing in Civil Engineering, June 1996, pp. 913919.
[4]
D.A. Bowman, M. Setareh, M.S. Pinho, N. Ali, A. Kalita, Y. Lee, A. Datey, Virtual-SAP: an immersive tool for visualizing the response of building structures to environmental conditions, in: Proceedings of the Virtual Reality, 2003, IEEE, March 2003, IEEE, pp. 243250.
[5]
C.S.C. Rodrigues, P.F. Rodrigues, C.M. Werner, An application of augmented reality in architectural education for understanding structural behavior through models, in: Proceedings of the X Symposium of Virtual and Augmented Reality, Joo Pessoa: Universidade Federal da Paraba, 2008, pp. 163166.
[6]
A.C. Aparicio, A.M. Ruiz-Teran, Tradition and innovation in teaching structural design in civil engineering, J. Prof. Iss. Eng. Educ. Pract., 133 (2007) 340-349.
[7]
S. Kitipornchai, H.F. Lam, T. Reichl, A new approach to teaching and learning structural analysis, Struct. Granul. Solids: From Scient. Princ. Eng. Appl. (2008) 247.
[8]
J.G. Teng, C.Y. Song, X.F. Yuan, Fostering creativity in students in the teaching of structural analysis, Int. J. Eng. Educ., 20 (2004) 96-102.
[9]
N.L. Pena, The Development of Structural Analysis Virtual Module for iPad Application, University of Idaho, 2014.
[10]
R.M. Felder, R. Brent, The intellectual development of science and engineering students, J. Eng. Educ., 93 (2004) 269-277.
[11]
R.M. Felder, R. Brent, The intellectual development of science and engineering students. Part 2: teaching to promote growth, J. Eng. Educ., 93 (2004) 279-291.
[12]
H.M. Matusovich, R.A. Streveler, R.L. Miller, Why do students choose engineering? A qualitative, longitudinal investigation of students motivational values, J. Eng. Educ., 99 (2010) 289-303.
[13]
X. Chen, M. Soldner, STEM Attrition: College Students Paths into and Out of STEM Fields, retrieved from <http://necs.ed.gov>, 2013.
[14]
R.T. Azuma, A survey of augmented reality, Pres.: Teleoperat. Virt. Environ., 6 (1997) 355-385.
[15]
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, Recent advances in augmented reality, IEEE Comp. Graph. Appl., 21 (2001) 34-47.
[16]
A.H. Behzadan, S. Dong, V.R. Kamat, Augmented reality visualization: a review of civil infrastructure system applications, Adv. Eng. Inf., 29 (2015) 252-267.
[17]
H.L. Chi, S.C. Kang, X. Wang, Research trends and opportunities of augmented reality applications in architecture, engineering, and construction, Autom. Construct., 33 (2013) 116-122.
[18]
F. Bosch, A. Guillemet, Y. Turkan, C.T. Haas, R. Haas, Tracking the built status of MEP works: assessing the value of a Scan-vs-BIM system, J. Comput. Civil Eng., 28 (2013) 05014004.
[19]
F. Bosch, M. Ahmed, Y. Turkan, C.T. Haas, R. Haas, The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: the case of cylindrical MEP components, Autom. Construct., 49 (2015) 201-213.
[20]
C. Eastman, C.M. Eastman, P. Teicholz, R. Sacks, K. Liston, BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors, John Wiley & Sons, 2011.
[21]
F. Leite, B. Akinci, J. Garrett, Identification of data items needed for automatic clash detection in MEP design coordination, in: Proceedings of Construction Research Congress, 2009, pp. 416425.
[22]
T.M. Korman, M.A. Fischer, C.B. Tatum, Knowledge and reasoning for MEP coordination, J. Construct. Eng. Manage., 129 (2003) 627-634.
[23]
F.A. Al Shalabi, Y. Turkan, S. Laflamme, BrIM implementation for documentation of bridge condition for inspection, in: Proceedings of the CSCE International Construction Specialty Conference, Vancouver, BC, 2015, pp. 262 (18).
[24]
J. Amann, A. Borrmann, L.O. Center, B. Gladbach, Creating a 3D-BIM-Compliant Road Design Based on IFC Alignment Originating From an OKSTRA-Accordant 2D Road Design Using the TUM Open Infra Platform and the OKSTRA Class Library, 2015.
[25]
A. Borrmann, T.H. Kolbe, A. Donaubauer, H. Steuer, J.R. Jubierre, M. Flurl, Multi-scale geometric-semantic modeling of shield tunnels for GIS and BIM applications, Comp.-Aided Civil Infrastruct. Eng., 30 (2015) 263-281.
[26]
E.J. Jaselskis, Z. Gao, R.C. Walters, Improving transportation projects using laser scanning, J. Construct. Eng. Manage., 131 (2005) 377-384.
[27]
Y. Ji, A. Borrmann, J. Beetz, M. Obergrieer, Exchange of parametric bridge models using a neutral data format, J. Comput. Civil Eng., 27 (2012) 593-606.
[28]
M. Obergriesser, A. Borrman, Infrastructural BIM standardsdevelopment of an information delivery manual for geotechnical design and analysis process, Ework Ebusiness Architect., Eng., Construct. (2012) 581587.
[29]
P. Tang, B. Akinci, Formalization of workflows for extracting bridge surveying goals from laser-scanned data, Autom. Construct., 22 (2012) 306-319.
[30]
J. Camba, M. Contero, G. Salvador-Herranz, Desktop vs. mobile: a comparative study of augmented reality systems for engineering visualizations in education, in: Proceedings of the 2014 IEEE Frontiers in Education Conference (FIE), 2014, pp. 18.
[31]
M. Buesing, M. Cook, Augmented reality comes to physics, Phys. Teach., 51 (2013) 226-228.
[32]
S. Singhal, S. Bagga, P. Goyal, V. Saxena, Augmented chemistry: interactive education system, Int. J. Comp. Appl., 49 (2012) 1-5.
[33]
H.K. Wu, S.W.Y. Lee, H.Y. Chang, J.C. Liang, Current status, opportunities and challenges of augmented reality in education, Comp. Educ., 62 (2013) 41-49.
[34]
N.M.M. Zainuddin, H.B. Zaman, A. Ahmad, A participatory design in developing prototype an augmented reality book for deaf students, in: 2010 Second International Conference on Computer Research and Development, 2010, pp. 400404.
[35]
M. Billinghurst, A. Duenser, Augmented reality in the classroom, Computer, 45 (2012) 56-63.
[36]
L.M. Qassem, H.A. Hawai, S.A. Shehhi, M.J. Zemerly, J.W. Ng, Air-edutech: augmented immersive reality (air) technology for high school chemistry education, in: 2016 IEEE Global Engineering Education Conference (EDUCON), 2016, pp. 842847.
[37]
G. Welch, E. Foxlin, Motion tracking: no silver bullet, but a respectable arsenal, IEEE Comput. Graph. Appl., 22 (2002) 24-38.
[38]
V. Lepetit, P. Fua, Monocular model-based 3D tracking of rigid objects, Found. Trends. Comput. Graph. Vis., 1 (2005) 1-89.
[39]
H. Kato, M. Billinghurst, Marker tracking and hmd calibration for a video-based augmented reality conferencing system, in: The 2nd International Workshop on Augmented Reality, 1999, San Francisco, CA, USA, 1999.
[40]
U. Neumann, A. Majoros, Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance, in: Proceedings or Virtual Reality Annual International Symposium, Atlanta, GA, USA, 1998.
[41]
C. Stauffer, W.E.L. Grimson, Learning patterns of activity using real-time tracking, IEEE Trans. Pattern Anal. Mach. Intell., 22 (2000) 747-757.
[42]
S.K. Zhou, R. Chellappa, B. Moghaddam, Visual tracking and recognition using appearance-adaptive models in particle filters, IEEE Trans. Image Process., 13 (2004) 1491-1506.
[43]
J. Quarles, S. Lampotang, I. Fischler, P. Fishwick, B. Lok, Collocated AAR: augmenting after action review with mixed reality, in: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, September 2008, pp. 107116.
[44]
S. Wursthorn, A.H. Coelho, G. Staub, Applications for mixed reality, in: XXth ISPRS Congress, Istanbul, Turkey, July 2004, pp. 1223.
[45]
C.E. Hughes, C.B. Stapleton, D.E. Hughes, E.M. Smith, Mixed reality in education, entertainment, and training, IEEE Comp. Graph. Appl., 25 (2005) 24-30.
[46]
K. Fast, T. Gifford, R. Yancey, Virtual training for welding, in: Third IEEE and ACM International Symposium on Mixed and Augmented Reality, 2004, ISMAR 2004, IEEE, 2004 November, pp. 298299.
[47]
D. Mller, J.M. Ferreira, MARVEL: a mixed reality learning environment for vocational training in mechatronics, in: Proceedings of the Technology Enhanced Learning International Conference (TEL'03), Milan, Italy, November 2003.
[48]
D.N.E. Phon, M.B. Ali, N.D.A. Halim, Collaborative augmented reality in education: a review, in: 2014 International Conference on Teaching and Learning in Computing and Engineering (LaTiCE), 2014, pp. 7883.
[49]
M. Billinghurst, H. Kato, I. Poupyrev, The MagicBook: a transitional AR interface, Comp. Graph., 25 (2001) 745-753.
[50]
N. Taketa, K. Hayashi, H. Kato, S. Noshida, Virtual pop-up book based on augmented reality, in: Symposium on Human Interface and the Management of Information, Springer, Berlin, Heidelberg, July 2007, pp. 475484.
[51]
B. Kraut, J. Jeknic, Improving education experience with augmented reality (AR), in: 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2015, pp. 755760.
[52]
M.W. Bazzaza, B.A. Delail, M.J. Zemerly, J.W.P. Ng, IARBOOK: An immersive augmented reality system for education, in: 2014 International Conference on Teaching, Assessment and Learning (TALE), 2014, pp. 495498.
[53]
R. Wojciechowski, W. Cellary, Evaluation of learners attitude toward learning in ARIES augmented reality environments, Comp. Educ., 68 (2013) 570-585.
[54]
N. Enyedy, J.A. Danish, G. Delacruz, M. Kumar, Learning physics through play in an augmented reality environment, Int. J. Comp.-Supp. Collab. Learn., 7 (2012) 347-378.
[55]
W. Matcha, D.R.A. Rambli, Preliminary Investigation on the Use of Augmented Reality in Collaborative Learning, Springer, Berlin Heidelberg, 2011.
[56]
S. Cuendet, Q. Bonnard, S. Do-Lenh, P. Dillenbourg, Designing augmented reality for the classroom, Comp. Educ., 68 (2013) 557-569.
[57]
M. Dunleavy, C. Dede, Augmented Reality Teaching and Learning, Springer, New York, NY, 2014.
[58]
N. Li, Y.X. Gu, L. Chang, H.B.L. Duh, Influences of AR-supported simulation on learning effectiveness in face-to-face collaborative learning for physics, in: 2011 11th IEEE International Conference on Advanced Learning Technologies (ICALT), IEEE, 2011, pp. 320322.
[59]
H. Alhumaidan, K. Lo, A. Selby, Co-design of augmented reality book for collaborative learning experience in primary education, SAI Intell. Syst. Conf. (IntelliSys) (2015) 427-430.
[60]
W. Matcha, D.R.A. Rambli, Design consideration for augmented reality book-based application for collaborative learning environment, in: 2012 International Conference on Computer Information Science (ICCIS), vol. 2, 2012, pp. 11231126.
[61]
P. Vate-U-Lan, Augmented reality 3d pop-up children book: Instructional design for hybrid learning, in: 2011 5th IEEE International Conference on e-Learning in Industrial Electronics (ICELIE), 2011, pp. 95100.
[62]
P. Vate-U-Lan, An augmented reality 3d pop-up book: the development of a multimedia project for English language teaching, in: 2012 IEEE International Conference on Multimedia and Expo, 2012, pp. 890895.
[63]
P.S. Dunston, D.H. Shin, Key areas and issues for augmented reality applications on construction sites, Mixed Reality Architect., Des. Construct. (2009) 157-170.
[64]
A.H. Behzadan, V.R. Kamat, Visualization of construction graphics in outdoor augmented reality, in: Proceedings of the 37th Conference on Winter Simulation, Winter Simulation Conference, 2005, pp. 19141920.
[65]
H. Xue, H. Quan, X. Song, M. Wu, Construction of simulation environment based on augmented reality technique, in: Asiasim, Springer, 2013.
[66]
S.J. Henderson, S. Feiner, Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret, in: Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009, 2009, pp. 135144.
[67]
C.-S. Park, D.-Y. Lee, O.-S. Kwon, X. Wang, A framework for proactive construction defect management using BIM, augmented reality and ontology-based data collection template, Autom. Construct., 33 (2013) 61-71.
[68]
C. Woodward, M. Hakkarainen, O. Korkalo, T. Kantonen, M. Aittala, K. Rainio, K. Khknen, Mixed reality for mobile construction site, in: 10th International Conference on Construction Applications of Virtual Reality, 2010, pp. 110.
[69]
A.H. Behzadan, V.R. Kamat, Interactive augmented reality visualization for improved damage protection and maintenance of underground infrastructure, in: Construction Research Congress, 2009, pp. 12141222.
[70]
S. Talmaki, V.R. Kamat, Real-time hybrid virtuality for prevention of excavation related utility strikes, J. Comput. Civil Eng., 28 (2014) 04014001.
[71]
V.R. Kamat, J.C. Martinez, M. Fischer, M. Golparvar-Fard, F. Pea-Mora, S. Savarese, Research in visualization techniques for field construction, J. Construct. Eng. Manage., 137 (2010) 853-862.
[72]
S. Rankohi, L. Waugh, Review and analysis of augmented reality literature for construction industry, Visual. Eng., 1 (2013) 1-18.
[73]
S. Siltanen, V. Oksman, M. Ainasoja, User-centered design of augmented reality interior design service, Int. J. Arts Sci., 6 (2013) 547.
[74]
A. Malkawi, R. Srinivasan, Multimodal humancomputer interaction for immersive visualization: integrating speechgesture recognitions and augmented reality for indoor environments, in: Proceedings of the Seventh IASTED Conference on Computer Graphics and Imaging, 2004, pp. 171175.
[75]
S. Talmaki, V.R. Kamat, H. Cai, Geometric modeling of geospatial data for visualization-assisted excavation, Adv. Eng. Inf., 27 (2013) 283-298.
[76]
A. Shirazi, A.H. Behzadan, Content delivery using augmented reality to enhance students performance in a building design and assembly project, Adv. Eng. Educ., 4 (2015) 1-24.
[77]
R. Molich, J. Nielson, Improving a human-computer dialogue, Commun. ACM 33 (3) (1990) 338348.
[78]
J. Nielsen, R. Molich, Heuristic evaluation of user interfaces, in: Proceedings of the ACM Computer & Human Interaction Conference, Seattle, WA, 15 April, 1990, pp. 249256.
[79]
J. Vlissides, R. Helm, R. Johnson, E. Gamma, Design Patterns: Elements of Reusable Object-Oriented Software, vol. 49(120), Addison-Wesley, Reading, 1995, p. 11.
[80]
T. Akenine-Mller, E. Haines, N. Hoffman, Real-Time Rendering, CRC Press, 2008.
[81]
M. Alexa, Recent advances in mesh morphing, in: Computer Graphics Forum, vol. 21(2), Blackwell Publishers Ltd., 2002, pp. 173198.
[82]
F.D. Davis, Perceived usefulness, perceived ease of use, and user acceptance of information technology, MIS Quart. (1989) 319-340.
[83]
B.J. Winer, D.R. Brown, K.M. Michels, Statistical Principles in Experimental Design, McGraw-Hill Humanities, 1991.
[84]
U. Neumann, S. You, Natural feature tracking for augmented reality, IEEE Trans. Multim., 1 (1999) 53-64.
[85]
R. Radkowski, J. Oliver, A hybrid tracking solution to enhance natural interaction in marker-based augmented reality applications best paper award, in: The Sixth International Conference on Advances in Computer-Human Interactions (ACHI 2013), Nice, France, February 2013.
[86]
F.F. Bermudez, C. Santana Diaz, S. Ward, R. Radkowski, T. Garrett, J. Oliver, Comparison of natural feature descriptors for rigid-object tracking for real-time augmented reality, in: Proceedings of the ASME 2014 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2014, August 2014.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Advanced Engineering Informatics
Advanced Engineering Informatics  Volume 34, Issue C
October 2017
150 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 October 2017

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media