research-article

ClimbVis: Investigating In-situ Visualizations for Understanding Climbing Movements by Demonstration

Authors:

Felix Kosmalla,

Florian Daiber,

Frederik Wiehr,

Antonio KrügerAuthors Info & Claims

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

Pages 270 - 279

https://doi.org/10.1145/3132272.3134119

Published: 17 October 2017 Publication History

Abstract

Rock climbing involves complex movements and therefore requires guidance when acquiring a new technique. The classic approach is mimicking the movements of a more experienced climber. However, the trainee has to remember every nuance of the climb, since the sequence of movements cannot be performed in parallel to the experienced climber. As a solution to this problem, we present a video recording and replay system for climbing. The replay component allows for different in-situ video feedback methods. We investigated the video feedback component of the system by studying two example visualization techniques, i.e. a life-sized in-place projection and a real-time third-person view of the climber, augmented by a video showing a successful ascent. The latter is presented to the user on both Google Glass and a projected display. The results indicate that a life-sized projection was perceived as easiest to follow, while most of the climbers had problems with the context switches between the augmented video and the climbing wall. These findings can aid in the design of assistance systems that teach complex movements.

References

[1]

Anderson, D. I., Magill, R. A., Sekiya, H., and Ryan, G. Support for an Explanation of the Guidance Effect in Motor Skill Learning Support for an Explanation of the Guidance Effect in Motor Skill Learning. Journal of motor behavior 37, 3 (2005), 231--238.

[2]

Anderson, F., Grossman, T., Matejka, J., and Fitzmaurice, G. YouMove: Enhancing Movement Training with an Augmented Reality Mirror. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13 (2013), 311--320.

Digital Library

[3]

Boyer, E., Miltenberger, R. G., Batsche, C., Fogel, V., and LeBlanc, L. Video modeling by experts with video feedback to enhance gymnastics skills. Journal of applied behavior analysis 42, 4 (2009), 855--860.

[4]

Daiber, F., Kosmalla, F., and Krüger, A. Bouldar: Using augmented reality to support collaborative boulder training. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, CHI EA '13, ACM (New York, NY, USA, 2013), 949--954.

Digital Library

[5]

Groom, R., and Cushion, C. Coaches perceptions of the use of video analysis: A case study. Insight 7, 3 (2004), 56--58.

[6]

Groom, R., and Cushion, C. Using of video based coaching with players: A case study. International Journal of Performance Analysis in Sport 5, 3 (2005), 40--46.

[7]

Guadagnoli, M., Holcomb, W., and Davis, M. The efficacy of video feedback for learning the golf swing. Journal of Sports Sciences 20, 8 (2002), 615--622.

[8]

Hämäläinen, P. Interactive video mirrors for sports training. In Proceedings of the Third Nordic Conference on Human-computer Interaction, NordiCHI '04, ACM (New York, NY, USA, 2004), 199--202.

Digital Library

[9]

Kajastila, R., and Hämäläinen, P. Augmented climbing: Interacting with projected graphics on a climbing wall. In Proceedings of the Extended Abstracts of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI EA '14, ACM (New York, NY, USA, 2014), 1279--1284.

Digital Library

[10]

Kajastila, R., Holsti, L., and Hämäläinen, P. The Augmented Climbing Wall: High-Exertion Proximity Interaction on a Wall-Sized Interactive Surface. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (2016), 758--769.

Digital Library

[11]

Kosmalla, F., Daiber, F., and Krüger, A. Climbsense: Automatic climbing route recognition using wrist-worn inertia measurement units. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 2033--2042.

Digital Library

[12]

Kosmalla, F., Wiehr, F., Daiber, F., Krüger, A., and Löchtefeld, M. Climbaware: Investigating perception and acceptance of wearables in rock climbing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, ACM (New York, NY, USA, 2016), 1097--1108.

Digital Library

[13]

Kosmalla, F., Zenner, A., Speicher, M., Daiber, F., Herbig, N., and Krüger, A. Exploring rock climbing in mixed reality environments. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA '17, ACM (New York, NY, USA, 2017), 1787--1793.

Digital Library

[14]

Ladha, C., Hammerla, N. Y., Olivier, P., and Plötz, T. Climbax: Skill assessment for climbing enthusiasts. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '13, ACM (New York, NY, USA, 2013), 235--244.

Digital Library

[15]

Lopera, M., Porcari, J. P., Steffen, J., Doberstein, S., and Foster, C. Effects of indoor rock climbing on muscular strength, endurance, and flexibility characteristics of novice climbers. Medicine and science in sports and exercise 40, 5 (May 2008).

[16]

Marquardt, Z., Beira, J. a., Em, N., Paiva, I., and Kox, S. Super mirror: A kinect interface for ballet dancers. In CHI '12 Extended Abstracts on Human Factors in Computing Systems, CHI EA '12, ACM (New York, NY, USA, 2012), 1619--1624.

Digital Library

[17]

Mencarini, E., Leonardi, C., De Angeli, A., and Zancanaro, M. Design opportunities for wearable devices in learning to climb. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction, NordiCHI '16, ACM (New York, NY, USA, 2016), 48:1--48:10.

Digital Library

[18]

Mermier, C. M., Janot, J. M., Parker, D. L., and Swan, J. G. Physiological and anthropometric determinants of sport climbing performance. British Journal of Sports Medicine 34, 5 (2000), 359--365.

[19]

Procyk, J., Neustaeder, C., and Schiphorst, T. Amateur ice hockey coaching and the role of video feedback. In Proceedings of Graphics Interface 2015, GI 2015, Canadian Human-Computer Communications Society (Toronto, Ontario, Canada, 2015), 179--186.

[20]

Rikli, R., and Smith, G. Videotape feedback effects on tennis serving form. Perceptual and Motor Skills 50, 3, Pt 1 (Jun 1980), 895--901.

[21]

Sigrist, R., Rauter, G., Riener, R., and Wolf, P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomic Bulletin & Review 20, 1 (2013), 21--53.

[22]

Sodhi, R., Benko, H., and Wilson, A. Lightguide: Projected visualizations for hand movement guidance. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2012), 179--188.

Digital Library

[23]

Sousa, M., Vieira, J., Medeiros, D., Arsenio, A., and Jorge, J. SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback. Proceedings of the 21st International Conference on Intelligent User Interfaces - IUI '16 (2016), 175--185.

Digital Library

[24]

Tang, R., Alizadeh, H., Tang, A., Bateman, S., and Jorge, J. A. Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises. Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA '14 (2014), 1651--1656.

[25]

Wiehr, F., Kosmalla, F., Daiber, F., and Krüger, A. betacube: Enhancing training for climbing by a self-calibrating camera-projection unit. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA '16, ACM (2016), 1998--2004.

[26]

Wieringen, P. V., Emmen, H., Bootsma, R., Hoogesteger, M., and Whiting, H. The effect of video-feedback on the learning of the tennis service by intermediate players. Journal of Sports Sciences 7, 2 (1989), 153--162.

Cited By

Kojima YMiyafuji STashiro YKiyofuji SKoike H(2024)MR MANE: MR Microsurgical Suturing Skill Acquisition for Novice Using Imitation of ExampleProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656660(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656660
Rastegar Sani M(2024)Situated Instructions and Guidance For Self-training and Self-coaching in SportsAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686644(1-4)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686644
Rastegar Sani MZollmann SLanglotz T(2024)Train Me: Exploring Mobile Sports Capture and Replay for Immersive Sports CoachingAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680239(1-7)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680239
Show More Cited By

Index Terms

ClimbVis: Investigating In-situ Visualizations for Understanding Climbing Movements by Demonstration
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

betaCube: Enhancing Training for Climbing by a Self-Calibrating Camera-Projection Unit
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

In rock climbing, discussing climbing techniques with others to master a specific route and getting practical advice from more experienced climbers is an inherent part of the culture and tradition of the sport. Spatial information, such as the position ...
The Augmented Climbing Wall: High-Exertion Proximity Interaction on a Wall-Sized Interactive Surface
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present the design and evaluation of the Augmented Climbing Wall (ACW). The system combines computer vision and interactive projected graphics for motivating and instructing indoor wall climbing. We have installed the system in a commercial climbing ...
InterPoser: Visualizing Interpolated Movements for Bouldering Training
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Bouldering is an urban form of rock climbing that requires precise and complex movement. Similarly to other sports, the simplest way to learn bouldering skill is to mimic professional's motion. However, ordinary beginner boulders cannot learn to coaches,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

October 2017

504 pages

ISBN:9781450346917

DOI:10.1145/3132272

General Chairs:
Sriram Subramanian
University of Sussex, UK
,
Jürgen Steimle
Saarland University, Germany
,
Program Chairs:
Raimund Dachselt
Technische Universität Dresden, Germany
,
Diego Martinez Plasencia
University of Sussex, UK
,
Tovi Grossman
Autodesk Research

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ISS '17

Sponsor:

SIGCHI

ISS '17: Interactive Surfaces and Spaces

October 17 - 20, 2017

Brighton, United Kingdom

Acceptance Rates

ISS '17 Paper Acceptance Rate 32 of 119 submissions, 27%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
512
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)14

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kojima YMiyafuji STashiro YKiyofuji SKoike H(2024)MR MANE: MR Microsurgical Suturing Skill Acquisition for Novice Using Imitation of ExampleProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656660(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656660
Rastegar Sani M(2024)Situated Instructions and Guidance For Self-training and Self-coaching in SportsAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686644(1-4)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686644
Rastegar Sani MZollmann SLanglotz T(2024)Train Me: Exploring Mobile Sports Capture and Replay for Immersive Sports CoachingAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680239(1-7)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680239
Kotte HDaiber FKravcik MDuong-Trung N(2024)FitSight: Tracking and Feedback Engine for Personalized Fitness TrainingProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659547(223-231)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3627043.3659547
Yu XLee BSedlmair M(2024)Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642143(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642143
Diller FScheuermann GWiebel A(2024)Visual Cue Based Corrective Feedback for Motor Skill Training in Mixed Reality: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322799930:7(3121-3134)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3227999
Geisen MRaab MJansen PKlatt S(2024)Embodied mental rotation ability in open- and closed-skill sports: pilot study with a new virtual paradigmExperimental Brain Research10.1007/s00221-023-06753-z242:3(653-664)Online publication date: 20-Jan-2024
https://doi.org/10.1007/s00221-023-06753-z
Beltrán Beltrán RRichter JKöstermeyer GHeinkel U(2023)Climbing Technique Evaluation by Means of Skeleton Video Stream AnalysisSensors10.3390/s2319821623:19(8216)Online publication date: 1-Oct-2023
https://doi.org/10.3390/s23198216
Geisen MFox AKlatt S(2023)VR as an Innovative Learning Tool in Sports EducationApplied Sciences10.3390/app1304223913:4(2239)Online publication date: 9-Feb-2023
https://doi.org/10.3390/app13042239
Postma DKarahanoğlu Avan Delden RReidsma D(2023)The Cost of Reward: A Critical Reflection on the `What', `How', and `Why' of Gamification for Motivation in SportsCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616102(222-224)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616102
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents