demonstration

P.I.A.N.O.: enhancing instrument learning via interactive projected augmentation

Authors:

Michael WeberAuthors Info & Claims

UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication

Pages 75 - 78

https://doi.org/10.1145/2494091.2494113

Published: 08 September 2013 Publication History

Get Access

Abstract

P.I.A.N.O. aims to support learning to play piano with a steep learning curve. In order to achieve this, traditional, hard-to-learn music notation is substituted for an alternative representation of a composition, which is projected directly onto the piano. Furthermore, we propose three different learning modes which support the natural learning process, incorporate live feedback and performance evaluation, as well as the augmentation of the system with aspects of gamification to achieve early experiences of success and prolonged motivation.

Supplementary Material

suppl.mov (comdv131.mp4)

Supplemental video

Download
92.60 MB

References

[1]

Activision. Guitar hero. http://guitarhero.com/, 2013.

Google Scholar

[2]

Löchtefeld, M., Gehring, S., Jung, R., and Krüger, A. Using Mobile Projection to Support Guitar Learning. In Proc. SG '11, ACM (2011).

Digital Library

Google Scholar

[3]

Lokovic, T. midi.net library. http://code.google.com/p/midi-dot-net/, 2013.

Google Scholar

[4]

Schnotz, W., and Kürschner, C. External and internal representations in the acquisition and use of knowledge: visualization effects on mental model construction. Instructional Science 36 (2008), 175--190.

Crossref

Google Scholar

[5]

Sweller, J., van Merriënboer, J. J. G., and Paas, F. G. W. C. Cognitive Architecture and Instructional Design. Educational Psychology Review 10 (1998), 251--296.

Crossref

Google Scholar

[6]

Synthesia LLC. Synthesia. http://www.synthesiagame.com/, 2013.

Google Scholar

[7]

Takegawa, Y., Terada, T., and Tsukamoto, M. Design and Implementation of a Piano Practice Support System using a real-time Fingering Recognition Technique. In Proc. ICMC '11 (2011).

Google Scholar

[8]

Xiao, X., and Ishii, H. Duet for Solo Piano: MirrorFugue for Single User Playing with Recorded Performances. In CHI EA '11, ACM (2011).

Digital Library

Google Scholar

Cited By

View all

Nijs LBehzadaval B(2024)Laying the Foundation for Augmented Reality in Music EducationIEEE Access10.1109/ACCESS.2024.342769812(100628-100645)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3427698
Deja JMayer SČopič Pucihar KKljun M(2022)A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?Proceedings of the ACM on Human-Computer Interaction10.1145/35677196:ISS(226-253)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567719
Deja J(2022)Piano Learning and Improvisation through Adaptive Visualisation and Digital AugmentationCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571464(41-45)Online publication date: 20-Nov-2022
https://dl.acm.org/doi/10.1145/3532104.3571464
Show More Cited By

Index Terms

P.I.A.N.O.: enhancing instrument learning via interactive projected augmentation
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
  2. Education
    1. Computer-assisted instruction
2. Information systems
  1. Information retrieval
    1. Specialized information retrieval
      1. Multimedia and multimodal retrieval
        Music retrieval

Recommendations

piARno - An Augmented Reality Piano Tutor
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction

Music is an important way for humans to express themselves, unite, relate, and gain enjoyment. While many people desire for themselves, or their loved ones, to achieve some form of musical prowess, the discipline remains encumbered by low motivation ...
P.I.A.N.O.: Faster Piano Learning with Interactive Projection
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

Learning to play the piano is a prolonged challenge for novices. It requires them to learn sheet music notation and its mapping to respective piano keys, together with articulation details. Smooth playing further requires correct finger postures. The ...
MirrorFugue iii: conjuring the recorded pianist
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

The body channels rich layers of information when playing music, from intricate manipulations of the instrument to vivid personifications of expression. But when music is captured and replayed across distance and time, the performer's body is rarely ...

Comments

Information & Contributors

Information

Published In

UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication

September 2013

1608 pages

ISBN:9781450322157

DOI:10.1145/2494091

General Chairs:
Friedemann Mattern
ETH Zurich, CH
,
Silvia Santini
TU Darmstadt, DE
,
Program Chairs:
John F. Canny
UC Berkeley, US
,
Marc Langheinrich
Università della Svizzera italiana, CH
,
Jun Rekimoto
University of Tokyo, JP

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

UbiComp '13

Sponsor:

SIGMOBILE
University of Florida
SIGCHI

UbiComp '13: The 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 8 - 12, 2013

Zurich, Switzerland

Acceptance Rates

UbiComp '13 Adjunct Paper Acceptance Rate 254 of 399 submissions, 64%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
775
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nijs LBehzadaval B(2024)Laying the Foundation for Augmented Reality in Music EducationIEEE Access10.1109/ACCESS.2024.342769812(100628-100645)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3427698
Deja JMayer SČopič Pucihar KKljun M(2022)A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?Proceedings of the ACM on Human-Computer Interaction10.1145/35677196:ISS(226-253)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567719
Deja J(2022)Piano Learning and Improvisation through Adaptive Visualisation and Digital AugmentationCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571464(41-45)Online publication date: 20-Nov-2022
https://dl.acm.org/doi/10.1145/3532104.3571464
Chen Y(2022)Interactive piano training using augmented reality and the Internet of ThingsEducation and Information Technologies10.1007/s10639-022-11443-428:6(6373-6389)Online publication date: 11-Nov-2022
https://doi.org/10.1007/s10639-022-11443-4
Matsui RKumaki MTakegawa YHirata KYanagisawa Y(2022)Proposal of a Piano Learning Support System Considering Gamification Based on ReconsolidationLearning and Collaboration Technologies. Designing the Learner and Teacher Experience10.1007/978-3-031-05657-4_9(113-125)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-05657-4_9
Deja J(2021)Adaptive Visualisations Using Spatiotemporal and Heuristic Models to Support Piano LearningProceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450613.3459656(286-290)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3450613.3459656
Deja J(2021)Encouraging Improvisation in Piano LearningUsing Adaptive Visualisations and Spatiotemporal ModelsAdjunct Publication of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447527.3474865(1-4)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447527.3474865
Rigby LWünsche BShaw A(2020)piARno - An Augmented Reality Piano TutorProceedings of the 32nd Australian Conference on Human-Computer Interaction10.1145/3441000.3441039(481-491)Online publication date: 2-Dec-2020
https://dl.acm.org/doi/10.1145/3441000.3441039
Khulusi RKusnick JMeinecke CGillmann CFocht JJänicke S(2020)A Survey on Visualizations for Musical DataComputer Graphics Forum10.1111/cgf.1390539:6(82-110)Online publication date: 5-Mar-2020
https://doi.org/10.1111/cgf.13905
Carvalho TCosta CMombach JFerreira CFernandes DSoares F(2020)PETA-System – A Piano Expression Teaching Aid System2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE)10.1109/CCECE47787.2020.9255820(1-5)Online publication date: 30-Aug-2020
https://doi.org/10.1109/CCECE47787.2020.9255820
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

piARno - An Augmented Reality Piano Tutor

P.I.A.N.O.: Faster Piano Learning with Interactive Projection

MirrorFugue iii: conjuring the recorded pianist