abstract

Notational Communication with Co-creative Systems: Studying Improvements to Musical Coordination

Author:

Prashanth Thattai RavikumarAuthors Info & Claims

C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition

Pages 518 - 523

https://doi.org/10.1145/3059454.3078702

Published: 22 June 2017 Publication History

Abstract

This research examines the impact of differences in extra-musical notational communication on a musician's co-creative experience with a music improvisation system. The method involves the development of musical improvisation agent technologies that support mixed-initiative communication and the use of mixed methods for studying the musician's co-creative engagement. The expected contributions are the findings about the impact of differences in extra-musical communication on the co-creative engagement with co-improvisation systems.

References

[1]

1. Anna Rita Addessi, Francois Pachet, and Roberto Caterina. 2004. Children Confronting an Interactive Musical System. In Proceedings of 8th International Conference on Music Perception & Cognition (ICMPC8), Adelaide.

[2]

2. Ritwik Banerji. 2012. Maxine's Turing test--a player-program as co-ethnographer of socio-aesthetic interaction in improvised music. In Proceedings of the Artificial Intelligence and Interactive Digital Entertainment (AIIDE'12) Conference.

[3]

3. Michele Biasutti, Eleonora Concina, David Wasley, and Aaron Williamon. 2016. Music Regulators in Two String Quartets: A Comparison of Communicative Behaviors Between Low-And High-Stress Performance Conditions. Frontiers in Psychology 7 (2016).

[4]

4. Linda Candy and Ernest Edmonds. 2002. Modeling co-creativity in art and technology. In Proceedings of the 4th conference on Creativity & cognition. ACM, 134--141.

Digital Library

[5]

5. Marcelo Cicconet, Mason Bretan, and Gil Weinberg. 2012. Visual cues-based anticipation for percussionist-robot interaction. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction (HRI'12). ACM, Boston, Massachusetts, USA, 117--118.

Digital Library

[6]

6. Jane W. Davidson. 2012. Bodily Movement and Facial Actions in Expressive Musical Performance By Solo and Duo Instrumentalists: Two Distinctive Case Studies. Psychology of Music 40, 5 (2012), 595--633.

[7]

7. Nicholas Davis. 2013. Human-computer co-creativity: blending human and computational creativity. In Ninth Artificial Intelligence and Interactive Digital Entertainment Conference.

[8]

8. Alexandre RJ François, Elaine Chew, and Dennis Thurmond. 2007. Mimi-A Musical Improvisation System That Provides Visual Feedback To the Performer. Technical Report 07--889. University of Southern California Computer Science Department.

[9]

9. William T Hsu and Marc H Sosnick. 2009. Evaluating Interactive Music Systems: An HCI Approach. In Proceedings of the International Conference on New Interfaces for Musical Expression. 25--28.

[10]

10. Anna Aurora Kantosalo, Jukka Mikael Toivanen, Hannu Tauno Tapani Toivonen, and others. 2015. Interaction Evaluation for Human-Computer Co-Creativity. In Proceedings of the Sixth International Conference on Computational Creativity.

[11]

11. Satoshi Kawase. 2014. Gazing Behavior and Coordination During Piano Duo Performance. Attention, Perception, & Psychophysics 76, 2 (2014), 527--540.

[12]

12. Angelica Lim, Takeshi Mizumoto, Tetsuya Ogata, and Hiroshi G Okuno. 2012. A Musical Robot That Synchronizes With a Coplayer Using Non-Verbal Cues. Advanced Robotics 26, 3--4 (2012), 363--381.

[13]

13. Louis McCallum and Peter W McOwan. 2014. Shut up and play: A musical approach to engagement and social presence in Human-Robot Interaction. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 949--954.

[14]

14. Dave Murray-Rust and Alan Smaill. 2011. Towards a Model of Musical Interaction and Communication. Artificial Intelligence 175, 9 (2011), 1697--1721.

Digital Library

[15]

15. Jérôme Nika and Marc Chemillier. 2012. Improtek: integrating harmonic controls into improvisation in the filiation of OMax. In Proceedings of the International Computer Music Conference (ICMC'12). Ljubljana, Slovenia, 180--187.

[16]

16. Isaac Schankler, Alexandre Francois, and Elaine Chew. 2011. Preparing for the Unpredictable: Identifying Successful Performance Strategies in Human-Machine Improvisation. In Proceedings of the International Symposium on Performance Science. Toronto, Canada, 157--162.

[17]

17. Gil Weinberg, Brian Blosser, Trishul Mallikarjuna, and Aparna Raman. 2009. The Creation of a Multi-Human, Multi-Robot Interactive Jam Session. In Proceedings of 10th International Conference on New Interfaces for Musical Expression (NIME). Pittsburgh, PA, USA, 70--73.

[18]

18. Aaron Williamon and Jane W. Davidson. 2002. Exploring Co-Performer Communication. Musicae Scientiae 6, 1 (2002), 53--72.

[19]

19. Lonce Wyse and Jude Yew. 2014. A Real-Time Score for Collaborative Just-In-Time Composition. Organised Sound 19, 03 (2014), 260--267.

[20]

20. Georgios N Yannakakis, Antonios Liapis, and Constantine Alexopoulos. 2014. Mixed-initiative co-creativity. In Proceedings of the 9th Conference on the Foundations of Digital Games. Society for the Advancement of the Science of Digital Games, Liberty of the Seas, Caribbean.

Cited By

Williford BRay SKoh JCherian JTaele PHammond T(2023)Exploring Creativity Support for Concept Art IdeationExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585684(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585684
Zhang CYao CLiu JZhou ZZhang WLiu LYing FZhao YWang G(2021)StoryDrawerExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451785(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451785
Lin YGuo JChen YYao CYing FBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through SketchProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376258(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376258
Show More Cited By

Index Terms

Notational Communication with Co-creative Systems: Studying Improvements to Musical Coordination
1. Human-centered computing

Recommendations

In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Collaboration is built on trust, and establishing trust with a creative Artificial Intelligence is difficult when the decision process or internal state driving its behaviour isn't exposed. When human musicians improvise together, a number of extra-...
Supporting Non-Musicians? Creative Engagement with Musical Interfaces
C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition

This paper reports on a study which sets out to examine the process of creative engagement of individual non-musicians when interacting with interactive musical systems (IMSs), and to identify features of IMSs that may support non-musician's creative ...
Storage and Playback Device for Creative Dance with Kinect
ACIT '19: Proceedings of the 7th ACIS International Conference on Applied Computing and Information Technology

The purpose of this study is to develop a device that can make the choreography of dance easily.

Since ancient times, people have given meanings and various purposes to dance as an action to music such as expressing emotions, praying to God, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition

June 2017

584 pages

ISBN:9781450344036

DOI:10.1145/3059454

General Chairs:
David A. Shamma
Centrum Wiskunde & Informatica (CWI)
,
Jude Yew
National University of Singapore
,
Program Chair:
Brian Bailey
University of Illinois at Urbana-Champaign

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2017

Check for updates

Author Tags

Qualifiers

Abstract

Conference

C&C '17

Sponsor:

SIGCHI

C&C '17: Creativity and Cognition

June 27 - 30, 2017

Singapore, Singapore

Acceptance Rates

C&C '17 Paper Acceptance Rate 27 of 94 submissions, 29%;

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
196
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Williford BRay SKoh JCherian JTaele PHammond T(2023)Exploring Creativity Support for Concept Art IdeationExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585684(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585684
Zhang CYao CLiu JZhou ZZhang WLiu LYing FZhao YWang G(2021)StoryDrawerExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451785(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451785
Lin YGuo JChen YYao CYing FBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through SketchProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376258(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376258
McCormack JGifford THutchings PLlano Rodriguez MYee-King Md'Inverno MBrewster SFitzpatrick GCox AKostakos V(2019)In a Silent WayProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300268(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300268

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten