skip to main content
10.1145/3610661.3620663acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

Melody Slot Machine II: Sound Enhancement with Multimodal Interface

Published: 09 October 2023 Publication History

Abstract

We previously developed Melody Slot Machine, which can replace melody segments with other variation segments. However, even if the melody segments of each part are replaced with other variations in a piece of music consisting of multiple parts, a musical novice may not notice the changes in melodies. Thus, we are developing Melody Slot Machine II, which uses information from the multimodal interface, such as the user’s touchscreen operation and head direction, to emphasize the sound of the part to which the user is attentively listening, making it easier to notice changes in melodies.

Supplementary Material

MP4 File (MelodySlotMachine.mp4)
This is the video for demo paper entitled "Melody Slot Machine II: Sound Enhancement with Multimodal Interface".

References

[1]
Masatoshi Hamanaka. 2022. Sound Scope Pad: Controlling a VR Concert with Natural Movement. In Proceedings of the 2022 International Conference on Multimodal Interaction(ICMI ’22). Association for Computing Machinery, New York, NY, USA, 730–732. https://doi.org/10.1145/3536221.3557038
[2]
Masatoshi Hamanaka. 2022. Sound Scope Phone: Focusing Parts by Natural Movement. In ACM SIGGRAPH 2022 Appy Hour(SIGGRAPH ’22). Association for Computing Machinery, New York, NY, USA, Article 5, 2 pages. https://doi.org/10.1145/3532723.3535465
[3]
Masatoshi Hamanaka. 2023. Melody Slot Machine HD. In ACM SIGGRAPH 2023 Appy Hour(SIGGRAPH ’23). Association for Computing Machinery, New York, NY, USA, Article 3, 2 pages. https://doi.org/10.1145/3588427.3595356
[4]
Masatoshi Hamanaka, Keiji Hirata, and Satoshi Tojo. 2023. Implementation of melodic morphing based on generative theory of tonal music. Journal of New Music Research 51, 1 (2023), 86–102. https://doi.org/10.1080/09298215.2023.2169713
[5]
Masatoshi Hamanaka, Takayuki Nakatsuka, and Shigeo Morishima. 2019. Melody Slot Machine. In ACM SIGGRAPH 2019 Emerging Technologies(SIGGRAPH ’19). Association for Computing Machinery, New York, NY, USA, Article 19, 2 pages. https://doi.org/10.1145/3305367.3327985
[6]
Fred Lerdahl and Ray Jackendoff. 1983. A generative theory of tonal music. The MIT Press, Cambridge. MA.
[7]
Takayuki Nakatsuka, Yukitaka Tsuchiya, Masatoshi Hamanaka, and Shigeo Morishima. 2021. Audio-Oriented Video Interpolation Using Key Pose. International Journal of Pattern Recognition and Artificial Intelligence 35, 16 (2021), 23 pages.

Cited By

View all

Index Terms

  1. Melody Slot Machine II: Sound Enhancement with Multimodal Interface

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '23 Companion: Companion Publication of the 25th International Conference on Multimodal Interaction
    October 2023
    434 pages
    ISBN:9798400703218
    DOI:10.1145/3610661
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 October 2023

    Check for updates

    Author Tags

    1. generative theory of tonal music (gttm)
    2. melodic morphing method
    3. time-span tree

    Qualifiers

    • Demonstration
    • Research
    • Refereed limited

    Funding Sources

    • JSPS KAKENHI

    Conference

    ICMI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 25
      Total Downloads
    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 06 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media