A novel approach for time-continuous tension prediction in film soundtracks
Pages 55 - 60
Abstract
Expectation is an important mechanism in shaping the affective experience of music. Central to this process is the concept of musical tension. The temporal evolution of tension during a piece of music is not only responsible for eliciting emotions but may form the basis for novel time-aware search queries in music information retrieval. This paper introduces a method of modelling musical tension based on automatically computed measures of musical complexity, psychoacoustics and musical structure. The approach involves examining time-continuous annotations of tension and constructing models with a number of regression algorithms. Highest performing models when evaluated with the R2 statistic reached 0.68 with Multiple Linear Regression in a 5 dimension feature space. When independently evaluated on unseen music data the system produced an R2 of 0.64.
References
[1]
H. Abdi. Partial least square regression PLS-regression. In Encyclopedia of Measurement and Statistics, volume 1. 2007.
[2]
E. Bigand, S. Filipic, and P. Lalitte. The time course of emotional responses to music. Annals of the New York Academy of Sciences, 1060(1):429--437, 2005.
[3]
G. E. P. Box and D. R. Cox. An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26(2):211--252, 1964.
[4]
V. Burnsed and J. Sochinski. The relationship between dynamics and tension in haydn's symphony 104: A developmental study. Psychomusicology: Music, Mind and Brain, 17(1--2):19--35, 2001.
[5]
D. Cabrera. PSYSOUND: A computer program for psychoacoustical analysis. In Proceedings of the Australian Acoustical Society Conference, volume 24, pages 47--54, 1999.
[6]
M. Chion. Audio-vision: sound on screen. Columbia University Press, 1994.
[7]
E. Coutinho and A. Cangelosi. Musical emotions: Predicting second-by-second subjective feelings of emotion from low-level psychoacoustic features and physiological measurements. Emotion, 11(4):921, 2011.
[8]
V. Dhandhania, J. Abeßer, A. Kruspe, and H. Großman. Automatic and manual annotation of time-varying perceptual properties in movie soundtracks. In Proceedings of the 9th Sound and Music Computing (SMC) Conference, Denmark, 2012.
[9]
T. Eerola, O. Lartillot, and P. Toiviainen. Prediction of multidimensional emotional ratings in music from audio using multivariate regression models. In Proceedings of the 10th International Society for Music Information Retrieval (ISMIR) Conference, pages 621--626, 2009.
[10]
T. Eerola and A. C. North. Expectancy-based model of melodic complexity. In Proceedings of the Sixth International Conference on Music Perception and Cognition. Keele, Staffordshire, UK, 2000.
[11]
M. Farbood. A quantitative, parametric model of musical tension. PhD thesis, Massachusetts Institute of Technology, 2006.
[12]
L. Finnäs. How can musical preferences be modified? a research review. Bulletin of the Council for Research in Music Education, pages 1--58, 1989.
[13]
A. Gabrielsson and E. Lindstrom. The influence of musical structure on emotional expression. In Music and Emotion: Theory and Research, chapter 10, pages 223--248. Oxford University Press, 2001.
[14]
M. Gruhne and C. Dittmar. Comparison of harmonic mid-level representations for genre recognition. In Proc. of the 3rd Workshop on Learning the Semantics of Audio Signals (LSAS), Graz, Austria, pages 91--102, 2009.
[15]
P. W. Holland and R. E. Welsch. Robust regression using iteratively reweighted least-squares. Communications in Statistics - Theory and Methods, 6(9):813--827, 1977.
[16]
D. Huron. Sweet anticipation: Music and the psychology of expectation. MIT Press, 2006.
[17]
Y. E. Kim, D. S. Williamson, and S. Pilli. Towards quantifying the album effect in artist identification. Poster at the International Conference on Music Information Retrieval (ISMIR 2006), Canada, 2006.
[18]
C. L. Krumhansl. A perceptual analysis of mozart's piano sonata k. 282: Segmentation, tension, and musical ideas. Music Perception, 13(3):401--432, 1996.
[19]
C. L. Krumhansl. Music: A link between cognition and emotion. Current Directions in Psychological Science, 11(2):45--50, 2002.
[20]
C. L. Krumhansl and E. J. Kessler. Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. Psychological Review, 89(4):334--368, 1982.
[21]
O. Lartillot and P. Toiviainen. MIR in matlab (II): A toolbox for musical feature extraction from audio. In Proceedings of the 8th International Conference on Music Information Retrieval, pages 237--244, 2007.
[22]
K. Lee. Automatic chord recognition from audio using enhanced pitch class profile. In Proceedings of the International Computer Music Conference (ICMC), New Orleans, USA, 2006.
[23]
F. Lerdahl and C. Krumhansl. Modeling tonal tension. Music Perception, 24(4):329--366, 2007.
[24]
L. B. Meyer. Emotion and meaning in music. The University of Chicago Press, 1961.
[25]
E. Narmour. The analysis and cognition of basic melodic structures: The implication-realization model. University of Chicago Press, 1990.
[26]
E. Narmour. The top-down and bottom-up systems of musical implication: Building on meyer's theory of emotional syntax. Music Perception, 9(1):1--26, 1991.
[27]
R. Panda and R. P. Pavia. Using support vector machines for automatic mood tracking in audio music. In 130th Convention of the Audio Engineering Society, 13--16 May 2011, London, UK, 2011.
[28]
R. Parncutt. Harmony: A psychoacoustical approach. Springer-Verlag Publishing, 1989.
[29]
D. Pressnitzer, S. McAdams, S. Winsberg, and J. Fineberg. Perception of musical tension for nontonal orchestral timbres and its relation to psychoacoustic roughness. Attention, Perception, & Psychophysics, 62(1):66--80, 2000.
[30]
J. Russell. A circumplex model of emotions. The Journal of Personality and Social Psychology, 39(6):1161--1178, 1980.
[31]
S. Streich. Music complexity: a multi-faceted description of audio content. PhD thesis, Universitat Pompeu Fabra, 2006.
[32]
F. Winckel and T. Binkley. Music, sound and sensation: A modern exposition. Dover Publications, 1967.
[33]
Y. H. Yang, Y. C. Lin, Y. F. Su, and H. H. Chen. A regression approach to music emotion recognition. IEEE Transactions on Audio, Speech, and Language Processing, 16(2):448--457, 2008.
Index Terms
- A novel approach for time-continuous tension prediction in film soundtracks
Recommendations
How does it sound? generation of rhythmic soundtracks for human movement videos
NIPS '21: Proceedings of the 35th International Conference on Neural Information Processing SystemsOne of the primary purposes of video is to capture people and their unique activities. It is often the case that the experience of watching the video can be enhanced by adding a musical soundtrack that is in-sync with the rhythmic features of these ...
Adaptive Musical Soundtracks: from in-game to on the street
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in SoundWe describe the challenges of creating location-based adaptive musical soundtracks, which we try to address via the iterative development of daoplayer, a tool to create such media experiences. Daoplayer is broadly modelled on the functionality of ...
An innovative method of algorithmic composition using musical tension
AbstractAccording to narratology or narrative theory, a piece of artwork should tell a story based on its various tensions. In this study, an automated music composition algorithm using musical tension energy was proposed; this algorithm can generate a ...
Comments
Information & Contributors
Information
Published In
September 2012
174 pages
ISBN:9781450315692
DOI:10.1145/2371456
- Conference Chairs:
- Andreas Floros,
- Andreas Mniestris,
- Program Chairs:
- Iani Zannos,
- Theodoros Lotis
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 September 2012
Check for updates
Qualifiers
- Research-article
Conference
AM '12
Acceptance Rates
Overall Acceptance Rate 177 of 275 submissions, 64%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 148Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)2
Reflects downloads up to 07 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in