research-article

AVEC 2012: the continuous audio/visual emotion challenge - an introduction

Authors:

Björn Schuller,

Michel Valstar,

Roddy Cowie,

Maja PanticAuthors Info & Claims

ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

Pages 361 - 362

https://doi.org/10.1145/2388676.2388758

Published: 22 October 2012 Publication History

Get Access

Abstract

The second international Audio/Visual Emotion Challenge and Workshop 2012 (AVEC 2012) is introduced shortly. 34 teams from 12 countries signed up for the Challenge. The SEMAINE database serves for prediction of four-dimensional continuous affect in audio and video. For the eligible participants, final scores for the Fully-Continuous Sub-Challenge ranged between a correlation coefficient between gold standard and prediction of 0.174 and 0.456, and for Word-Level Sub-Challenge between 0.113 and 0.280.

References

[1]

Cowie, R., Douglas-Cowie, E., Savvidou, S., McMahon, E., Sawey, M., and Schröder, M. Feeltrace: An instrument for recording perceived emotion in real time. In Proc. ISCA Workshop on Speech and Emotion (Belfast, UK, 2000), pp. 19--24.

Google Scholar

[2]

Eyben, F., Wöllmer, M., and Schuller, B. openSMILE - The Munich Versatile and Fast Open-Source Audio Feature Extractor. In Proc. ACM Multimedia (MM) (Florence, Italy, 2010), pp. 1459--1462.

Digital Library

Google Scholar

[3]

Jiang, B., Valstar, M., and Pantic, M. Action unit detection using sparse appearance descriptors in space-time video volumes. In Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition (Santa Barbara, USA, 2011), pp. 314--321.

Crossref

Google Scholar

[4]

McKeown, G., Valstar, M., Cowie, R., Pantic, M., and Schroder, M. The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Transactions on Affective Computing 3 (2012), 5--17.

Digital Library

Google Scholar

[5]

Schröder, M., Bevacqua, E., Cowie, R., Eyben, F., Gunes, H., Heylen, D., ter Maat, M., McKeown, G., Pammi, S., Pantic, M., Pelachaud, C., Schuller, B., de Sevin, E., Valstar, M., and Wöllmer, M. Building Autonomous Sensitive Artificial Listeners. IEEE Transactions on Affective Computing (2012). 20 pages, to appear.

Digital Library

Google Scholar

[6]

Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., and Pantic, M. AVEC 2011 - The First International Audio/Visual Emotion Challenge. In Proc. Int'l Audio/Visual Emotion Challenge and Workshop, AVEC 2011, in conjunction with the Int'l Conf. Affective Computing and Intelligent Interaction, 2011, vol. II. Springer, Memphis, TN, October 2011, pp. 415--424.

Digital Library

Google Scholar

Cited By

View all

Ma HWang JLin HZhang BZhang YXu B(2024)A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in ConversationsIEEE Transactions on Multimedia10.1109/TMM.2023.327101926(776-788)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3271019
Chen FShao JZhu AOuyang DLiu XShen H(2024)Modeling Hierarchical Uncertainty for Multimodal Emotion Recognition in ConversationIEEE Transactions on Cybernetics10.1109/TCYB.2022.318511954:1(187-198)Online publication date: Jan-2024
https://doi.org/10.1109/TCYB.2022.3185119
Zhang TTan Z(2024)Survey of deep emotion recognition in dynamic data using facial, speech and textual cuesMultimedia Tools and Applications10.1007/s11042-023-17944-983:25(66223-66262)Online publication date: 22-Jan-2024
https://doi.org/10.1007/s11042-023-17944-9
Show More Cited By

Index Terms

AVEC 2012: the continuous audio/visual emotion challenge - an introduction

Recommendations

AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
AVEC '16: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge

The Audio/Visual Emotion Challenge and Workshop (AVEC 2016) "Depression, Mood and Emotion" will be the sixth competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and physiological ...
AVEC 2012: the continuous audio/visual emotion challenge
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

We present the second Audio-Visual Emotion recognition Challenge and workshop (AVEC 2012), which aims to bring together researchers from the audio and video analysis communities around the topic of emotion recognition. The goal of the challenge is to ...
AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge
AVEC '14: Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge

Mood disorders are inherently related to emotion. In particular, the behaviour of people suffering from mood disorders such as unipolar depression shows a strong temporal correlation with the affective dimensions valence, arousal and dominance. In ...

Comments

Information & Contributors

Information

Published In

ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

October 2012

636 pages

ISBN:9781450314671

DOI:10.1145/2388676

General Chairs:
Louis-Philippe Morency
University of Southern California, USA
,
Dan Bohus
Microsoft Research, USA
,
Hamid Aghajan
Stanford University, USA
,
Program Chairs:
Justine Cassell
Carnegie Mellon University, USA
,
Anton Nijholt
University of Twente, Netherlands
,
Julien Epps
The University of New South Wales, Australia

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '12

Sponsor:

SIGCHI

ICMI '12: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 22 - 26, 2012

California, Santa Monica, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
258
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ma HWang JLin HZhang BZhang YXu B(2024)A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in ConversationsIEEE Transactions on Multimedia10.1109/TMM.2023.327101926(776-788)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3271019
Chen FShao JZhu AOuyang DLiu XShen H(2024)Modeling Hierarchical Uncertainty for Multimodal Emotion Recognition in ConversationIEEE Transactions on Cybernetics10.1109/TCYB.2022.318511954:1(187-198)Online publication date: Jan-2024
https://doi.org/10.1109/TCYB.2022.3185119
Zhang TTan Z(2024)Survey of deep emotion recognition in dynamic data using facial, speech and textual cuesMultimedia Tools and Applications10.1007/s11042-023-17944-983:25(66223-66262)Online publication date: 22-Jan-2024
https://doi.org/10.1007/s11042-023-17944-9
Gupta RSinha R(2023)An Investigation on the Audio-Video Data Based Estimation of Emotion Regulation Difficulties and Their Association With Mental DisordersIEEE Access10.1109/ACCESS.2023.329709111(74324-74336)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3297091
Ding JChen XLu PYang ZLi XDu Y(2023)DialogueINAB: an interaction neural network based on attitudes and behaviors of interlocutors for dialogue emotion recognitionThe Journal of Supercomputing10.1007/s11227-023-05439-179:18(20481-20514)Online publication date: 15-Jun-2023
https://doi.org/10.1007/s11227-023-05439-1
Kadiri SAlku P(2022)Subjective Evaluation of Basic Emotions from Audio–Visual DataSensors10.3390/s2213493122:13(4931)Online publication date: 29-Jun-2022
https://doi.org/10.3390/s22134931
Nagasawa TMasui KDoi HOgawa-Ochiai KTsumura N(2022)Continuous estimation of emotional change using multimodal responses from remotely measured biological informationArtificial Life and Robotics10.1007/s10015-022-00734-1Online publication date: 3-Feb-2022
https://doi.org/10.1007/s10015-022-00734-1
Hamieh SHeiries VAl Osman HGodin CSchuller BStappen LMeßner ECambria EZhao G(2021)Multi-modal Fusion for Continuous Emotion Recognition by Using Auto-EncodersProceedings of the 2nd on Multimodal Sentiment Analysis Challenge10.1145/3475957.3484455(21-27)Online publication date: 24-Oct-2021
https://dl.acm.org/doi/10.1145/3475957.3484455
Chen HJiang DSahli H(2021)Transformer Encoder With Multi-Modal Multi-Head Attention for Continuous Affect RecognitionIEEE Transactions on Multimedia10.1109/TMM.2020.303749623(4171-4183)Online publication date: 2021
https://doi.org/10.1109/TMM.2020.3037496
Miller CMiller C(2019)Timing is Everything: Identifying Diverse Interaction Dynamics in Scenario and Non-Scenario Meetings2019 15th International Conference on eScience (eScience)10.1109/eScience.2019.00029(203-212)Online publication date: Sep-2019
https://doi.org/10.1109/eScience.2019.00029
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge