Nonverbal behavior in multimodal performances
July 2019
Pages 219 - 262
References
[1]
J. Allwood, L. Cerrato, K. Jokinen, C. Navarretta, and P. Paggio. 2007. The mumin coding scheme for the annotation of feedback, turn management and sequencing phenomena. Language Resources and Evaluation, 41(3--4): 273--287. 226
[2]
M. Argyle and M. Cook. 1976a. Gaze and Mutual Gaze. Cambridge University Press. https://books.google.com/books?id=ZBR0QgAACAAJ. 221, 227
[3]
M. Argyle and M. Cook. 1976b. Gaze and Mutual Gaze. Cambridge University Press, Cambridge. 219
[4]
M. Aylett and C. Pidcock. 2007a. The cerevoice characterful speech synthesiser sdk. In C. Pelachaud, J.-C. Martin, E. André, G. Chollet, K. Karpouzis, and D. Pelé, eds., Intelligent Virtual Agents, vol. 4722 of Lecture Notes in Computer Science, pp. 413--414. Springer-Verlag, Berlin, Heidelberg. 242
[5]
M. P. Aylett and C. J. Pidcock. 2007b. The cerevoice characterful speech synthesiser sdk. In C. Pelachaud, J.-C. Martin, E. André, G. Chollet, K. Karpouzis, and D. Pelé, editors, Proceedings of the 7th International Conference on Intelligent Virtual Agents, vol. 4722 of LNCS, pp. 413--414. Springer-Verlag. 233
[6]
T. Bänziger and K. R. Scherer. 2010. Introducing the geneva multimodal emotion portrayal (GEMEP) corpus. In K. R. Scherer, T. Bänziger, and E. B. Roesch editors, Blueprint for Affective Computing: A sourcebook, pp. 271--294. Oxford University Press, Oxford, England. 226
[7]
T. Baur, I. Damian, F. Lingenfelser, J. Wagner, and E. André. October 2013. Nova: Automated analysis of nonverbal signals in social interactions. In A. A. Salah, H. Hung, O. Aran, and H. Gunes, editors, Proceedings of the Human Behavior Understanding: 4th International Workshop, HBU 2013, Barcelona, Spain, pp. 160--171. Springer International Publishing, Cham. 245
[8]
J. B. Bavelas. 1994. Gestures as part of speech: Methodological implications. Research on Language and Social Interaction, 27(3): 201--221. 219, 221
[9]
K. Bergmann and S. Kopp. 2009a. GNetIc---Using bayesian decision networks for iconic gesture generation. In Intelligent Virtual Agents, vol. 1, pp. 76--89. http://www.springerlink.com/index/l754644205211847.pdf. 232, 245
[10]
K. Bergmann and S. Kopp. 2009b. Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks. In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems---Volume 1, pp. 361--368. http://dl.acm.org/citation.cfm?id=1558062. 232, 245
[11]
T. Bickmore, D. Schulman, and G. Shaw. 2009. Dtask and litebody: Open source, standards-based tools for building web-deployed embodied conversational agents. In Proceedings of the 9th International Conference on Intelligent Virtual Agents, IVA '09, pp. 425--431. Springer, Berlin, Heidelberg. 231, 238
[12]
P. Bourgeois and U. Hess. 2008. The impact of social context on mimicry. Biological Psychology, 77(3): 343--352. 225
[13]
C. Breazeal, N. DePalma, J. Orkin, S. Chernova, and M. Jung. 2013. Crowdsourcing human-robot interaction: New methods and system evaluation in a public environment. Journal of Human-Robot Interaction, 2(1): 82--111. 231
[14]
H. Bunt. 2014. A context-change semantics for dialogue acts. In H. Bunt, J. Bos, S. Pulman, editors, Computing Meaning, Text, Speech and Language Technology, vol. 47, pp. 177--201. Springer, Dordrecht. 226
[15]
J. K. Burgoon and B. A. Poire. 1999. Nonverbal cues and interpersonal judgments: Participant and observer perceptions of intimacy, dominance, composure, and formality. Communication Monographs, 66(2): 105--124. 246
[16]
A. Cafaro, R. Gaito, and H. H. Vilhjálmsson. 2009. Animating idle gaze in public places. In Proceedings of the 9th International Conference on Intelligent Virtual Agents, IVA '09, pp. 250--256. Springer-Verlag, Berlin, Heidelberg. 231
[17]
A. Cafaro, H. Vilhjálmsson, T. Bickmore, D. Heylen, and C. Pelachaud. 2014. Representing communicative functions in saiba with a unified function markup language. In T. Bickmore, S. Marsella, and C. Sidner, editors, Intelligent Virtual Agents, vol. 8637 of Lecture Notes in Computer Science, pp. 81--94. Springer International Publishing. 230
[18]
A. Cafaro, N. Glas, and C. Pelachaud. 2016a. The effects of interrupting behavior on interpersonal attitude and engagement in dyadic interactions. In Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems, AAMAS '16, p. 911--920. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. http://dl.acm.org/citation.cfm?id=2936924.2937059. 247
[19]
A. Cafaro, B. Ravenet, M. Ochs, H. H. Vilhjálmsson, and C. Pelachaud. July 2016b. The effects of interpersonal attitude of a group of agents on user's presence and proxemics behavior. ACM Tranactions on Interactaction and Intelligent Systems, 6(2): 12:1--12:33. 231
[20]
G. Calbris. November 2011. Elements of Meaning in Gesture 378 pps. John Benjamins Publishing, Philadelphia, PA. 221, 224, 226, 246
[21]
J. Cassell. 2006. Body language: Lessons from the near-human. In G. Redux, editor, Genesis Redux: Essays in the History and Philosophy of Artificial Life, pp. 346--374. University of Chicago Press. 245
[22]
J. Cassell, T. Bickmore, M. Billinghurst, L. Campbell, K. Chang, H. Vilhjálmsson, and H. Yan. 1999. Embodiment in conversational interfaces: Rea. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '99, pp. 520--527. ACM, New York. 228
[23]
J. Cassell, H. H. Vilhjálmsson, and T. Bickmore. 2001. Beat: the behavior expression animation toolkit. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '01, pp. 477--486. ACM, New York. 228, 231, 232, 238, 239
[24]
A. Čereković, T. Pejša, and I. S. Pandžić 2010. A controller-based animation system for synchronizing and realizing human-like conversational behaviors. In A. Esposito, N. Campbell, C. Vogel, A. Hussain, and A. Nijholt, eds., Development of Multimodal Interfaces: Active Listening and Synchrony: Second COST 2102 International Training School, Dublin, Ireland, March 23--27, 2009, Revised Selected Papers, pp. 80--91. Springer, Berlin, Heidelberg. 232, 245
[25]
T. L. Chartrand and J. A. Bargh. 1999. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76(6): 893. 222, 764
[26]
C.-C. Chiu, L.-P. Morency, and S. Marsella. 2015. Predicting co-verbal gestures: A deep and temporal modeling approach. In W.-P. Brinkman, J. Broekens, and D. Heylen, editors, Intelligent Virtual Agents: 15th International Conference, IVA 2015, Delft, The Netherlands, August 26--28, 2015, Proceedings, pp. 152--166. Springer International Publishing, Cham. 232, 245
[27]
M. Chollet, M. Ochs, and C. Pelachaud. 2014. From non-verbal signals sequence mining to bayesian networks for interpersonal attitudes expression. In T. Bickmore, S. Marsella, and C. Sidner, eds., Intelligent Virtual Agents: 14th International Conference, IVA 2014, Boston, MA, USA, August 27--29, 2014. Proceedings, pp. 120--133. Springer International Publishing, Cham. 231
[28]
H. Clark. 1996. Using Language. Cambridge, Cambridge University Press. 227
[29]
E. J. Coats, R. S. Feldman, and P. Philippot. 1999. The influence of television on children's nonverbal behavior. In P. Philippot, R. S. Feldman, and E. J. Coats, eds., The social context of nonverbal behavior, pp. 156--181. Cambridge University Press, Paris. 248
[30]
W. Condon and W. Osgton. 1967. A segmentation of behavior. Journal of Psychiatric Research, 5: 221--235. 225
[31]
M. Courgeon and C. Clavel. 2013. Marc: a framework that features emotion models for facial animation during human-computer interaction. Journal on Multimodal User Interfaces, 7(4): 311--319. 239, 241
[32]
R. Cowie, C. Cox, J.-C. Martin, A. Batliner, D. Heylen, and D. Karpouzis. 2011. Issues in Data Labelling. In: R. Cowie, C. Pelachaud, P. Petta, editors, Emotion-Oriented Systems, Cognitive Technologies, pp. 215--244. Springer, Berlin, Heidelberg. 227
[33]
C. Darwin. 1872. The Expression of the Emotions in Man and Animals. London, UK. John Murray publisher. 225
[34]
E. Delaherche, M. Chetouani, A. Mahdhaoui, C. Saint-Georges, S. Viaux, and D. Cohen. July-September 2012. Interpersonal synchrony: A survey of evaluation methods across disciplines. IEEE Transactions on Affective Computing, 3(3): 349--365. 223, 786
[35]
U. Dimberg. 1997. Facial emg: Indicator of rapid emotional reactions. International Journal of Psychophysiology, 25(1): 52--53. http://www.sciencedirect.com/science/article/pii/S0167876097854839. 225, 247
[36]
Y. Ding, K. Prepin, J. Huang, C. Pelachaud, and T. Artières. 2014. Laughter animation synthesis. In Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS '14, pp. 773--780. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. http://dl.acm.org/citation.cfm?id=2615731.2615856. 245
[37]
E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, M. McRorie, J.-C. Martin, L. Devillers, S. Abrilian, A. Batliner, N. Amir, and K. Karpouzis. 2007. The HUMAINE Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data. In A. C. R. Paiva, R. Prada, R. W. Picard, editors, Affective Computing and Intelligent Interaction. ACII 2007. Lecture Notes in Computer Science, vol. 4738. Springer, Berlin, Heidelberg. 226, 227
[38]
E. Douglas-Cowie, C. Cox, J. C. Martin, L. Devillers, R. Cowie, I. Sneddon, M. McRorie, C. Pelachaud, C. Peters, O. Lowry, A. Batlinder, and F. Hönig. 2011. The HUMAINE database. In R. Cowie, C. Pelachaud, P. Petta, editors, Emotion-Oriented Systems. Cognitive Technologies. Springer, Berlin, Heidelberg. 227
[39]
S. Duncan and D. Fiske. 1985. Interaction Structure and Strategy. Cambridge University Press, New York, NY. 227
[40]
P. Edelmann and R. B. Zajonc. 1989. Facial Efference and the Experience of Emotion. Annual Review of Pyschology, 40: 249--280. 225
[41]
P. Ekman. 1979. About brows: Emotional and conversational signals. In M. von Cranach, K. Foppa, W. Lepenies, and D. Ploog, editors, Human ethology: Claims and Limits of a New Discipline: Contributions to the Colloquium, pp. 169--248. Cambridge University Press, Cambridge, UK, New York. 227
[42]
P. Ekman. 2003. Emotions Revealed. Times Books (US), New York. Weidenfeld & Nicolson (world), London. 227
[43]
P. Ekman and W. V. Friesen. 1969. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1: 49--98. 219
[44]
P. Ekman, W. Friesen, and J. Hager. 2002. The Facial Action Coding System (2nd Edition). Research Nexus eBook, London, Weidenfeld & Nicolson (world), Salt Lake City, UT. 226
[45]
C. Ennis and C. O'Sullivan. May 2012. Perceptually plausible formations for virtual conversers. Computer Animation and Virtual Worlds, 23(3--4): 321--329. 231
[46]
C. Ennis, R. McDonnell, and C. O'Sullivan. July 2010. Seeing is believing: Body motion dominates in multisensory conversations. ACM Transactions on Graphics, 29(4): 91:1--91:9. 231
[47]
S. Garrod and A. Anderson. 1987. Saying what you mean in dialogue: A study in conceptual and semantic co-ordination. Cognition, 27(2): 181--218. 225
[48]
R. Gifford. 1994. A lens-mapping framework for understanding the encoding and decoding of interpersonal dispositions in nonverbal behavior. Journal of Personality and Social Psychology, 66(2): 398--412. 248
[49]
H. Giles, N. Coupland, and I. Coupland. 1991. Accommodation theory: Communication, context, and consequence. In H. Giles, J. Coupland, and N. Coupland, editors, Studies in Emotion and Social Interaction. Contexts of Accommodation: Developments in Applied Sociolinguistics, pp. 1--68. New York, NY. Cambridge University Press, Paris, France. Editions de la Maison des Sciences de l'Homme. 225
[50]
N. Glas and C. Pelachaud. 2015. Definitions of engagement in human-agent interaction. In Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on, pp. 944--949. IEEE. 222, 779
[51]
J. Gratch, N. Wang, J. Gerten, E. Fast, and R. Duffy. 2007. Creating rapport with virtual agents. In C. Pelachaud, J.-C. Martin, E. André, G. Chollet, K. Karpouzis, and D. Pelé, editors, Intelligent Virtual Agents, pp. 125--138. Springer, Berlin, Heidelberg. 247
[52]
U. GroBekathöfer, N.-C. Wöhler, T. Hermann, and S. Kopp. 2012. On-the-fly behavior coordination for interactive virtual agents: A model for learning, recognizing and reproducing hand-arm gestures online. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems---Volume 3, AAMAS '12, pp. 1177--1178. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. 232, 245
[53]
A. Hartholt, D. Traum, S. C. Marsella, A. Shapiro, G. Stratou, A. Leuski, L.-P. Morency, and J. Gratch. 2013. All Together Now. Introducing the Virtual Human Toolkit, pp. 368--381. Springer, Berlin, Heidelberg. 234
[54]
A. Heloir and M. Kipp. 2009. Embr---a realtime animation engine for interactive embodied agents. In Z. Ruttkay, M. Kipp, A. Nijholt, and H. H. Vilhjálmsson, eds., Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14--16, 2009 Proceedings, pp. 393--404. Springer, Berlin, Heidelberg. 232
[55]
D. Heylen, S. Kopp, S. C. Marsella, C. Pelachaud, and H. H. Vilhjálmsson. 2008. The next step towards a function markup language. In Proceedings of the 8th International Conference on Intelligent Virtual Agents, IVA '08, pp. 270--280. Springer-Verlag, Berlin, Heidelberg. 230
[56]
A. B. Hostetter and M. W. Alibali. 2008. Psychonomic Bulletin and Review, 15: 495. 225
[57]
H.-H. Huang, T. Nishida, A. Cerekovic, I. S. Pandzic, and Y. Nakano. 2008. The design of a generic framework for integrating eca components. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent System---Volume 1, AAMAS '08, pp. 128--135. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. http://dl.acm.org/citation.cfm?id=1402383.1402406. 241
[58]
J. Huang and C. Pelachaud. 2012. An efficient energy transfer inverse kinematics solution. In International Conference on Motion in Games, pp. 278--289. Springer. 244
[59]
L. Huang, L.-P. Morency, and J. Gratch. 2011. Virtual rapport 2.0. In International Workshop on Intelligent Virtual Agents, pp. 68--79. Springer. 223, 783
[60]
K. Jokinen and C. Pelachaud. 2013. From Annotation to Multimodal Behavior. In M. Rojc, N. Campbell, editors, Coverbal Synchrony in Human-Machine Interaction. Boca Raton, CRC Press. 227
[61]
A. Kendon. 2000. Language and gesture: Unity or duality. In D. McNeill, editor, Language and Gesture, number 2 in Language, Culture and Cognition, pp. 47--63. Cambridge University Press. 219, 224
[62]
A. Kendon. 2002. Some uses of the head shake. Gesture, 2(2): 147--183. 223
[63]
A. Kendon. 2004. Gesture: Visible Action as Utterance. Cambridge University Press. 226, 227
[64]
M. Kipp. 2006. Creativity meets automation: Combining nonverbal action authoring with rules and machine learning. In Proceedings of the 6th International Conference on Intelligent Virtual Agents, IVA'06, pp. 230--242. Springer-Verlag, Berlin, Heidelberg. 245
[65]
S. Kopp and I. Wachsmuth. March 2004. Synthesizing multimodal utterances for conversational agents: Research articles. Computer Animation and Virtual Worlds, 15(1): 39--52. 236
[66]
S. Kopp, B. Krenn, S. Marsella, A. N. Marshall, C. Pelachaud, H. Pirker, K. R. Thórisson, and H.H. Vilhjálmsson. 2006. Towards a common framework for multimodal generation: the behavior markup language. In Proceedings of the 6th International Conference on Intelligent Virtual Agents, IVA'06, pp. 205--217. Springer-Verlag, Berlin, Heidelberg. 229, 230, 233
[67]
S. Kopp, H. van Welbergen, R. Yaghoubzadeh, and H. Buschmeier. 2014. An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing. Journal of Multimodal User Interfaces, 8(1): 97--108. http://dblp.uni-trier.de/db/journals/jmui/jmui8.html#KoppWYB14. 235
[68]
J. L. Lakin, V. A. Jefferis, C. M. Cheng, and T. L. Chartrand. 2003. Chameleon effect as social glue: Evidence for the evolutionary significance of nonconsious mimicry. Nonverbal Behavior, 27(3): 145--162. 225
[69]
J. Lee and S. Marsella. 2006. Nonverbal behavior generator for embodied conversational agents. In Proceedings of the 6th International Conference on Intelligent Virtual Agents, IVA'06, pp. 243--255. Springer-Verlag, Berlin, Heidelberg. 231, 234
[70]
M. Lhommet, Y. Xu, and S. Marsella. 2015. Cerebella: Automatic generation of nonverbal behavior for virtual humans. 237
[71]
D. Luciew, J. Mulkern, and R. Punako Jr. 2011. Finding the Truth: Interview and Interrogation Training Simulations. In Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Paper No. 11186. 248
[72]
M. Mancini and C. Pelachaud. 2008. The FML-APML language. In Why Conversational Agents do What They Do. Workshop on Functional Representations for Generating Conversational Agents Behavior at AAMAS. 233
[73]
S. Marsella, Y. Xu, M. Lhommet, A. Feng, S. Scherer, and A. Shapiro. 2013. Virtual character performance from speech. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '13, pp. 25--35. ACM, New York. 232, 237
[74]
S. C. Marsella, S. M. Carnicke, J. Gratch, A. Okhmatovskaia, and A. Rizzo. 2006. An exploration of Delsarte's structural acting system. In Intelligent Virtual Agents, pp. 80--92. Springer. 248
[75]
D. Matsumoto. 2006. Culture and nonverbal behavior. In V. Manusov and M. L. Patterson editors, The Sage Handbook of Nonverbal Communication, (pp. 219--235). Thousand Oaks, CA. Sage Publications, Inc. 224
[76]
E. Z. McClave. June 2000. Linguistic functions of head movements in the context of speech. Journal of Pragmatics, 32(7): 855--878. http://www.sciencedirect.com/science/article/pii/S037821669900079X. 223
[77]
D. McNeill. 1992. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago. 221, 222, 226, 227, 243, 763, 773
[78]
A. Menache. 2011. 4 - The motion data. In A. Menache, editor, Understanding Motion Capture for Computer Animation. 2nd ed., The Morgan Kaufmann Series in Computer Graphics, pp. 135--185. Morgan Kaufmann, Boston. http://www.sciencedirect.com/science/article/pii/B9780123814968000044. 245
[79]
J. Nadel and G. Butterworth. 1999. Imitation in Infancy, vol. 16. Cambridge University Press Cambridge. 222, 775
[80]
J. Nadel and H. Tremblay-Leveau. 1999. Early perception of social contingencies and interpersonal intentionality: Dyadic and triadic paradigms. Early social Cognition: Understanding Others in the First Months of Life, pp. 189--212. 225
[81]
R. Niewiadomski, E. Bevacqua, M. Mancini, and C. Pelachaud. 2009. Greta: an interactive expressive eca system. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems---Volume 2, AAMAS '09, pp. 1399--1400. International Foundation for Autonomous Agents and Multiagent Systems. 228
[82]
A. Ortony, G. Clore, and A. Collins. 1988. The Cognitive Structure of Emotions. New York, NY. Cambridge University Press. 227
[83]
A. Paiva, J. Dias, D. Sobral, R. Aylett, P. Sobreperez, S. Woods, C. Zoll, and L. Hall. 2004. Caring for agents and agents that care: Building empathic relations with synthetic agents. In Proceedings of the Third International Joint Conference on Autonomous Agents an Multiagent Systems---Volume 1, pp. 194--201. IEEE Computer Society. 222, 770
[84]
F. Pecune, A. Cafaro, M. Chollet, P. Philippe, and C. Pelachaud. 2014. Suggestions for extending saiba with the vib platform. In Workshop on Architectures and Standards for IVAs, held at the '14th International Conference on Intelligent Virtual Agents, IVA 2014, p. 16--20. Bielefeld eCollections. 233
[85]
F. Pecune, B. Biancardi, Y. Ding, C. Pelachaud, M. Mancini, G. Varni, A. Camurri, and G. Volpe. 2015. Lol-laugh out loud. In AAAI, pp. 4309--4310. 232, 247
[86]
C. Pedica and H. H. Vilhjálmsson. 2012. Lifelike interactive characters with behavior trees for social territorial intelligence. In ACM SIGGRAPH 2012 Posters, SIGGRAPH '12, pp. 32:1--32:1. ACM, New York, NY. 231, 232, 240
[87]
M.J. Pickering and S. Garrod. 2004. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27(02): 169--190. 222, 225, 761
[88]
I. Poggi. 2007. Mind, Hands, Face and Body. A Goal and Belief View of Multimodal Communication, volume Körper, Zeichen, Kultur. Weidler Verlag. 225, 227
[89]
K. Prepin, M. Ochs, and C. Pelachaud. 2013. Beyond backchannels: co-construction of dyadic stancce by reciprocal reinforcement of smiles between virtual agents. In Procedings of CogSci Annual Meeting of the Cognitive Science Society). 232
[90]
B. Ravenet, M. Ochs, and C. Pelachaud. 2013. From a user-created corpus of virtual agent's non-verbal behavior to a computational model of interpersonal attitudes. In R. Aylett, B. Krenn, C. Pelachaud, and H. Shimodaira, editors, Intelligent Virtual Agents: 13th International Conference, IVA 2013, Edinburgh, UK, August 29--31, 2013 Proceedings, pp. 263--274. Springer, Berlin, Heidelberg. 231
[91]
M. Rehm and E. André. 2008. From annotated multimodal corpora to simulated human-like behaviors. In Proceedings of the Embodied Communication in Humans and Machines, 2Nd ZiF Research Group International Conference on Modeling Communication with Robots and Virtual Humans, ZiF'06, pp. 1--17. Springer-Verlag, Berlin, Heidelberg. http://dl.acm.org/citation.cfm?id=1794517.1794518. 230, 245
[92]
C. Reynolds. 1999. Steering behaviors for autonomous characters. In Proceedings of the Game Developers Conference, pp. 763--782. Miller Freeman Game Groups, San Francisco, CA. 240
[93]
J. Robison, S. McQuiggan, and J. Lester. September 2009. Evaluating the consequences of affective feedback in intelligent tutoring systems. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pp. 1--6. 248
[94]
R. Rojas. 1996. Neural Networks---A Systematic Introduction. Springer-Verlag, Berlin, NewYork. 232
[95]
B. Rossen and B. Lok. Apr. 2012. A crowdsourcing method to develop virtual human conversational agents. International Journal of Human-Computer Studies, 70(4): 301--319. 231, 239
[96]
J. A. Russell and J. M. Fernadez-Dols. 1997. What does a facial expression mean. In J. A. Russell and J. M. Fernadez-Dols, editors, The Psychology of Facial Expression. Cambridge University Press, New York, NY. 223
[97]
K. Scherer. 2000. Emotion. In M. Hewstone and W. Stroebe, editors, Introduction to Social Psychology: A European Perspective, pp. 151--191. Blackwell, Oxford, UK. 227
[98]
K. R. Scherer and G. Ceschi. 1997. Lost luggage: a field study of emotion-antecedent appraisal. Motivation and Emotion, 21(3): 211--235. 226
[99]
M. Schröder. January 2010. The semaine api: Towards a standards-based framework for building emotion-oriented systems. Advances in Human-Computer Interaction. 239, 240
[100]
M. Schröder, P. Baggia, F. Burkhardt, C. Pelachaud, C. Peter, and E. Zovato. 2011. Emotionml-an upcoming standard for representing emotions and related states. In International Conference on Affective Computing and Intelligent Interaction, pp. 316--325. Springer. 226
[101]
A. Shoulson, N. Marshak, M. Kapadia, and N. I. Badler. 2013. Adapt: The agent development and prototyping testbed. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 13, pp. 9--18. ACM, New York, NY, USA. 239
[102]
W. R. Swartout, J. Gratch, R. W. Hill Jr, E. Hovy, S. Marsella, J. Rickel, and D. Traum. 2006. Toward virtual humans. AI Magazine, 27(2): 96--108. 235
[103]
M. ter Maat and D. Heylen. 2011. Flipper: An information state component for spoken dialogue systems. In H. H. Vilhjálmsson, S. Kopp, S. Marsella, and K. R. Thórisson, editors, Intelligent Virtual Agents: 10th International Conference, IVA 2011, Reykjavik, Iceland, September 15--17, 2011. Proceedings, pp. 470--472. Springer, Berlin, Heidelberg. 235
[104]
M. Thiebaux, S. Marsella, A. N. Marshall, and M. Kallmann. 2008. Smartbody: behavior realization for embodied conversational agents. In Proceedings of the 7th International Joint Conference on Autonomous Agents an Multiagent Systems---Volume 1, AAMAS '08, pp. 151--158. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. http://dl.acm.org/citation.cfm?id=1402383.1402409. 235
[105]
F. Thomas and O. Johnston. 1995. The Illusion of Life: Disney Animation. Hyperion, New York. 249
[106]
L. Tickle-Degnen and R. Rosenthal. 1990. The nature of rapport and its nonverbal correlates. Psychological Inquiry, 1(4): 285--293. 225, 247
[107]
N. Tinbergen and Perdeck. 1950. On the stimulus situation releasing the begging response in the newly hatched herring gull chick (Larus argentatus argentatus Pont). Behavior, 3: 1--39. 249
[108]
B. Tversky and B. M. Hard. 2009. Embodied and disembodied cognition: Spatial perspective-taking. Cognition, 110(1): pp. 124--129. 224
[109]
R. B. Van Baaren, R. W. Holland, B. Steenaert, and A. van Knippenberg. 2003. Mimicry for money: Behavioral consequences of imitation. Journal of Experimental Social Psychology, 39(4): 393--398. 222, 779
[110]
H. van Welbergen, D. Reidsma, Z. M. Ruttkay, and J. Zwiers. 2010. Elckerlyc - A BML realizer for continuous, multimodal interaction with a virtual human. Journal on Multimodal User Interfaces, 3(4): 271--284. 236
[111]
H. van Welbergen, R. Yaghoubzadeh, and S. Kopp. 2014. AsapRealizer 2.0: The Next Steps in Fluent Behavior Realization for ECAs, pp. 449--462. Springer International Publishing, Cham. 232, 235
[112]
H. H. Vilhjálmsson, N. Cantelmo, J. Cassell, N. E. Chafai, M. Kipp, S. Kopp, M. Mancini, S. Marsella, A. N. Marshall, C. Pelachaud, Z. Ruttkay, K. R. Thórisson, H. Welbergen, and R. J. Werf. 2007. The behavior markup language: Recent developments and challenges. In Proceedings of the 7th International Conference on Intelligent Virtual Agents, IVA '07, pp. 99--111. Springer-Verlag, Berlin, Heidelberg. 230, 233
[113]
H. H. Vilhjálmsson. 2005. Augmenting online conversation through automated discourse tagging. In Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05)---Track 4---Volume 04, HICSS '05, pp. 109.1-. IEEE Computer Society, Washington, DC. 228
[114]
H. H. Vilhjálmsson. 2009. Representing communicative function and behavior in multimodal communication. In A. Esposito, A. Hussain, M. Marinaro, and R. Martone, eds., Multimodal Signals: Cognitive and Algorithmic Issues, vol. 5398 of Lecture Notes in Computer Science, pp. 47--59. Springer, Berlin, Heidelberg. 229
[115]
J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, and E. André. 2013. The social signal interpretation (ssi) framework: multimodal signal processing and recognition in real-time. In Proceedings of the 21st ACM International Conference on Multimedia, MM '13, pp. 831--834. ACM, New York, NY. 233, 245
[116]
M. Walker and C. Trimboli. 1983. The expressive function of the eye flash. Journal of Nonverbal Behavior, 8(1): 3--13. 227
[117]
G. L. Wells and R. E. Petty. 1980. The effects of over head movements on persuasion: Compatibility and incompatibility of responses. Basic and Applied Social Psychology, 1(3): 219--230. 225
[118]
Y. Xu, C. Pelachaud, and S. Marsella. Sept. 2014. Compound gesture generation: A model based on ideational units. In Intelligent Virtual Agents. http://www.ccs.neu.edu/~marsella/publications/Yuyu_IVA2014.pdf. 237, 246
[119]
R. Zhao, A. Papangelis, and J. Cassell. 2014. Towards a dyadic computational model of rapport management for human-virtual agent interaction. In International Conference on Intelligent Virtual Agents, pp. 514--527. Springer. 223, 783
Recommendations
Changes in verbal and nonverbal conversational behavior in long-term interaction
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionWe present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video ...
Multimodal Collaboration in Expository Discourse: Verbal and Nonverbal Moves Alignment
Speech and ComputerAbstractThe paper explores multimodal collaboration in expository discourse considering verbal and nonverbal moves used by the participants in turn-taking. It reports the results of an experiment which tested speech, gesture and gaze alignment as affected ...
Analysis environment of conversational structure with nonverbal multimodal data
ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal InteractionThis paper shows the IMADE (Interaction Measurement, Analysis, and Design Environment) project to build a recording and anlyzing environment of human conversational interactions. The IMADE room is designed to record audio/visual, human-motion, eye ...
Comments
Information & Contributors
Information
Published In
July 2019
813 pages
ISBN:9781970001754
DOI:10.1145/3233795
Publisher
Association for Computing Machinery and Morgan & Claypool
Publication History
Published: 01 July 2019
Check for updates
Qualifiers
- Research-article
Appears in
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 177Total Downloads
- Downloads (Last 12 months)18
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in