research-article

Orchestration: tv-like mixing grammars applied to video-communication for social groups

Authors:

Marian F. Ursu,

Manolis Falelakis,

Michael Frantzis,

Vilmos Zsombori,

Rene KaiserAuthors Info & Claims

MM '13: Proceedings of the 21st ACM international conference on Multimedia

Pages 333 - 342

https://doi.org/10.1145/2502081.2502118

Published: 21 October 2013 Publication History

Abstract

This paper reports research into video-mediated synchronous communication within social groups. The ultimate aim of the research is to create a more natural medium for interaction, aware of the context in which it operates, able to continuously adapt itself to the communication needs and optimise the way in which it captures and transmits aspects of the communication. This, is hypothesised, can be achieved by equipping each of the various locations involved in the communication with multiple controllable video cameras and microphones, and mixing the resulting content through techniques similar to those used in television?a process referred to as "orchestration". Through orchestration, each location should be able to receive the appropriate perspectives and levels of detail, thus generating experiences in which the spatial separation between participants is minimised. The paper defines the concept of orchestration and presents two major evaluation experiments that provide supporting evidence for the main assumption and motivate further research, in richer interaction contexts, into this concept.

References

[1]

Ames, M. G., Go, J., Kaye, J. J., & Spasojevic, M. (2010). Making love in the network closet: the benefits and work of family videochat Proc ACM CSCW, 145--154.

Digital Library

[2]

Ballagas, R., Kaye, J. J., Ames, M., Go, J., & Raffle, H. (2009). Family communication: phone conversations with children Proc ACM IDC, 321--324.

Digital Library

[3]

Doherty-Sneddon, G., Anderson, A., Omalley, C., Langton, S., Garrod, S., & Bruce, V. (1997). Face-to-face and video-mediated communication: A comparison of dialogue structure and task performance. Journal of Experimental Psychology-Applied, 3(2), 105--125.

[4]

Falelakis, M., Groen, M., Kaiser, R., and Ursu M.F. (2012). Automatic orchestration of video streams to enhance group communication. In Proceedings of the International Workshop on Socially Aware Multimedia, associated with ACM MM 2012, Nara, Japan.

Digital Library

[5]

Gergle, D., Rose, C.P., Kraut, R.E (2007). Modeling the impact of shared visual information on collaborative reference. In Proc ACM CHI, 1543--1552.

Digital Library

[6]

Groen, M., Ursu, M.F., Michalakopoulos, S., Falelakis, M., and Gasparis, E. (2012). Improving video-mediated communication with Orchestration. Computers in Human Behaviour (28), 1575--1579.

Digital Library

[7]

Inkpen, K., Hegde, R., Czerwinski, M., & Zhang, Z. (2010). Exploring spatialized audio and video for distributed conversations. Proc ACM CSCW, 95--98.

Digital Library

[8]

Inoue, T., Okada, K. and Matsushita, Y. (1995). Learning from TV programs: Application of TV presentation to a videoconferencing system. Proc. ACM UIST, 147--154.

Digital Library

[9]

Jansen, J., Cesar, P., Bulterman, D., Stevens, T., Kegel, I., & Issing, J. (2011). Enabling composition-based video-conferencing for the home. IEEE Transactions on Multimedia 13(5), 869--88.

Digital Library

[10]

Kaiser, R., Weiss, W., Falelakis, M., Michalakopoulos, S., and Ursu, M.F. (2012). A rule-Based Virtual Director Enhancing Group Communication. In 2012 IEEE Conference on Multimedia and Expo Workshops (ICMEW), Melbourne, Australia, 187--192.

Digital Library

[11]

Kirk, D. S., Sellen, A., & Cao, X. (2010). Home video communication: mediating 'closeness'. Proc ACM CSCW, 135--144.

Digital Library

[12]

Kleij, van der, R., Schraagen, J.M., Werkhoven, P., & De Dreu, C.K.W. (2009). How Conversations Change Over Time in Face-to-Face and Video-Mediated Communication. Small Group Research 40(4), 355--381.

[13]

Korchagin, D., Duffner, S., Motlicek, P., and Scheffler, C. (2012). Multimodal Cue Detection Engine for Orchestrated Entertainment. In Proceedings of the International Conference on Multi-Media Modeling (MMM) 2012, Klagenfurt, Austria, 662--670.

Digital Library

[14]

Lessiter, J., Freeman, J., Keogh, E., & Davidoff, J. (2001). A cross-media presence questionnaire: The ITC-Sense of Presence Inventory. Presence: Teleoperators and Virtual Environments, 10(3), 282--297.

Digital Library

[15]

Liu, Z. C., Cohen, M., Bhatnagar, D., Cutler, R., & Zhang, Z. Y. (2007). Head-size equalization for improved visual perception in video conferencing. {Article}. IEEE Trans. on Multimedia, 9(7), 1520--1527.

Digital Library

[16]

Nguyen, D. T., & Canny, J. (2007). Multiview: improving trust in group video conferencing through spatial faithfulness Proc ACM CHI, 1465--1474.

Digital Library

[17]

Nguyen, D. T., & Canny, J. (2009). More than face-to-face: empathy effects of video framing Proc ACM CHI 423--432.

Digital Library

[18]

Psathas, G. (1995). Conversation Analysis, The Study of Talk-in-Interaction (Qualitative Research Methods), Sage.

[19]

Ranjan, A., Birnholtz, J. and Balakrishnan, R. (2008). Improving Meeting Capture by Applying Television Production Principles with Audio and Motion Detection. Proc. ACM CHI, 227--236.

Digital Library

[20]

Scholl, J., Parnes, P., McCarthy, J. D., & Sasse, A. (2005). Designing a large-scale video chat application Proc ACM MM, 71--80.

Digital Library

[21]

Tang, J. C., & Isaacs, E. (1992). Why Do Users Like Video?: Studies of Multimedia-supported Collaboration: Sun Microsystems Laboratories.

Digital Library

[22]

Vishwanath, D., Girshick, A. R., & Banks, M. S. (2005). Why pictures look right when viewed from the wrong place. Nature Neuroscience, 8(10), 1401--1410.

[23]

Walkowski, S., Dörner, R., Lievonen, M., & Rosenberg, D. (2011). Using a game controller for relaying deictic gestures in computer-mediated communication. International Journal of Human-Computer Studies, 69(6), 362--374.

Digital Library

[24]

Wheatley, D. J., & Basapur, S. (2009). A comparative evaluation of TV video telephony with webcam and face to face communication. Proc EuroITV 2009, 1--8.

Digital Library

Cited By

Langa SCliment MCernigliaro GRincon Rivera D(2022)Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV ScenariosIEEE Transactions on Broadcasting10.1109/TBC.2021.312349968:1(13-32)Online publication date: Mar-2022
https://doi.org/10.1109/TBC.2021.3123499
Langa SMontagud MCernigliaro GRivera D(2022)Multiparty Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual RealityIEEE Access10.1109/ACCESS.2022.319628510(81856-81876)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3196285
Montagud MLi JCernigliaro GEl Ali AFernández SCesar P(2022)Towards socialVR: evaluating a novel technology for watching videos togetherVirtual Reality10.1007/s10055-022-00651-526:4(1593-1613)Online publication date: 8-May-2022
https://doi.org/10.1007/s10055-022-00651-5
Show More Cited By

Index Terms

Orchestration: tv-like mixing grammars applied to video-communication for social groups
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Experimental Enquiry into Automatically Orchestrated Live Video Communication in Social Settings
TVX '15: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

'Orchestration' refers to the ability of a live video communication system to adapt in real-time to the communication context with a view to enhance the quality of mediation and subsequently the quality of interaction between participants. For example, ...
Improving video-mediated communication with orchestration

Video-mediated communication (VMC) has become a popular communication medium. However, research to date suggests that the inherent constraints of VMC impair effective and efficient communication and task performance. We propose that these negative ...
Connecting Living Rooms: An Experiment In Orchestrated Video Communication
TVX '16: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

Consumer live video communication has now become an established communication medium, but the current systems are still quite limited in their ability to support natural communication in more complex interaction setups. What new features might be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '13: Proceedings of the 21st ACM international conference on Multimedia

October 2013

1166 pages

ISBN:9781450324045

DOI:10.1145/2502081

General Chairs:
Alejandro (Alex) Jaimes
Yahoo!, Spain
,
Nicu Sebe
University of Trento, Italy
,
Nozha Boujemaa
INRIA, France
,
Program Chairs:
Daniel Gatica-Perez
IDIAP & EPFL, Switzerland
,
David A. Shamma
Yahoo!, USA
,
Marcel Worring
University of Amsterdam, The Netherlands
,
Roger Zimmermann
National University of Singapore, Singapore

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '13

Sponsor:

SIGMM

MM '13: ACM Multimedia Conference

October 21 - 25, 2013

Barcelona, Spain

Acceptance Rates

MM '13 Paper Acceptance Rate 47 of 235 submissions, 20%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
292
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Langa SCliment MCernigliaro GRincon Rivera D(2022)Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV ScenariosIEEE Transactions on Broadcasting10.1109/TBC.2021.312349968:1(13-32)Online publication date: Mar-2022
https://doi.org/10.1109/TBC.2021.3123499
Langa SMontagud MCernigliaro GRivera D(2022)Multiparty Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual RealityIEEE Access10.1109/ACCESS.2022.319628510(81856-81876)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3196285
Montagud MLi JCernigliaro GEl Ali AFernández SCesar P(2022)Towards socialVR: evaluating a novel technology for watching videos togetherVirtual Reality10.1007/s10055-022-00651-526:4(1593-1613)Online publication date: 8-May-2022
https://doi.org/10.1007/s10055-022-00651-5
Li JSubramanyam SJansen JMei YReimat ILawicka KCesar P(2021)Evaluating the user Experience of a Photorealistic Social VR Movie2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR52148.2021.00044(284-293)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR52148.2021.00044
Yang DZhang LWu YLi SLiang DDing G(2019)Computable Framework For Live Sport Broadcast Directing2019 IEEE International Symposium on Multimedia (ISM)10.1109/ISM46123.2019.00054(239-2391)Online publication date: Dec-2019
https://doi.org/10.1109/ISM46123.2019.00054
Awori KVetere FSmith W(2016)Sessions with GrandmaProceedings of the First African Conference on Human Computer Interaction10.1145/2998581.2998585(1-11)Online publication date: 21-Nov-2016
https://dl.acm.org/doi/10.1145/2998581.2998585
Falelakis MUrsu MGeelhoed EKaiser RFrantzis MWhitney PMurray JBasapur SAli Hasan NHuber J(2016)Connecting Living RoomsProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2932206.2932215(49-58)Online publication date: 17-Jun-2016
https://dl.acm.org/doi/10.1145/2932206.2932215
Ursu MFalelakis MGroen MKaiser RFrantzis MGeerts DDe Marez LPauwels CBentley FTimmerer C(2015)Experimental Enquiry into Automatically Orchestrated Live Video Communication in Social SettingsProceedings of the ACM International Conference on Interactive Experiences for TV and Online Video10.1145/2745197.2745211(63-72)Online publication date: 3-Jun-2015
https://dl.acm.org/doi/10.1145/2745197.2745211
Weiss WFalelakis MKaiser RUrsu MAl Moubayed SBohus DEsposito AHeylen DKoutsombogera MPapageorgiou HSkantze G(2014)Models for Decision Making in Video Mediated CommunicationProceedings of the 2014 workshop on Understanding and Modeling Multiparty, Multimodal Interactions10.1145/2666242.2666250(45-50)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1145/2666242.2666250
Weiss WKaiser RFalelakis MAli Salah ACohn JSchuller BAran OMorency LCohen P(2014)Orchestration for Group VideoconferencingProceedings of the 16th International Conference on Multimodal Interaction10.1145/2663204.2669624(72-73)Online publication date: 12-Nov-2014
https://dl.acm.org/doi/10.1145/2663204.2669624
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten