research-article

Improving meeting capture by applying television production principles with audio and motion detection

Authors:

Abhishek Ranjan,

Jeremy Birnholtz,

Ravin BalakrishnanAuthors Info & Claims

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 227 - 236

https://doi.org/10.1145/1357054.1357095

Published: 06 April 2008 Publication History

Abstract

Video recordings of meetings are often monotonous and tedious to watch. In this paper, we report on the design, implementation and evaluation of an automated meeting capture system that applies television production principles to capture and present videos of small group meetings in a compelling manner. The system uses inputs from a motion capture system and microphones to drive multiple pan-tilt-zoom cameras and uses heuristics to frame shots and cut between them. An evaluation of the system indicates that its performance approaches that of a professional crew while requiring significantly fewer human resources.

Supplementary Material

index.html (index.html)

Slides from the presentation

Download
1.02 KB

ZIP File (p227-slides.zip)

Supplemental material for Improving meeting capture by applying television production principles with audio and motion detection

Download
16.77 MB

Audio only (1357095.mp3)

Download
8.89 MB

Video (1357095.mp4)

Download
122.41 MB

References

[1]

Abowd, G. Classroom 2000: an experiment with the instrumentation of a living educational environment. IBM Systems Journal, 38, 4 (1999). 508--530.

Digital Library

[2]

Arijon, D. Grammar of the film language. Silman-James Press, 1991.

[3]

Bianchi, M.H., AutoAuditorium: a fully automatic, multi-camera system to televise auditorium presentations. In Joint DARPA/NIST Smart Spaces Technology Workshop (1998).

[4]

Birnholtz, J.P., Ranjan, A. and Balakrishnan, R. Using motion tracking data to augment video recordings in experimental social science research. In E-Social Science (2007) (in online proceedings).

[5]

Donald, R. and Spann, T. Fundamentals of TV production. Blackwell Publication, 2000.

[6]

Gaver, W., Sellen, A., Heath, C. and Luff, P. One is not enough: multiple views in a media space. In InterCHI Conference (1993), 335--341.

Digital Library

[7]

Gaver, W.W., The affordances of media spaces for collaboration. In ACM CSCW (1999), 17--24.

Digital Library

[8]

Human-Synergistics, The subarctic survival simulation (http://www.human-synergistics.com.au/content/products/simulations/survival.asp).

[9]

Indico, http://indico.cern.ch.

[10]

Inoue, T., Okada, K. and Matsushita, Y. Evaluation of a videoconferencing system based on TV programs. In IEEE 19th International Convention of Electrical and Electronics Engineers in Israel (1996), 436--439.

[11]

Inoue, T., Okada, K. and Matsushita, Y. Learning from TV programs: application of TV presentation to a videoconferencing system. In ACM UIST (1995), 147--154.

Digital Library

[12]

Jaimes, A., Omura, K., Nagamine, T. and Hirata, K. Memory cues for meeting video retrieval. In ACM CARPE (2004), 74--85.

Digital Library

[13]

Kuney, J. Take one: television directors on directing. Praeger Publishers, 1990.

[14]

Liu, Q., Kimber, D., Foote, J., Wilcox, L. and Boreczky, J. FLYSPEC: a multi-user video camera system with hybrid human and automatic control. In ACM Multimedia (2002), 484--492.

Digital Library

[15]

Liu, Q., Rui, Y., Gupta, A. and Cadiz, J.J. Automating camera management for lecture room environments. In ACM CHI (2001), 442--449.

Digital Library

[16]

Lottridge, D. Hedonic affective response as a measure of human performance. http://www.imedia.mie.utoronto.ca/IML/model/technical_reports.php, University of Toronto, Interactive Media Lab, Toronto, 2007.

[17]

Meetings in america V: meeting of the minds, http://e-meetings.verizonbusiness.com/meetingsinamerica/pdf/MIA5.pdf (2003).

[18]

Meetings in america: a study of trends, costs, and attitudes toward business travel and teleconferencing, and their impact on productivity, http://e-meetings.verizonbusiness.com/meetingsinamerica/uswhitepaper.php (1999).

[19]

MeetingSense, www.meetingsense.com/.

[20]

Nickel, K. and Stiefelhagen, R. Pointing gesture recognition based on 3-D tracking of face, hands and head orientation. In ACM ICMI (2003), 140--146.

Digital Library

[21]

Ou, J., Oh, L.M., Fussell, S.R., Blum, T. and Yang, J. Analyzing and predicting focus of attention in remote collaborative tasks. In ACM ICMI (2005), 116--123.

Digital Library

[22]

Poltrock, S.E. and Engelbeck, G. Requirements for a virtual collocation environment. In ACM GROUP (1997), 61--70.

Digital Library

[23]

Polycom, http://www.polycom.com/.

[24]

Ranjan, A., Birnholtz, J.P. and Balakrishnan, R. An exploratory analysis of partner action and camera control in a video-mediated collaborative task. In ACM CSCW (2006), 403--412.

Digital Library

[25]

Rosenschein, S.J. Meeting capture: an essential part of the collaboration toolkit, http://www.cxoamerica.com/pastissue/article.asp?art=268314&issue=202#top.

[26]

Rosenschein, S.J., Quindi meeting companion: a personal meeting-capture tool. In ACM CARPE (2004), 112--113.

Digital Library

[27]

Rubin, A.M. The uses-and-gratifications perspective of media effects. Media Effects: Advances in theory and persuasion (2002), 525--548.

[28]

Rui, Y., Gupta, A. and Cadiz, J.J. Viewing meeting captured by an omni-directional camera. In ACM CHI (2001), 450--457.

Digital Library

[29]

Rui, Y., Gupta, A. and Grudin, J. Videography for telepresentations. In ACM CHI (2003), 457--464.

Digital Library

[30]

Sellen, A.J. Speech patterns in video-mediated conversations. In ACM CHI (1992), 49--59.

Digital Library

[31]

Stiefelhagen, R., Yang, J. and Waibel, A. Modeling focus of attention for meeting indexing. In ACM Multimedia (Part 1) (1993), 3--10.

Digital Library

[32]

Takemae, Y., Otsuka, K. and Mukawa, N. Video cut editing rule based on participants' gaze in multiparty conversation. In ACM Multimedia (2003), 303--306.

Digital Library

[33]

Takemae, Y., Otsuka, K. and Yamato, J. Automatic video editing system using stereo-based head tracking for multiparty conversation. In ACM CHI extended abstracts (2005), 1817--1820.

Digital Library

[34]

Vertegaal, R. The GAZE groupware system: mediating joint attention in multiparty communication and collaboration. In ACM CHI (1999), 294--301.

Digital Library

[35]

Vertegaal, R., Weevers, I., Sohn, C. and Cheung, C. GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction. In ACM CHI (2003), 521 -- 528.

Digital Library

[36]

Vicon, http://www.vicon.com/.

[37]

WLAP, http://www.wlap.org/.

[38]

Zettl, H. Television production handbook. Thomson Wadsworth, 2005.

Cited By

Duan HLiao JLin LEl Saddik ACai W(2024)Meetor: A Human-Centered Automatic Video Editing System for Meeting RecordingsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/364868120:9(1-23)Online publication date: 19-Feb-2024
https://dl.acm.org/doi/10.1145/3648681
Qian XTan FZhang YCollins BKim DOlwal ARamani KDu R(2024)ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout TransitionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642110(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642110
Achary SGirmaji RDeshmukh AGandhi V(2024)Real Time GAZED: Online Shot Selection and Editing of Virtual Cameras from Wide-Angle Monocular Video Recordings2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00406(4096-4104)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00406
Show More Cited By

Index Terms

Improving meeting capture by applying television production principles with audio and motion detection
1. Human-centered computing

Recommendations

Automatic camera control using unobtrusive vision and audio tracking
GI '10: Proceedings of Graphics Interface 2010

While video can be useful for remotely attending and archiving meetings, the video itself is often dull and difficult to watch. One key reason for this is that, except in very high-end systems, little attention has been paid to the production quality of ...
Using motion capture for interactive motion editing
VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Motion capture technology has been widely used for creating character motions. Motion editing is usually also required to adjust captured motions. Because character poses which include joint rotations, body positions, and orientations are high-...
Video-Interfaced Human Motion Capture Data Retrieval Based on the Normalized Motion Energy Image Representation
Neural Information Processing
Abstract
To retrieve expected clips from human motion capture (MoCap) databases for effective reuse with a user-friendly interface is a challenging task. In this work, we propose an effective video-based human MoCap data retrieval scheme, which lets the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2008

1870 pages

ISBN:9781605580111

DOI:10.1145/1357054

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

CHI '08 Paper Acceptance Rate 157 of 714 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
1,117
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Duan HLiao JLin LEl Saddik ACai W(2024)Meetor: A Human-Centered Automatic Video Editing System for Meeting RecordingsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/364868120:9(1-23)Online publication date: 19-Feb-2024
https://dl.acm.org/doi/10.1145/3648681
Qian XTan FZhang YCollins BKim DOlwal ARamani KDu R(2024)ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout TransitionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642110(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642110
Achary SGirmaji RDeshmukh AGandhi V(2024)Real Time GAZED: Online Shot Selection and Editing of Virtual Cameras from Wide-Angle Monocular Video Recordings2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00406(4096-4104)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00406
Hwang ELee J(2024)Attention-based automatic editing of virtual lectures for reduced production labor and effective learning experienceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103161181:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103161
Chen BZiai ATucker RXie Y(2023)Match Cutting: Finding Cuts with Smooth Visual Transitions2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00215(2114-2124)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00215
Fujisawa KHirabe YSuwa HArakawa YYasumoto K(2018)Automatic Live Sport Video Streams Curation System From User Generated MediaSports Media, Marketing, and Management10.4018/978-1-5225-5475-2.ch022(417-435)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5475-2.ch022
Viel CZimmermann LRodrigues KPimentel MNeto MNovais RFerraz CViana W(2018)Recording Maybe?Proceedings of the 24th Brazilian Symposium on Multimedia and the Web10.1145/3243082.3243102(53-60)Online publication date: 16-Oct-2018
https://dl.acm.org/doi/10.1145/3243082.3243102
Hassib MSchneegass SHenze NSchmidt AAlt FMandryk RHancock MPerry MCox A(2018)A Design Space for Audience Sensing and Feedback SystemsExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3188569(1-6)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3188569
Tsuchida SFukayama SGoto M(2018)Automatic System for Editing Dance Videos Recorded Using Multiple CamerasAdvances in Computer Entertainment Technology10.1007/978-3-319-76270-8_47(671-688)Online publication date: 21-Feb-2018
https://doi.org/10.1007/978-3-319-76270-8_47
Serrano ASitzmann VRuiz-Borau JWetzstein GGutierrez DMasia B(2017)Movie editing and cognitive event segmentation in virtual reality videoACM Transactions on Graphics10.1145/3072959.307366836:4(1-12)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073668
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten