research-article

Automatic generation of video narratives from shared UGC

Authors:

Vilmos Zsombori,

Michael Frantzis,

Rodrigo Laiola Guimaraes,

Marian Florin Ursu,

Roland Craigie,

Dick C.A. BultermanAuthors Info & Claims

HT '11: Proceedings of the 22nd ACM conference on Hypertext and hypermedia

Pages 325 - 334

https://doi.org/10.1145/1995966.1996009

Published: 06 June 2011 Publication History

Abstract

This paper introduces an evaluated approach to the automatic generation of video narratives from user generated content gathered in a shared repository. In the context of social events, end-users record video material with their personal cameras and upload the content to a common repository. Video narrative techniques, implemented using Narrative Structure Language (NSL) and ShapeShifting Media, are employed to automatically generate movies recounting the event. Such movies are personalized according to the preferences expressed by each individual end-user, for each individual viewing. This paper describes our prototype narrative system, MyVideos, deployed as a web application, and reports on its evaluation for one specific use case: assembling stories of a school concert by parents, relatives and friends. The evaluations carried out through focus groups, interviews and field trials, in the Netherlands and UK, provided validating results and further insights into this approach.

References

[1]

Bulterman, Dick C. A. and Rutledge, Lloyd W. 2009. SMIL 3.0: Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books. Springer Publishing Company, Incorporated, ISBN: 978--3--540--78546-0.

Digital Library

[2]

Bocconi, S., Nack, F. and Hardman, L. 2008. Automatic generation of matter-of-opinion video documentaries. Special Issue on Semantic Multimedia, Journal of Web Semantics (JWS), 6(2), pp. 139 -- 150. DOI=http://doi.acm.org/10.1145/1026633.1026636

Digital Library

[3]

Cesar, P., Bulterman, Dick C. A., Guimarães, R. L. and Kegel, I. 2010. Web-Mediated Communication: in Search of Togetherness. In Proceedings of the Web Science Conference (WebSci10), Raleigh, North Carolina, USA.

[4]

Cavazza, M., Champagnat, R., Leonardi, R. and the IRIS Consortium, 2009. The IRIS Network of Excellence: Future Directions in Interactive Storytelling. In Proceedings of the Second International Conference on Interactive Digital Storytelling (ICIDS 2009), Springer LNCS 5915, pp. 8--13. DOI=http://dx.doi.org/10.1007/978--3--642--10643--9_4

Digital Library

[5]

Ibanez, J., Aylett, R., Delgado-Mata, C. and Molinuevo, E. 2009. On the Implications of the Virtual Storyteller's Point of View. The Knowledge Engineering Review, 23(4):339--367. DOI= http://dx.doi.org/10.1017/S0269888908000039

Digital Library

[6]

Kennedy, L. and Naaman, M. 2009. Less talk, more rock: automated organization of community-contributed collections of concert videos. In Proceedings of the 18th international conference on World wide web (WWW '09). ACM, New York, NY, USA, 311--320. DOI=http://doi.acm.org/10.1145/1526709.1526752

Digital Library

[7]

Korchagin, D., Garner, P. N. and Dines, J. 2010. Automatic Temporal Alignment of AV Data with Confidence Estimation. In Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, USA, 2010

[8]

Obrador, P., de Oliveira, R. and Oliver, N. 2010. Supporting personal photo storytelling for social albums. In Proceedings of the international conference on Multimedia (MM '10). ACM, New York, NY, USA, 561--570. DOI=http://doi.acm.org/10.1145/1873951.1874025

Digital Library

[9]

Porteous, J., Benini S., Canini L., Charles, F., Cavazza, M. and Leonardi, R. 2010. Interactive Storytelling via Video Content Recombination. In Proceedings of the 18th ACM International Conference on Multimedia (Short Papers), Firenze, Italy, October 25--29, 2010. DOI=http://dx.doi.org/10.1145/1873951.1874334

Digital Library

[10]

Riedl, M. and Young, R. M. 2006. From Linear Story Generation to Branching Story Graphs, IEEE Journal of Computer Graphics and Applications, May/June: 23--31. DOI= http://doi.ieeecomputersociety.org/10.1109/MCG.2006.56

Digital Library

[11]

Shamma, D. A., Shaw, R., Shafton, P. L. and Liu, Y. 2007. Watch what I watch: using community activity to understand content. In Proceedings of the international workshop on Workshop on multimedia information retrieval (MIR '07). ACM, New York, NY. DOI=http://doi.acm.org/10.1145/1290082.1290120

Digital Library

[12]

Shamma, D. A., Kennedy, L. and Churchill, E. F. 2009. Tweet the Debates: Understanding Community Annotation of Uncollected Sources. In Proceedings of the first SIGMM Workshop on Social Media, pp. 3--10. DOI= http://doi.acm.org/10.1145/1631144.1631148

Digital Library

[13]

Shrestha, P., de With, P. H. N., Weda, H., Barbieri, M. and Aarts, E. H. L. 2010. Automatic mashup generation from multiple-camera concert recordings. In Proceedings of the international conference on Multimedia (MM '10). ACM, New York, NY, USA, 541--550. DOI=http://doi.acm.org/10.1145/1873951.1874023

Digital Library

[14]

Truong, B. T. and Venkatesh, S. 2007. Video abstraction: A systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. 3, 1, Article 3. DOI=http://doi.acm.org/10.1145/1198302.1198305

Digital Library

[15]

Ursu, M. F., Kegel, I., Williams, D., Thomas, M., Mayer, H., Zsombori, V., Tuomola M. L., Larsson, H., and Wyver, J. 2008. ShapeShifting TV -- Interactive Screen Media Narratives. Multimedia Systems Journal, Volume 14, Number 2 / July 2008, ACM/Springer, pages 115--132. DOI=http://dx.doi.org/10.1007/s00530-008-0119-z

Digital Library

[16]

Ursu, M.F., Thomas, M., Kegel, I., Williams, D., Tuomola, M., Lindstedt, I., Wright, T., Leurdijk, A., Zsombori, V., Sussner, J., Maystream, U., and Hall, N., 2008b, Interactive TV Narratives: Opportunities, Progress and Challenges, ACM Transactions on Multimedia Computing, Communications and Applications, 4 (4) : Article 25, pp. 25:1--25:39.

Digital Library

[17]

Ursu, M.F., Zsombori, V., Wyver, J., Conrad, L., Kegel, I., and Williams, D., 2009. Interactive Documentaries: A Golden Age, ACM Computers in Entertainment (CiE), Volume 7, Issue 3, Special Issue: TV and Video Entertainment Environments, Section: Production, Interactivity, and Narrative. September 2009

Digital Library

[18]

Williams, D., Ursu, M. F., Cesar, P., Bergstrom, K., Kegel, I. and Meenowa, J. 2009. An emergent role for TV in social communication. In Proceedings of the seventh european conference on European interactive television conference (EuroITV '09). ACM, New York, NY, USA, 19--28. DOI=http://doi.acm.org/10.1145/1542084.1542088

Digital Library

Cited By

Duan HLiao JLin LEl Saddik ACai W(2024)Meetor: A Human-Centered Automatic Video Editing System for Meeting RecordingsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/364868120:9(1-23)Online publication date: 19-Feb-2024
https://dl.acm.org/doi/10.1145/3648681
Duan HLiao JLin LCai WYan ZZink MLiu Y(2022)FLADProceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video10.1145/3534088.3534349(43-49)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3534088.3534349
Liao JDuan HZhao WYang YChen L(2022)A Light Weight Model for Video Shot Occlusion DetectionICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP43922.2022.9746742(3154-3158)Online publication date: 23-May-2022
https://doi.org/10.1109/ICASSP43922.2022.9746742
Show More Cited By

Index Terms

Automatic generation of video narratives from shared UGC

Recommendations

Interactive video stories from user generated content: a school concert use case
ICIDS'12: Proceedings of the 5th international conference on Interactive Storytelling

This paper describes a web-based narrative system able to generate video compilations, framed as event stories, from a shared repository of video recordings of the event itself and possibly of related events. For this, it employs narrative techniques ...
Interactive documentaries: A Golden Age
SPECIAL ISSUE: TV and Video Entertainment Environments

This article is motivated by the opportunity presented by recent advances in information and communication technology—particularly by faster broadband connections and faster digital media processing capabilities—for interactive television to extend and ...
Interactive TV narratives: Opportunities, progress, and challenges

This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...

Comments

Information & Contributors

Information

Published In

HT '11: Proceedings of the 22nd ACM conference on Hypertext and hypermedia

June 2011

348 pages

ISBN:9781450302562

DOI:10.1145/1995966

General Chair:
Paul De Bra
Eindhoven University of Technology, the Netherlands
,
Program Chair:
Kaj Grønbæk
Aarhus University, Denmark

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HT '11

Sponsor:

SIGWEB

HT '11: 22nd ACM Conference on Hypertext and Hypermedia

June 6 - 9, 2011

Eindhoven, The Netherlands

Acceptance Rates

Overall Acceptance Rate 378 of 1,158 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
541
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Duan HLiao JLin LEl Saddik ACai W(2024)Meetor: A Human-Centered Automatic Video Editing System for Meeting RecordingsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/364868120:9(1-23)Online publication date: 19-Feb-2024
https://dl.acm.org/doi/10.1145/3648681
Duan HLiao JLin LCai WYan ZZink MLiu Y(2022)FLADProceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video10.1145/3534088.3534349(43-49)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3534088.3534349
Liao JDuan HZhao WYang YChen L(2022)A Light Weight Model for Video Shot Occlusion DetectionICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP43922.2022.9746742(3154-3158)Online publication date: 23-May-2022
https://doi.org/10.1109/ICASSP43922.2022.9746742
Multisilta JNiemi H(2019)Tools, Pedagogical Models, and Best Practices for Digital StorytellingAdvanced Methodologies and Technologies in Modern Education Delivery10.4018/978-1-5225-7365-4.ch040(508-519)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-7365-4.ch040
Viel CRodrigues KCunha BPimentel Mdos Santos JMuchaluat Saade Dda Graça C. Pimentel MMacedo A(2019)Elderly vloggersProceedings of the 25th Brazillian Symposium on Multimedia and the Web10.1145/3323503.3360303(185-192)Online publication date: 29-Oct-2019
https://dl.acm.org/doi/10.1145/3323503.3360303
Huber BShin HRussell BWang OMysore GBrewster SFitzpatrick GCox AKostakos V(2019)B-ScriptProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300311(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300311
Bakkay MPizenberg MCarlier ABalavoine EMorin GCharvillat V(2019)Protocols and software for simplified educational video capture and editingJournal of Computers in Education10.1007/s40692-019-00136-6Online publication date: 20-Mar-2019
https://doi.org/10.1007/s40692-019-00136-6
Jorge ACampos RJatowt ABhatia S(2019)The 2nd International Workshop on Narrative Extraction from Text: Text2Story 2019Advances in Information Retrieval10.1007/978-3-030-15719-7_54(389-393)Online publication date: 7-Apr-2019
https://doi.org/10.1007/978-3-030-15719-7_54
Multisilta JNiemi H(2018)Tools, Pedagogical Models, and Best Practices for Digital StorytellingEncyclopedia of Information Science and Technology, Fourth Edition10.4018/978-1-5225-2255-3.ch230(2641-2650)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2255-3.ch230
Wilkinson GBartindale TNappey TEvans MWright POlivier PMandryk RHancock MPerry MCox A(2018)Media of ThingsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173780(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173780
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents