poster

Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation

Authors:

Evlampios Apostolidis,

Vasileios Mezaris,

Mathilde Sahuguet,

Barbora Červenková,

Stefan Eickeler,

José Luis Redondo Garcia,

Raphaël Troncy,

Lukás PikoraAuthors Info & Claims

MM '14: Proceedings of the 22nd ACM international conference on Multimedia

Pages 1033 - 1036

https://doi.org/10.1145/2647868.2655041

Published: 03 November 2014 Publication History

Abstract

This paper introduces a framework for establishing links between related media fragments within a collection of videos. A set of analysis techniques is applied for extracting information from different types of data. Visual-based shot and scene segmentation is performed for defining media fragments at different granularity levels, while visual cues are detected from keyframes of the video via concept detection and optical character recognition (OCR). Keyword extraction is applied on textual data such as the output of OCR, subtitles and metadata. This set of results is used for the automatic identification and linking of related media fragments. The proposed framework exhibited competitive performance in the Video Hyperlinking sub-task of MediaEval 2013, indicating that video scene segmentation can provide more meaningful segments, compared to other decomposition methods, for hyperlinking purposes.

References

[1]

R. Aly, M. Eskevich, R. Ordelman, et al. Adapting binary information retrieval evaluation metrics for segment-based retrieval tasks. Technical report, ArXiv e-prints, 2013.

[2]

E. Apostolidis and V. Mezaris. Fast shot segmentation combining global and local visual descriptors. In Proc. IEEE ICASSP, Florence, Italy, May 2014.

[3]

W. Bailer, M. Lokaj, and H. Stiegler. Context in video search: Is close-by good enough when using linking? In ACM ICMR, Glasgow, UK, April 1--4 2014.

Digital Library

[4]

C. A. Bhatt, N. Pappas, M. Habibi, et al. Multimodal reranking of content-based recommendations for hyperlinking video snippets. In ACM ICMR, Glasgow, UK, April 1--4 2014.

Digital Library

[5]

S. Chen, G. J. F. Jones, and N. E. O'Connor. DCU linking runs at MediaEval 2013: Search and Hyperlinking task. In MediaEval, 2013.

[6]

M. Eskevich, R. Aly, R. Ordelman, et al. The Search and Hyperlinking task at MediaEval 2013. In MediaEval, 2013.

[7]

C. Guinaudeau, A.-R. Simon, G. Gravier, et al. HITS and IRISA at MediaEval 2013: Search and Hyperlinking task. In MediaEval, 2013.

[8]

T. D. Nies, W. D. Neve, E. Mannens, et al. Ghent University-iMinds at MediaEval 2013: An unsupervised named entity-based similarity measure for search and hyperlinking. In MediaEval, 2013.

[9]

P. Over, G. Awad, M. Michel, et al. TRECVID 2012 -- An overview of the goals, tasks, data, evaluation mechanisms and metrics. In Proc. of TRECVID 2012. NIST, USA, 2012.

[10]

J. Preston, J. S. Hare, S. Samangooei, et al. A unified, modular and multimodal approach to search and hyperlinking video. In MediaEval, 2013.

[11]

K. Schouten, R. Aly, and R. Ordelman. Searching and Hyperlinking using word importance segment boundaries in MediaEval 2013. In MediaEval, 2013.

[12]

P. Sidiropoulos, V. Mezaris, and I. Kompatsiaris. Enhancing video concept detection with the use of tomographs. In Proc. IEEE ICIP, 2013.

[13]

P. Sidiropoulos, V. Mezaris, I. Kompatsiaris, et al. Temporal video segmentation to scenes using high-level audiovisual features. IEEE Trans. on CSVT, 21(8):1163--1177, Aug. 2011.

Digital Library

[14]

D. Stein, S. Eickeler, R. Bardeli, et al. Think before you link -- Meeting content constraints when linking television to the web. In NEM Summit 2013, 28--30 October 2013, Nantes, France.

[15]

S. Tschöpel and D. Schneider. A lightweight keyword and tag-cloud retrieval algorithm for automatic speech recognition transcripts. In Proc. 11th Annual Conf. of the Int. Speech Communication Association, 2010.

[16]

C. Ventura, M. Tella-Amo, and X. G. i Nieto. UPC at MediaEval 2013 Hyperlinking task. In MediaEval, 2013.

[17]

M. Yeung, B.-L. Yeo, and B. Liu. Segmentation of video by clustering and graph analysis. Comp. Vision and Image Underst., 71(1):94--109, July 1998.

Digital Library

Cited By

Liu CJin YXu KGong GMu Y(2020)Beyond Short-Term Snippet: Video Relation Detection With Spatio-Temporal Global Context2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.01085(10837-10846)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.01085
Budnik MDemirdelen MGravier G(2018)A Study on Multimodal Video Hyperlinking with Visual Aggregation2018 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2018.8486549(1-6)Online publication date: Jul-2018
https://doi.org/10.1109/ICME.2018.8486549
Ben Ahmed OSargent GGarnier FHuet BClaveau VCouturier LTroncy RGravier GBouzy PLeménorel FLiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)NexGenTVProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3127929(1259-1260)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3127929
Show More Cited By

Index Terms

Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation
1. Information systems
  1. Information retrieval
    1. Document representation
    2. Retrieval models and ranking

Recommendations

Perceptual Organization for Scene Segmentation and Description

A data-driven system for segmenting scenes into objects and their components is presented. This segmentation system generates hierarchies of features that correspond to structural elements such as boundaries and surfaces of objects. The technique is ...
Con-Text: Text Detection for Fine-Grained Object Classification
This paper focuses on fine-grained object classification using recognized scene text in natural images. While the state-of-the-art relies on visual cues only, this paper is the first work which proposes to combine textual and visual cues. Another novelty ...
Evaluating Keyword Selection Methods for WEBSOM Text Archives

Abstract--The WEBSOM methodology, proven effective for building very large text archives, includes a method that extracts labels for each document cluster assigned to nodes in the map. However, the WEBSOM method needs to retrieve all the words of all ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '14: Proceedings of the 22nd ACM international conference on Multimedia

November 2014

1310 pages

ISBN:9781450330633

DOI:10.1145/2647868

General Chairs:
Kien A. Hua
University of Central Florida, USA
,
Yong Rui
Microsoft Research, China
,
Ralf Steinmetz
Technische Universitt Darmstadt, Germany
,
Program Chairs:
Alan Hanjalic
Delft University of Technology, Netherlands
,
Apostol (Paul) Natsev
Google, USA
,
Wenwu Zhu
Tsinghua University, China

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Seventh Framework Programme

Conference

MM '14

Sponsor:

SIGMM

MM '14: 2014 ACM Multimedia Conference

November 3 - 7, 2014

Florida, Orlando, USA

Acceptance Rates

MM '14 Paper Acceptance Rate 55 of 286 submissions, 19%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
146
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu CJin YXu KGong GMu Y(2020)Beyond Short-Term Snippet: Video Relation Detection With Spatio-Temporal Global Context2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.01085(10837-10846)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.01085
Budnik MDemirdelen MGravier G(2018)A Study on Multimodal Video Hyperlinking with Visual Aggregation2018 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2018.8486549(1-6)Online publication date: Jul-2018
https://doi.org/10.1109/ICME.2018.8486549
Ben Ahmed OSargent GGarnier FHuet BClaveau VCouturier LTroncy RGravier GBouzy PLeménorel FLiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)NexGenTVProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3127929(1259-1260)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3127929
Shang XRen TGuo JZhang HChua TLiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)Video Visual Relation DetectionProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3123380(1300-1308)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3123380
Cheng ZZhang HWu XNgo CIonescu BSebe NFeng JLarson MLienhart RSnoek C(2017)On the Selection of Anchors and Targets for Video HyperlinkingProceedings of the 2017 ACM on International Conference on Multimedia Retrieval10.1145/3078971.3079025(287-293)Online publication date: 6-Jun-2017
https://dl.acm.org/doi/10.1145/3078971.3079025
Jiang LBourdeau JHendler JNkambou RHorrocks IZhao B(2016)Web-scale Multimedia Search for Internet Video ContentProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2888599(311-316)Online publication date: 11-Apr-2016
https://dl.acm.org/doi/10.1145/2872518.2888599
Cheng DJiang LGong YZheng NHauptmann A(2016)Video Search via Ranking Network with Very Few Query ExemplarsMultiMedia Modeling10.1007/978-3-319-51814-5_35(419-430)Online publication date: 31-Dec-2016
https://doi.org/10.1007/978-3-319-51814-5_35
García JRizzo GTroncy RBarker KGómez-Pérez J(2015)Capturing News Stories Once, Retelling a Thousand WaysProceedings of the 8th International Conference on Knowledge Capture10.1145/2815833.2816951(1-4)Online publication date: 7-Oct-2015
https://dl.acm.org/doi/10.1145/2815833.2816951
Ordelman RAly REskevich MHuet BJones GGravier GLarson MJones GOrdelman R(2015)Convenient Discovery of Archived Video Using Audiovisual HyperlinkingProceedings of the Third Edition Workshop on Speech, Language & Audio in Multimedia10.1145/2802558.2814652(23-26)Online publication date: 30-Oct-2015
https://dl.acm.org/doi/10.1145/2802558.2814652
Eskevich MBui QLe HHuet BGravier GLarson MJones GOrdelman R(2015)Exploring Video Hyperlinking in Broadcast MediaProceedings of the Third Edition Workshop on Speech, Language & Audio in Multimedia10.1145/2802558.2814647(35-38)Online publication date: 30-Oct-2015
https://dl.acm.org/doi/10.1145/2802558.2814647
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents