Article

Story boundary detection in large broadcast news video archives: techniques, experience and trends

Authors:

Lekha Chaisorn,

Winston HsuAuthors Info & Claims

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

Pages 656 - 659

https://doi.org/10.1145/1027527.1027679

Published: 10 October 2004 Publication History

Abstract

The segmentation of news video into story units is an important step towards effective processing and management of large news video archives. In the story segmentation task in TRECVID 2003, a wide variety of techniques were employed by many research groups to segment over 120-hour of news video. The techniques employed range from simple anchor person detector to soisticated machine learning models based on HMM and Maximum Entropy (ME) approaches. The general results indicate that the judicious use of multi-modality features coupled with rigorous machine learning models could produce effective solutions. This paper presents the algorithms and experience learned in TRECVID evaluations. It also points the way towards the development of scalable technology to process large news video corpuses.

References

[1]

J. Allan, J. Carbonell, G. Doddington, J. Yamron & Y. Yang (1998). Topic detection and tracking pilot study final report. Proceedings of DARPA Broadcast News Transcription and Understanding Workshop. 194--218.

[2]

P. Browne, C. Czirjek, G. Gaughan, C. Gurrin, G. J.F. Jones, H. Lee, S. Marlow, K. Mac Donald, N. Mury, N. E. O'Connor, N. Hare, A. F. Smeaton, & J. Ye (2003). Dublin City University video track experiments for TREC 2003. Notebook submitted to TRECVID 2003.

[3]

L. Chaisorn, T.-S Chua, C.-K Koh, Y.-L Zhao, H. Xu, H. Feng & Q. Tian (2003). A two-level multi-modal approach for story segmentation of large news video corpus, Proceedings of TRECVID workshop 2003.

[4]

D. Eichmann & D.-J. Park (2003). Experiments in boundaries recognition at the University of Iowa. Notebook submitted to TRECVID 2003.

[5]

M. Franz, J. S. McCarley, S. Roukos, T. Ward, and W.-J. Zhu,"Segmentation and detection at IBM: Hybrid statistical models and two-tiered clustering broadcast news domain," in Proceedings of TDT-3 Workshop, 2000.

[6]

J.L. Gauvain, L. Lamel & G. Adda (2002). The LIMSI broadcast news transcription system. Speech Communication, 37(1-2):89--108.

Digital Library

[7]

M.A. Hearst (1994). Multi-paragra segmentation of expository text. Proc of the 32nd Annual Meeting of the Association for Computational Linguistics.

Digital Library

[8]

W. Hsu, S.-F. Chang, C.-W. Huang, L. Kennedy, C.-Y. Lin, and G. Iyengar, "Discovery and fusion of salient multi-modal features towards news story segmentation," in IS&T/SPIE Electronic Imaging, San Jose, CA, 2004.

[9]

W. Hsu and S.-F. Chang, "Generative, Discriminative, and Ensemble Learning on Multi-modal Perceptual Fusion toward News Video Story Segmentation," IEEE International Conference on Multimedia and Expo, Taipei, Taiwan, June 27-30, 2004.

[10]

P. Rennert (2003). StreameSage unsupervised ASR-based topic segmentation. Proceedings of TRECVID workshop.

[11]

J.C. Reynar (1994). An automatic method of finding topic boundaries. Proc. of the 32nd Annual Meeting of the Association for Computational Linguistics.

Digital Library

[12]

TREC Video Retrieval Evaluation (2003), http://www-nlpir.nist.gov/projects/tv2003/tv2003.html. Washington D.C., 17-18 Nov, 2003.

[13]

J. Vaissiere, "Language-independent prosodic features," in Prosody: Models and Measurements, Anne Cutler and D. Robert Ladd, Eds., pp. 53--66. Springer, Berlin, 1983.

[14]

L. Wu, Y. Guo, X. Qiu, Z. Feng, J. Rong, W. Jin, D. Zhou, R. Wang & M. Jing (2003). Fudan University at TRECVID 2003. Notebook submitted to TRECVID 2003.

[15]

Y. Zhai, Z. Rasheed & M. Shah (2003). Univerisity of Central Florida at TRECVID 2003. Notebook submitted to TRECVID 2003.

[16]

Zugano, K. Hoashi, K. Mutsumato, F. Sugaya & Y. Nakajima (2003). Shot boundary determination on MPEG compressed domain and story segmentation experiments for TRECVID 2003. Notebook in TRECVID 2003.

Cited By

Gulia SPandey PRaghav Y(2024)Multimedia Data in Healthcare SystemSupervised and Unsupervised Data Engineering for Multimedia Data10.1002/9781119786443.ch3(63-92)Online publication date: May-2024
https://doi.org/10.1002/9781119786443.ch3
Ruangrotsakun AOh DNguyen TLee KSer MHiew ANgo RShureih ZKhanna RKahng M(2023)VIVA: Visual Exploration and Analysis of Videos with Interactive AnnotationCompanion Proceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581754.3584160(162-165)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581754.3584160
Bhatti MSiddiqi IMoetesum M(2023)LSTM-based Siamese neural network for Urdu news story segmentationInternational Journal on Document Analysis and Recognition (IJDAR)10.1007/s10032-023-00441-y26:3(363-373)Online publication date: 3-Jun-2023
https://doi.org/10.1007/s10032-023-00441-y
Show More Cited By

Index Terms

Story boundary detection in large broadcast news video archives: techniques, experience and trends
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing

Recommendations

Discovering salient prosodic cues and their interactions for automatic story segmentation in Mandarin broadcast news

This paper investigates speech prosody for automatic story segmentation in Mandarin broadcast news. Prosodic cues effectively used in English story segmentation deserve a re-investigation since the lexical tones of Mandarin may complicate the ...
Story Segmentation and Detection of Commercials in Broadcast News Video
ADL '98: Proceedings of the Advances in Digital Libraries Conference

The Informedia Digital Library Project [Wactlar96] allows full content indexing and retrieval of text, audio and video material. Segmentation is an integral process in the Informedia digital video library. The success of the Informedia project hinges on ...
Unsupervised story segmentation and indexing of broadcast news video
Abstract
This paper presents a novel technique for story segmentation of news videos. The visual similarity, silence in the audio and the text in text boxes of a news video are used as parameters to define the story boundaries. Each of these parameters is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

October 2004

1028 pages

ISBN:1581138938

DOI:10.1145/1027527

General Chairs:
Henning Schulzrinne
Columbia University
,
Nevenka Dimitrova
Philips Research
,
Program Chairs:
Angela Sasse
UCL
,
Sue Moon
KAIST
,
Rainer Lienhart
U Augsburg

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 10 - 16, 2004

NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
657
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gulia SPandey PRaghav Y(2024)Multimedia Data in Healthcare SystemSupervised and Unsupervised Data Engineering for Multimedia Data10.1002/9781119786443.ch3(63-92)Online publication date: May-2024
https://doi.org/10.1002/9781119786443.ch3
Ruangrotsakun AOh DNguyen TLee KSer MHiew ANgo RShureih ZKhanna RKahng M(2023)VIVA: Visual Exploration and Analysis of Videos with Interactive AnnotationCompanion Proceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581754.3584160(162-165)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581754.3584160
Bhatti MSiddiqi IMoetesum M(2023)LSTM-based Siamese neural network for Urdu news story segmentationInternational Journal on Document Analysis and Recognition (IJDAR)10.1007/s10032-023-00441-y26:3(363-373)Online publication date: 3-Jun-2023
https://doi.org/10.1007/s10032-023-00441-y
Kannao RGuha PChaudhuri B(2022)Only overlay text: novel features for TV news broadcast video segmentationMultimedia Tools and Applications10.1007/s11042-022-12917-w81:21(30493-30517)Online publication date: 6-Apr-2022
https://doi.org/10.1007/s11042-022-12917-w
Segall RLu S(2019)Data Linkage Discovery ApplicationsAdvanced Methodologies and Technologies in Network Architecture, Mobile Computing, and Data Analytics10.4018/978-1-5225-7598-6.ch026(354-366)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-7598-6.ch026
Haloi PGadde PBhuyan M(2019)News Video Indexing and Story Unit Segmentation using Text Cue2019 International Conference on Wireless Communications Signal Processing and Networking (WiSPNET)10.1109/WiSPNET45539.2019.9032814(501-507)Online publication date: Mar-2019
https://doi.org/10.1109/WiSPNET45539.2019.9032814
Kannao RGuha P(2019)Segmenting with style: detecting program and story boundaries in TV news broadcast videosMultimedia Tools and Applications10.1007/s11042-019-7699-978:22(31925-31957)Online publication date: 27-Jul-2019
https://doi.org/10.1007/s11042-019-7699-9
Segall RLu S(2018)Data Linkage Discovery ApplicationsEncyclopedia of Information Science and Technology, Fourth Edition10.4018/978-1-5225-2255-3.ch155(1783-1793)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2255-3.ch155
Hua XWang M(2018)Video Content StructureEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1020(4393-4399)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1020
Qu BVallet FCarrive JGravier G(2017)Content-based unsupervised segmentation of recurrent TV programs using grammatical inferenceMultimedia Tools and Applications10.1007/s11042-017-4816-576:21(22569-22597)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1007/s11042-017-4816-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents