research-article

An accurate lecture video segmentation method by using sift and adaptive threshold

Authors:

Hyun Ji Jeong,

Tak-Eun Kim,

Myoung Ho KimAuthors Info & Claims

MoMM '12: Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia

Pages 285 - 288

https://doi.org/10.1145/2428955.2429011

Published: 03 December 2012 Publication History

Get Access

Abstract

Much research has been done in the past for segmenting lecture videos by detecting slide transitions. However, they do not perform well on certain kinds of videos recorded under non-stationary settings: the changes of a camera position or focus during a lecture. Since such non-stationary settings greatly affect visual properties of slides, the existing approaches utilizing global features and a global threshold, often have trouble in computing similarities between slides. In this paper, we propose a highly accurate method for lecture video segmentation by using SIFT and an adaptive threshold. By using SIFT, we can reliably match two slides whose contents are the same but are visually different. We also propose an adaptive threshold selection algorithm that detects slide transitions accurately by considering characteristics of features. Through various experiments that use real lecture videos, we show that our method provides 30% improvement in the average F₁-score over other existing methods.

References

[1]

Sugata Mukhopadhyay and Brian Smith. 1999. Passive capture and structuring of lectures. In Proceedings of the seventh ACM international conference on Multimedia (Part 1) (MULTIMEDIA '99). ACM, New York, NY, USA, 477--487. DOI=10.1145/319463.319690

Digital Library

Google Scholar

[2]

Weiming Hu; Nianhua Xie; Li Li; Xianglin Zeng; Maybank, S.;, "A Survey on Visual Content-Based Video Indexing and Retrieval," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 41, no. 6, pp. 797--819, Nov. 2011

Digital Library

Google Scholar

[3]

Chong-Wah Ngo; Ting-Chuen Pong; Huang, T. S.;, "Detection of slide transition for topic indexing," Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on, vol. 2, no., pp. 533--536 vol. 2, 2002.

Crossref

Google Scholar

[4]

Chong-Wah Ngo; Feng Wang; Ting-Chuen Pong;, "Structuring lecture videos for distance learning applications," Multimedia Software Engineering, 2003. Proceedings. Fifth International Symposium on, vol., no., pp. 215--222, 10--12 Dec. 2003.

Crossref

Google Scholar

[5]

Quanfu Fan; Amir, A.; Barnard, K.; Swaminathan, R.; Efrat, A.;, "Temporal Modeling of Slide Change in Presentation Videos," Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, vol. 1, no., pp. I-989--I-992, 15--20 April 2007.

Crossref

Google Scholar

[6]

David G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60, 2 (2004), pp. 91--110

Digital Library

Google Scholar

Cited By

View all

Kumar ARizvi D(2024)(S2M Semiotics Similarity Measurement and Information Quantification, Lecture Information Weightage CalculationSN Computer Science10.1007/s42979-024-03541-66:1Online publication date: 18-Dec-2024
https://dl.acm.org/doi/10.1007/s42979-024-03541-6
Varma SPandey AShivam Das SRoy S(2022)Video Indexing System Based on Multimodal Information Extraction Using Combination of ASR and OCRBig-Data-Analytics in Astronomy, Science, and Engineering10.1007/978-3-030-96600-3_14(201-208)Online publication date: 18-Feb-2022
https://doi.org/10.1007/978-3-030-96600-3_14
Das ADas P(2020)Semantic Segmentation of MOOC Lecture Videos by Analyzing Concept Change in Domain Knowledge GraphDigital Libraries at Times of Massive Societal Transition10.1007/978-3-030-64452-9_5(55-70)Online publication date: 26-Nov-2020
https://doi.org/10.1007/978-3-030-64452-9_5
Show More Cited By

Index Terms

An accurate lecture video segmentation method by using sift and adaptive threshold
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Video summarization

Recommendations

Lecture video segmentation by automatically analyzing the synchronized slides
MM '13: Proceedings of the 21st ACM international conference on Multimedia

In this paper we propose a solution which segments lecture video by analyzing its supplementary synchronized slides. The slides content derives automatically from OCR (Optical Character Recognition) process with an approximate accuracy of 90%. Then we ...
Automatic detection of slide transitions in lecture videos

This paper presents a method to automatically detect slide changes in lecture videos. For accurate detection, the regions capturing slide images are first identified from video frames. Then, SIFT features are extracted from the regions, which are ...
Video segmentation algorithm using threshold and weighting based on moving sliding window
ICACT'09: Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3

The video segmentation is a main technique for automatic management of video data. We propose the video segmentation algorithm using thresholds and weighting based on moving sliding window. The proposed method generates threshold and weighting factor ...

Comments

Information & Contributors

Information

Published In

MoMM '12: Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia

December 2012

323 pages

ISBN:9781450313070

DOI:10.1145/2428955

Conference Chair:
Matthias Steinbauer
Johannes Kepler University Linz, Austria
,
Editor:
Ismail Khalil
Johannes Kepler University Linz, Austria
,
General Chair:
Eric Pardede
La Trobe University, Australia
,
Program Chair:
David Taniar
Monash University, Australia

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation of Korea

Conference

MoMM '12

Sponsor:

@WAS

MoMM '12: The 10th International Conference on Advances in Mobile Computing & Multimedia

December 3 - 5, 2012

Bali, Indonesia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kumar ARizvi D(2024)(S2M Semiotics Similarity Measurement and Information Quantification, Lecture Information Weightage CalculationSN Computer Science10.1007/s42979-024-03541-66:1Online publication date: 18-Dec-2024
https://dl.acm.org/doi/10.1007/s42979-024-03541-6
Varma SPandey AShivam Das SRoy S(2022)Video Indexing System Based on Multimodal Information Extraction Using Combination of ASR and OCRBig-Data-Analytics in Astronomy, Science, and Engineering10.1007/978-3-030-96600-3_14(201-208)Online publication date: 18-Feb-2022
https://doi.org/10.1007/978-3-030-96600-3_14
Das ADas P(2020)Semantic Segmentation of MOOC Lecture Videos by Analyzing Concept Change in Domain Knowledge GraphDigital Libraries at Times of Massive Societal Transition10.1007/978-3-030-64452-9_5(55-70)Online publication date: 26-Nov-2020
https://doi.org/10.1007/978-3-030-64452-9_5
Furini MMirri SMontangero M(2018)Topic-based playlist to improve video lecture accessibility2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC.2018.8319246(1-5)Online publication date: Jan-2018
https://doi.org/10.1109/CCNC.2018.8319246
Furini M(2018)On introducing timed tag-clouds in video lectures indexingMultimedia Tools and Applications10.1007/s11042-016-4282-577:1(967-984)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4282-5
Ma DZhang XOuyang XAgam G(2017)Lecture Vdeo Indexing Using Boosted Margin Maximizing Neural Networks2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA.2017.0-155(221-227)Online publication date: Dec-2017
https://doi.org/10.1109/ICMLA.2017.0-155
Bhabad DTherese SGedam M(2017)Multimedia based Information Retrieval Approach based on ASR and OCR and Video Recommendation System2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC)10.1109/CTCEEC.2017.8455038(1168-1172)Online publication date: Sep-2017
https://doi.org/10.1109/CTCEEC.2017.8455038
Furini MMirri S(2017)On using on-the-fly students' notes in video lecture indexing2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC)10.1109/CCNC.2017.7983290(1083-1088)Online publication date: Jan-2017
https://doi.org/10.1109/CCNC.2017.7983290
Vigneshwari GJuliet A(2015)Optimized searching of video based on speech and video text content2015 International Conference on Soft-Computing and Networks Security (ICSNS)10.1109/ICSNS.2015.7292369(1-4)Online publication date: Feb-2015
https://doi.org/10.1109/ICSNS.2015.7292369
Pranali BAnil WKokhale S(2015)Inhalt Based Video Recuperation System Using OCR and ASR Technologies2015 International Conference on Computational Intelligence and Communication Networks (CICN)10.1109/CICN.2015.315(382-386)Online publication date: Dec-2015
https://doi.org/10.1109/CICN.2015.315
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Lecture video segmentation by automatically analyzing the synchronized slides

Automatic detection of slide transitions in lecture videos

Video segmentation algorithm using threshold and weighting based on moving sliding window