skip to main content
10.1145/2632856.2632939acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicimcsConference Proceedingsconference-collections
research-article

The State-of-the-Art Research Progress on Motion Segmentation

Published: 10 July 2014 Publication History

Abstract

Motion segmentation is currently one of the most active research topics in the areas of computer vision and multimedia. It has a wide spectrum of potential applications, including action recognition, visual surveillance, video indexing, video compression, and many other applications. In this paper, we review the recent developments (especially for those in recent five years) of motion segmentation methods and analyze their respective pros and cons. Several valuable research directions are discussed and some suggestions are put forward in the end.

References

[1]
Ben Benfold, and Ian Reid. Guiding Visual Surveillance by Tracking Human Attention. BMVC, pages 1-11, 2009.
[2]
Michael Bleyer, Carsten Rother, and Pushmeet Kohli. Surface stereo with soft segmentation. IEEE CVPR, pages 1570-1577, 2010.
[3]
Thomas Brox, and Jitendra Malik. Object segmentation by long term analysis of point trajectories. ECCV, pages 282-295, 2010.
[4]
Thomas Brox, Andrés Bruhn, Nils Papenberg, and Joachim Weickert. High accuracy optical flow estimation based on a theory for warping. ECCV, pages 25-36, 2004.
[5]
Anil M. Cheriyadat, and Richard J. Radke. Non-negative matrix factorization of partial track data for motion segmentation. IEEE ICCV, pages 865-872, 2009.
[6]
Chris Ding, Tao Li, and Michael I. Jordan. Convex and semi-nonnegative matrix factorizations. IEEE Trans. on Pattern Analysis and Machine Intelligence, 32(1): 45--55, 2010.
[7]
David L. Donoho. For most large underdetermined systems of linear equations the minimal ℓ1 - norm solution is also the sparsest solution. Communications on Pure and Applied Mathematics, 59(6):797--829, 2006.
[8]
Ehsan Elhamifar, and René Vidal. Sparse subspace clustering. IEEE CVPR, pages 2790-2797, 2009.
[9]
Charles Elkan. Using the triangle inequality to accelerate k-means.ICML, pages 147-153, 2003.
[10]
Paolo Favaro, René Vidal, and Avinash Ravichandran. A closed form solution to robust subspace estimation and clustering. IEEE CVPR, pages 1801-1807, 2011.
[11]
Martin A. Fischler, and Robert C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381--395, 1981.
[12]
Venu Madhav Govindu. A tensor decomposition for geometric grouping and segmentation. IEEE CVPR, pages 1150-1157, 2005.
[13]
Woo-Jin Han, Junghye Min, Il-Koo Kim, Elena Alshina, Alexander Alshin, Tammy Lee, Jianle Chen et al. Improved video compression efficiency through flexible unit representation and corresponding extension of coding tools. IEEE Trans. on Circuits and Systems for Video Technology, 20(12):1709--1720, 2010.
[14]
Richard Hartley, and Andrew Zisserman. Multiple view geometry in computer vision. Cambridge University Press, 2003.
[15]
Patrik O. Hoyer. Non-negative matrix factorization with sparseness constraints. The Journal of Machine Learning Research, 5:1457--1469, 2004.
[16]
Kenichi Kanatani. Motion segmentation by subspace separation and model selection. IEEE ICCV, pages 586-591, 2001.
[17]
Jens Klappstein, Tobi Vaudrey, Clemens Rabe, Andreas Wedel, and Reinhard Klette. Moving object segmentation using optical flow and depth information. Springer Berlin Heidelberg, 2009.
[18]
Vladimir Kolmogorov, and Ramin Zabih. Computing visual correspondence with occlusions using graph cuts. IEEE ICCV, pages 508-515, 2001.
[19]
Sheetal Lahabar, and P. J. Narayanan. Singular value decomposition on GPU using CUDA. IEEEIPDPS, pages 1-10, 2009.
[20]
Daniel D. Lee, and H. Sebastian Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788--791, 1999.
[21]
Zhouchen Lin, Minming Chen, and Yi Ma. The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. Technical Report UILU-ENG-09-2215, 2009.
[22]
Guangcan Liu, and Shuicheng Yan. Latent low-rank representation for subspace segmentation and feature extraction. IEEE ICCV, pages 1615-1622, 2011.
[23]
Guangcan Liu, Zhouchen Lin, Shuicheng Yan, Ju Sun, Yong Yu, and Yi Ma. Robust recovery of subspace structures by low-rank representation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 35(1):171--184, 2013.
[24]
Guangcan Liu, Zhouchen Lin, and Yong Yu. Robust subspace segmentation by low-rank representation. ICML, pages 663-670, 2010.
[25]
Weifeng Liu, Puskal P. Pokharel, and Jose C. Principe. Correntropy: A localized similarity measure. IEEE IJCNN, pages 4919-4924, 2006.
[26]
Yuanyuan Liu, L. C. Jiao, and Fanhua Shang. An efficient matrix factorization based low-rank representation for subspace clustering. Pattern Recognition, 46(1):284--292, 2013.
[27]
Zhuwen Li, Jiaming Guo, Loong-Fah Cheong, and Steven Zhiying Zhou. Perspective Motion Segmentation via Collaborative Clustering. IEEE ICCV, pages 1369-1376, 2013
[28]
Yi Ma, Harm Derksen, Wei Hong, and John Wright. Segmentation of multivariate mixed data via lossy data coding and compression. IEEE Trans. on Pattern Analysis and Machine Intelligence, 29(9):1546--1562, 2007.
[29]
Quanyi Mo, and Bruce A. Draper. Semi-nonnegative matrix factorization for motion segmentation with missing data. ECCV, pages 402-415, 2012.
[30]
Manjunath Narayana, Allen Hanson, and Erik Learned-Miller. Coherent Motion Segmentation in Moving Camera Videos using Optical Flow Orientations. IEEE ICCV, pages 1577-1584, 2013.
[31]
Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. On Spectral Clustering: Analysis and an algorithm. NIPS, pages 849-856, 2001.
[32]
Mila Nikolova, and Michael K. Ng. Analysis of half-quadratic minimization methods for signal and image recovery. SIAM Journal on Scientific Computing, 27(3):937--966, 2005.
[33]
Peter Ochs, and Thomas Brox. Higher order motion models and spectral clustering. IEEE CVPR, pages 614-621, 2012.
[34]
Bryan Poling, and Gilad Lerman. A New Approach to Two-View Motion Segmentation Using Global Dimension Minimization. International Journal of Computer Vision, 1-21, 2013.
[35]
Shankar Rao, Roberto Tron, Rene Vidal, and Yi Ma. Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories. IEEE Trans. on Pattern Analysis and Machine Intelligence, 32(10):1832--1845, 2010.
[36]
Shankar R. Rao, Allen Y. Yang, S. Shankar Sastry, and Yi Ma. Robust algebraic segmentation of mixed rigid-body and planar motions from two views. International Journal of Computer Vision, 88(3):425--446, 2010.
[37]
Fanhua Shang, L. C. Jiao, and Fei Wang. Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recognition, 45(6):2237--2250, 2012.
[38]
Jianbo Shi, and Carlo Tomasi. Good features to track. IEEE CVPR, pages 593-600, 1994.
[39]
Roberto Tron, and René Vidal. A benchmark for the comparison of 3-d motion segmentation algorithms. IEEE CVPR, pages 1-8, 2007.
[40]
Shimon Ullman, and Ronen Basri. Recognition by linear combinations of models. IEEE Trans. on Pattern Analysis and Machine Intelligence, 13(10):992--1006, 1991.
[41]
Markus Unger, Manuel Werlberger, Thomas Pock, and Horst Bischof. Joint motion estimation and segmentation of complex scenes with label costs and occlusion modeling. IEEE CVPR, pages 1878-1885, 2012.
[42]
Lieven Vandenberghe, and Stephen Boyd. Semidefinite programming. SIAM Review, 38(1):49--95, 1996.
[43]
RenéVidal. A tutorial on subspace clustering. IEEE Signal Processing Magazine, 28(2):52--68, 2010.
[44]
Heng Wang, Alexander Klaser, Cordelia Schmid, and Cheng-Lin Liu. Action recognition by dense trajectories. IEEE CVPR, pages 3169-3176, 2011.
[45]
Allen Y. Yang, Shankar R. Rao, and Yi Ma. Robust statistical estimation and segmentation of multiple subspaces. IEEE CVPR, pages 99-99, 2006.
[46]
Luca Zappella, Xavier Lladó, and Joaquim Salvi. New trends in motion segmentation. Intechweb.org, pages 31-46, 2009.
[47]
Yun Zeng, Dimitris Samaras, Wei Chen, and Qunsheng Peng. Topology cuts: A novel min-cut/max-flow algorithm for topology preserving segmentation in N--D images. Computer Vision and Image Understanding, 112(1):81--90, 2008.
[48]
Zheng-Jun Zha, Meng Wang, Yan-Tao Zheng, Yi Yang, Richang Hong, and T-S. Chua. Interactive video indexing with statistical active learning. IEEE Trans. Multimedia, 14(1):17--27, 2012.
[49]
Yingya Zhang, Zhenan Sun, Ran He, and Tieniu Tan. Robust Subspace Clustering via Half-Quadratic Minimization. IEEE ICCV, pages 3096--3103, 2013.
[50]
Dengyong Zhou, Jiayuan Huang, and Bernhard Schölkopf. Learning with hypergraphs: Clustering, classification, and embedding. NIPS, pages 1601-1608, 2007.
[51]
Vasileios Zografos, and Klas Nordberg. Fast and accurate motion segmentation using Linear Combination of Views. BMVC, pages 1-11, 2011.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICIMCS '14: Proceedings of International Conference on Internet Multimedia Computing and Service
July 2014
430 pages
ISBN:9781450328104
DOI:10.1145/2632856
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • NSF of China: National Natural Science Foundation of China
  • Beijing ACM SIGMM Chapter

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 July 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Motion segmentation
  2. matrix factorization
  3. optical flow
  4. subspace clustering
  5. two/multi-view geometry

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICIMCS '14

Acceptance Rates

Overall Acceptance Rate 163 of 456 submissions, 36%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media