skip to main content
10.1145/2683483.2683538acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicvgipConference Proceedingsconference-collections
research-article

Multi-criteria Energy Minimization with Boundedness, Edge-density and Rarity, for Object Saliency in Natural Images

Published: 14 December 2014 Publication History

Abstract

Recent methods of bottom-up salient object detection have attempted to either: (i) obtain a probability map with a `contrast rarity' based functional, formed using low level cues; or (ii) Minimize an objective function, to detect the object. Most of these methods fail for complex, natural scenes, such as the PASCAL-VOC challenge dataset which contains images with diverse appearances, illumination conditions, multiple distracting objects and varying scene environments. We thus formulate a novel multi-criteria objective function which captures many dependencies and the scene structure for correct spatial propagation of low-level priors to perform salient object segmentation, in such cases. Our proposed formulation is based on CRF modeling where the minimization is performed using graph cut and the optimal parameters of the objective function are learned using a max-margin framework from the training set, without the use of class labels. Hence the method proposed is unsupervised, and works efficiently when compared to the very recent state-of-the art methods of saliency map detection and object proposals. Results, compared using F-measure and intersection-over-union scores, show that the proposed method exhibits superior performance in case of the complex PASCAL-VOC 2012 object segmentation dataset as well as the traditional MSRA-B saliency dataset.

References

[1]
A. Treisman and S. Gormican, "Feature analysis in early vision: evidence from search asymmetries." Psychological review, vol. 95, no. 1, p. 15, 1988.
[2]
M. A. Goodale, A. D. Milner, L. Jakobson, and D. Carey, "A neurological dissociation between perceiving objects and grasping them," Nature, vol. 349, 1991.
[3]
P. Viola and M. J. Jones, "Robust real-time face detection," IJCV, vol. 57, 2004.
[4]
P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," TPAMI, vol. 32, 2010.
[5]
J. Shi and J. Malik, "Normalized cuts and image segmentation," TPAMI, vol. 22, 2000.
[6]
P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," TPAMI, vol. 33, 2011.
[7]
P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," IJCV, vol. 59, 2004.
[8]
J. Carreira and C. Sminchisescu, "Constrained parametric min-cuts for automatic object segmentation," in CVPR, 2010.
[9]
I. Endres and D. Hoiem, "Category independent object proposals," in ECCV, 2010.
[10]
B. Alexe, T. Deselaers, and V. Ferrari, "Measuring the objectness of image windows," TPAMI, 2012.
[11]
E. Rahtu, J. Kannala, and M. Blaschko, "Learning a category independent object detection cascade," in ICCV, 2011.
[12]
K. E. A. van de Sande, J. R. R. Uijlings, T. Gevers, and A. W. M. Smeulders, "Segmentation as selective search for object recognition," in ICCV, 2011, pp. 1879–1886.
[13]
M.-M. Cheng, Z. Zhang, W.-Y. Lin, and P. Torr, "Bing: Binarized normed gradients for objectness estimation at 300fps," in CVPR, 2014.
[14]
L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," TPAMI, vol. 20, 1998.
[15]
T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in CVPR, 2007.
[16]
J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in NIPS, 2006, pp. 545–552.
[17]
S. Goferman, L. Zelnik-manor, and A.Tal, "Context-aware saliency detection," in CVPR, 2010.
[18]
M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu, "Global contrast based salient region detection," in CVPR, 2011.
[19]
F. Perazzi, P. Krahenbuhl, Y. Pritch, and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in CVPR, 2012.
[20]
C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang, "Saliency detection via graph-based manifold ranking," in CVPR, 2013.
[21]
S. Roy and S. Das, "Saliency detection in images using graph-based rarity, spatial compactness and background prior," in VISAPP, 2014.
[22]
M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes Challenge 2012 (VOC 2012) Results," http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html.
[23]
Y. Wei, F. Wen, W. Zhu, and J. Sun, "Geodesic saliency using background priors," in ECCV, 2012.
[24]
R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "SLIC Superpixels," EPFL, Tech. Rep., June 2010.
[25]
P. Dollár and C. L. Zitnick, "Structured forests for fast edge detection," in ICCV, 2013.
[26]
R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency-tuned salient region detection," in CVPR, 2009.
[27]
X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparse salient regions," TPAMI, vol. 34, no. 1, pp. 194–201, 2012.
[28]
J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual saliency based on scale-space analysis in the frequency domain," TPAMI, vol. 35, 2013.
[29]
T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H. Shum, "Learning to detect a salient object," TPAMI, vol. 33, 2011.
[30]
L. Zhang, M. H. Tong, and e. a. Marks, T. K., "Sun: A bayesian framework for saliency using natural statistics," Journal of Vision, vol. 8, 2008.
[31]
J. Yang and M.-H. Yang, "Top-down visual saliency via joint crf and dictionary learning," in CVPR, 2012.
[32]
S. Nowozin and C. H. Lampert, "Structured learning and prediction in computer vision," Foundations and Trends in Computer Graphics and Vision, 2011.
[33]
J. D. Lafferty, A. McCallum, and F. C. N. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in ICML, 2001.
[34]
M. Szummer, P. Kohli, and D. Hoiem, "Learning crfs using graph cuts," in ECCV, 2008.
[35]
I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," in JMLR, 2005.
[36]
M. Grant and S. Boyd, "Cvx: Matlab software for disciplined convex programming, version 2.0," http://cvxr.com/cvx, September 2013.
[37]
J. Dolson, B. Jongmin, C. Plagemann, and S. Thrun, "Upsampling range data in dynamic environments," in CVPR, 2010.

Cited By

View all

Index Terms

  1. Multi-criteria Energy Minimization with Boundedness, Edge-density and Rarity, for Object Saliency in Natural Images

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICVGIP '14: Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing
        December 2014
        692 pages
        ISBN:9781450330619
        DOI:10.1145/2683483
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 December 2014

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. CRF
        2. Object Segmentation
        3. Objectness
        4. Saliency

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ICVGIP '14

        Acceptance Rates

        Overall Acceptance Rate 95 of 286 submissions, 33%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 07 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media