skip to main content
10.1145/2393347.2396475acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
abstract

Guess what you draw: interactive contour-based image retrieval on a million-scale database

Published: 29 October 2012 Publication History

Abstract

We propose a real-time image retrieval system which allows users to search target images whose objects are similar to the query in contour, regardless of their sizes and positions appearing in the images. Even in a complicated scene, as long as the object's contour is most salient in the target image, the system is still able to capture it and lists the image in the retrieval results. Therefore, the system has better retrieval rate than existing systems and algorithms. One typical application of the proposed system is to help the computer understand what does the user draw or upload. It is based on the statistical distributions of tags of retrieved images, and the proposed system feeds back some candidate tags related to the query image. Such tags could be used for further retrieval to refine the result list. In addition, the system provides a friendly interactive interface with multiple queries. These queries are from different combinations of tags, a hand-drawn sketch and a natural image, and could help users search images flexibly and conveniently. The system runs on a database of 1.3 million images and could achieve a real-time retrieval speed. The results in the demonstration show excellent retrieval performance of the proposed system.

Supplementary Material

JPG File (mtd022.jpg)
suppl.mov (mtd022.mov)
Supplemental video

References

[1]
Y. Cao, C. H. Wang, L. Q. Zhang, and L. Zhang. Edgel index for large-scale sketch-based image search. In CVPR, 2011.
[2]
Y. Cao, H. Wang, C. H. Wang, Z. W. Li, L. Q. Zhang, and L. Zhang. Mindfinder: Interactive sketch-based image search on millions of images. In ACM MM, 2010.
[3]
R. Datta, D. Joshi, J. Li, and J. Z. Wang. Image retrieval: ideas, influences, and trends of the new age. ACM Computing Surveys}, 40(2):1--60, 2008.
[4]
M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa. An evaluation of descriptors for large-scale image retrieval from sketched feature lines. Computers & Graphics, 34:482--498, 2010.

Cited By

View all

Index Terms

  1. Guess what you draw: interactive contour-based image retrieval on a million-scale database

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MM '12: Proceedings of the 20th ACM international conference on Multimedia
      October 2012
      1584 pages
      ISBN:9781450310895
      DOI:10.1145/2393347

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 29 October 2012

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. contour
      2. image retrieval
      3. million-scale
      4. sketch

      Qualifiers

      • Abstract

      Conference

      MM '12
      Sponsor:
      MM '12: ACM Multimedia Conference
      October 29 - November 2, 2012
      Nara, Japan

      Acceptance Rates

      Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 09 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media