short-paper

Real time google and live image search re-ranking

Authors:

Xiaoou TangAuthors Info & Claims

MM '08: Proceedings of the 16th ACM international conference on Multimedia

Pages 729 - 732

https://doi.org/10.1145/1459359.1459471

Published: 26 October 2008 Publication History

Abstract

Nowadays, web-scale image search engines (e.g. Google, Live Image Search) rely almost purely on surrounding text features. This leads to ambiguous and noisy results. We propose to use adaptive visual similarity to re-rank the text-based search results. A query image is first categorized into one of several predefined intention categories, and a specific similarity measure is used inside each category to combine image features for re-ranking based on the query image. Extensive experiments demonstrate that using this algorithm to filter output of Google and Live Image Search is a practical and effective way to dramatically improve the user experience. A real-time image search engine is developed for on-line image search with re-ranking: http://mmlab.ie.cuhk.edu.hk/intentsearch

References

[1]

Google Image Search. http://images.google.com.

[2]

http://www.live.com/~&scope=images.

[3]

J. Cui, F. Wen, and X. Tang. Intentsearch: Interactive on-line image search re-ranking. In MULTIMEDIA '08: Proceedings of the 16th international conference on Multimedia, 2008.

Digital Library

[4]

N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, 2005.

Digital Library

[5]

R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman. Learning object categories from google's image search. In ICCV, 2005.

Digital Library

[6]

R. Fergus, P. Perona, and A. Zisserman. A visual category filter for google images. In ECCV, 2004.

[7]

W. Freeman and M. Roth. Orientation histogram for hand gesture recognition. In Int'l Workshop on Automatic Face- and Gesture-Recognition, 1995.

[8]

Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer. An efficient boosting algorithm for combining preferences. J. Mach. Learn. Res., 4:933--969, 2003.

Digital Library

[9]

W. H. Hsu, L. S. Kennedy, and S.-F. Chang. Novel reranking methods for visual search. IEEE Multimedia, 2007.

Digital Library

[10]

T. Liu, J. Sun, N.-N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. In CVPR, 2007.

[11]

D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91--110, 2004.

Digital Library

[12]

Y. Luo and X. Tang. Photo and video quality evaluation: Focusing on the subject. In MULTIMEDIA '08: Proceedings of the 16th international conference on Multimedia, 2008.

Digital Library

[13]

J. R. Quinlan. C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993.

Digital Library

[14]

Y. Rubner, L. J. Guibas, and C. Tomasi. The earth mover's distance, multi-dimensional scaling, and color-based image retrieval. In Proceedings of the ARPA Image Understanding Workshop, 1997.

[15]

A. Torralba, K. Murphy, W. Freeman, and M. Rubin. Context-based vision system for place and object recognition, 2003.

[16]

M. Unser. Texture classification and segmentation using wavelet frames. IEEE TIP, 4:1549--1560, 1995.

Digital Library

[17]

R. Xiao, H. Zhu, H. Sun, and X. Tang. Dynamic cascades for face detection. In ICCV, 2007.

[18]

X. S. Zhou and T. S. Huang. Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems, 8(6):536--544, 2003.

Cited By

Hu JEl-Rashid FBertelsen S(2024)SHADE: Empowering Consumer Choice for Sustainable Fashion with AI and Digital ToolingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651025(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651025
Phan HNguyen A(2022)DeepFace-EMD: Re-ranking Using Patch-wise Earth Mover's Distance Improves Out-Of-Distribution Face Identification2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01962(20227-20237)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01962
Makhortykh MUrman AUlloa R(2021)Detecting Race and Gender Bias in Visual Representation of AI on Web Search EnginesAdvances in Bias and Fairness in Information Retrieval10.1007/978-3-030-78818-6_5(36-50)Online publication date: 25-Jun-2021
https://doi.org/10.1007/978-3-030-78818-6_5
Show More Cited By

Index Terms

Real time google and live image search re-ranking
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
2. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
      1. Document filtering
      2. Information extraction

Recommendations

IntentSearch: Capturing User Intention for One-Click Internet Image Search

Web-scale image search engines (e.g., Google image search, Bing image search) mostly rely on surrounding text features. It is difficult for them to interpret users' search intention only by query keywords and this leads to ambiguous and noisy search ...
IntentSearch: interactive on-line image search re-ranking
MM '08: Proceedings of the 16th ACM international conference on Multimedia

In this demo, we present IntentSearch, an interactive system for realtime web based image retrieval. IntentSearch works directly on top of Microsoft Live Image Search, and re-ranks its results according to user specified query image(s) and the ...
Google Search Engine: Seo Tools You Need to Explode Your Website Traffic - Google Seo, Google Ranking

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '08: Proceedings of the 16th ACM international conference on Multimedia

October 2008

1206 pages

ISBN:9781605583037

DOI:10.1145/1459359

General Chairs:
Abdulmotaleb EL Saddik
University of Ottawa
,
Son Vuong
University of British Colombia
,
Program Chairs:
Carsten Griwodz
University of Oslo
,
Alberto Del Bimbo
University degli Studi di Firenze
,
K. Selcuk Candan
Arizona State University
,
Alejandro Jaimes
Telefonica R&D, Madrid, Spain

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 26 - 31, 2008

British Columbia, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

70
Total Citations
View Citations
1,144
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)5

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hu JEl-Rashid FBertelsen S(2024)SHADE: Empowering Consumer Choice for Sustainable Fashion with AI and Digital ToolingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651025(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651025
Phan HNguyen A(2022)DeepFace-EMD: Re-ranking Using Patch-wise Earth Mover's Distance Improves Out-Of-Distribution Face Identification2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01962(20227-20237)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01962
Makhortykh MUrman AUlloa R(2021)Detecting Race and Gender Bias in Visual Representation of AI on Web Search EnginesAdvances in Bias and Fairness in Information Retrieval10.1007/978-3-030-78818-6_5(36-50)Online publication date: 25-Jun-2021
https://doi.org/10.1007/978-3-030-78818-6_5
Yu ZKovashka A(2020)Syntharch: Interactive Image Search with Attribute-Conditioned Synthesis2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW50498.2020.00093(645-654)Online publication date: Jun-2020
https://doi.org/10.1109/CVPRW50498.2020.00093
Chen Y(2020)Exploring the Impact of Similarity Model to Identify the Most Similar Image from a Large Image DatabaseJournal of Physics: Conference Series10.1088/1742-6596/1693/1/0121391693(012139)Online publication date: 17-Dec-2020
https://doi.org/10.1088/1742-6596/1693/1/012139
Mohan Prasad KSri Kavya RBhuvaneswari Devi S(2019)Virtual Fitting Space for Dress TrialsIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/590/1/012013590(012013)Online publication date: 15-Oct-2019
https://doi.org/10.1088/1757-899X/590/1/012013
Wu DLiang S(2018)Mobile Search Behavious: An In-depth Analysis based on Contexts, APPs, and DevicesSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00831ED1V01Y201802ICR06310:2(i-159)Online publication date: 19-Mar-2018
https://doi.org/10.2200/S00831ED1V01Y201802ICR063
Dange BKshirsagar D(2017)Hashing based re-ranking of web images using query-specific semantic signatures2017 1st International Conference on Intelligent Systems and Information Management (ICISIM)10.1109/ICISIM.2017.8122168(164-170)Online publication date: Oct-2017
https://doi.org/10.1109/ICISIM.2017.8122168
Nguyen NNguyen VNgo TNguyen K(2017)Person re-identification with mutual re-rankingVietnam Journal of Computer Science10.1007/s40595-016-0093-x4:4(233-244)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1007/s40595-016-0093-x
Sejal DGaneshsingh TVenugopal KIyengar SPatnaik L(2017)ACSIR: ANOVA Cosine Similarity Image Recommendation in vertical searchInternational Journal of Multimedia Information Retrieval10.1007/s13735-017-0124-06:2(143-154)Online publication date: 31-Mar-2017
https://doi.org/10.1007/s13735-017-0124-0
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents