short-paper

Tag-based social image search with visual-text joint hypergraph learning

Authors:

Dacheng TaoAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 1517 - 1520

https://doi.org/10.1145/2072298.2072054

Published: 28 November 2011 Publication History

Abstract

Tag-based social image search has attracted great interest and how to order the search results based on relevance level is a research problem. Visual content of images and tags have both been investigated. However, existing methods usually employ tags and visual content separately or sequentially to learn the image relevance. This paper proposes a tag-based image search with visual-text joint hypergraph learning. We simultaneously investigate the bag-of-words and bag-of-visual-words representations of images and accomplish the relevance estimation with a hypergraph learning approach. Each textual or visual word generates a hyperedge in the constructed hypergraph. We conduct experiments with a real-world data set and experimental results demonstrate the effectiveness of our approach.

References

[1]

J. Bu, S. Tan, C. Chen, C. Wang, H. Wu, L. Zhang, and X. He. Music recommendation by unified hypergraph: combining social media information and music content. In Proceedings of the ACM International Conference on Multimedia, 2010.

Digital Library

[2]

L. Chen, D. Xu, W. Tsang, and J. Luo. Tag-based web photo retrieval improved by batch mode re-tagging. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2010.

[3]

T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu. Sketch2photo: Internet image montage. ACM Trans. Graph, 28, 2009.

Digital Library

[4]

M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu. Global contrast based salient region detection. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pages 409 416, 2011.

Digital Library

[5]

Y. Gao, M. Wang, Z. Zha, Q. Tian, Q. Dai, and N. Zhang. Less is more: Efficient 3d object retrieval with query view selection. IEEE Transactions on Multimedia, 11, 2011.

Digital Library

[6]

B. Geng, L. Yang, C. Xu, and X.-S. Hua. Ranking model adaptation for domain-specific search. IEEE Transactions on Knowledge and Data Engineering, 2010.

Digital Library

[7]

Y. Huang, Q. Liu, S. Zhang, and D. Metaxas. Video object segmentation by hypergraph cut. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1 6, Miami, USA, 2009.

[8]

Y. Huang, Q. Liu, S. Zhang, and D. Metaxas. Image retrieval via probabilistic hypergraph ranking. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1 6, 2010.

[9]

X. Li, C. G. Snoek, and M. Worring. Unsupervised multi-feature tag relevance learning for social image retrieval. In Proceedings of the ACM International Conference on Image and Video Retrieval, 2010.

Digital Library

[10]

D. Liu, X.-S. Hua, L. Yang, M. Wang, and H.-J. Zhang. Tag ranking. In Proceedings of the International Conference on World Wide Web, 2009.

Digital Library

[11]

D. Liu, M. Wang, X.-S. Hua, and H.-J. Zhang. Semi-automatic tagging of photo albums via exemplar selection and tag inference. IEEE Transaction on Multimedia, 13:82 91, 2011.

Digital Library

[12]

D. Liu, M. Wang, L. Yang, X.-S. Hua, and H. Zhang. Tag quality improvement for social images. In Proceeding of IEEE International Conference on Multimedia, pages 350 353, 2009.

Digital Library

[13]

D. Liu, S. Yan, X.-S. Hua, and H.-J. Zhang. Image tagging via collaborative tag propagation. IEEE Transaction on Multimedia, 13:702 712, 2011.

Digital Library

[14]

J. Shen, J. Shepherd, B. Cui, and K.-L. Tan. A novel framework for efficient automated singer identification in large music databases. ACM Transactions on Information Systems, 27, 2009.

Digital Library

[15]

J. Shen, D. Tao, and X. Li. Modality mixture projections for semantic video event detection. IEEE Transactions on Circuits and Systems for Video Technology, 18:1587 1596, 2008.

Digital Library

[16]

A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22:1349 1380, 2000.

Digital Library

[17]

M. Wang and X.-S. Hua. Active learning in multimedia annotation and retrieval: A survey. ACM Transactions on Intelligent Systems and Technology, 2:10 31, 2011.

Digital Library

[18]

M. Wang, X.-S. Hua, J. Tang, and R. Hong. Beyond distance measurement: Constructing neighborhood similarity for video annotation. IEEE Transactions on Multimedia, 11:465 476, 2009.

Digital Library

[19]

M. Wang, K. Yang, X.-S. Hua, and H.-J. Zhang. Towards relevant and diverse search of social images. IEEE Transactions on Multimedia, 12:829 842, 2010.

Digital Library

[20]

Y. Yang, D. Xu, F. Nie, S. Yan, and Y. Zhuang. Image clustering using local discriminant models and global integration. IEEE Transactions on Image Processing, 10:2761 2773, 2010.

Digital Library

[21]

Y. Yang, Y. Zhuang, F. Wu, and Y. Pan. Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval. IEEE Transactions on Multimedia, 10:437 446, 2008.

Digital Library

[22]

R. Zass and A. Shashua. Probabilistic graph and hypergraph matching. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Alaska, USA, 2008.

[23]

D. Zhou, J. Huang, and B. Schokopf. Learning with hypergraphs: Clustering, classification, and embedding. In Proceedings of Advances in Neural Information Processing Systems 19, pages 1601 1608, 2007.

[24]

G. Zhu, S. Yan, and Y. Ma. Image tag refinement towards low-rank, content-tag prior and error sparsity. In Proceedings of the ACM International Conference on Multimedia, 2010.

Digital Library

Cited By

Jintanachaiwat WSiriborvornratanakul T(2023)Vision-based image similarity measurement for image search similarityInternational Journal of Information Technology10.1007/s41870-023-01437-x15:8(4125-4130)Online publication date: 19-Sep-2023
https://doi.org/10.1007/s41870-023-01437-x
Yang ZXu LZhao L(2022)Multimodal Feature Fusion Based Hypergraph Learning ModelComputational Intelligence and Neuroscience10.1155/2022/90736522022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9073652
Tonge ACaragea C(2020)Image Privacy Prediction Using Deep Neural NetworksACM Transactions on the Web10.1145/338608214:2(1-32)Online publication date: 9-Apr-2020
https://dl.acm.org/doi/10.1145/3386082
Show More Cited By

Index Terms

Tag-based social image search with visual-text joint hypergraph learning
1. Information systems
  1. Information retrieval
  2. Information systems applications

Recommendations

Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search

Due to the popularity of social media websites, extensive research efforts have been dedicated to tag-based social image search. Both visual information and tags have been investigated in the research field. However, most existing methods use tags and ...
Boost search relevance for tag-based social image retrieval
ICME'09: Proceedings of the 2009 IEEE international conference on Multimedia and Expo

Social media sharing web sites like Flickr allow users to annotate images with free tags, which greatly facilitate social image search and browsing. However, currently tag-based image search on Flickr does not provide the option of relevance-based ...
Social tag relevance learning via ranking-oriented neighbor voting

High quality tags play a critical role in applications involving online multimedia search, such as social image annotation, sharing and browsing. However, user-generated tags in real world are often imprecise and incomplete to describe the image ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

50
Total Citations
View Citations
863
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jintanachaiwat WSiriborvornratanakul T(2023)Vision-based image similarity measurement for image search similarityInternational Journal of Information Technology10.1007/s41870-023-01437-x15:8(4125-4130)Online publication date: 19-Sep-2023
https://doi.org/10.1007/s41870-023-01437-x
Yang ZXu LZhao L(2022)Multimodal Feature Fusion Based Hypergraph Learning ModelComputational Intelligence and Neuroscience10.1155/2022/90736522022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9073652
Tonge ACaragea C(2020)Image Privacy Prediction Using Deep Neural NetworksACM Transactions on the Web10.1145/338608214:2(1-32)Online publication date: 9-Apr-2020
https://dl.acm.org/doi/10.1145/3386082
Bouhlel NFeki GAmar C(2020)Hypergraph-based image search reranking with elastic net regularized regressionMultimedia Tools and Applications10.1007/s11042-020-09418-zOnline publication date: 15-Aug-2020
https://doi.org/10.1007/s11042-020-09418-z
Leordeanu MLeordeanu M(2020)Unsupervised Learning of Graph and Hypergraph ClusteringUnsupervised Learning in Space and Time10.1007/978-3-030-42128-1_3(107-124)Online publication date: 18-Apr-2020
https://doi.org/10.1007/978-3-030-42128-1_3
Tonge ACaragea C(2019)Privacy-aware Tag Recommendation for Accurate Image Privacy PredictionACM Transactions on Intelligent Systems and Technology10.1145/333505410:4(1-28)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3335054
Arya DRudinac SWorring M(2019)Predicting Behavioural Patterns in Discussion Forums using Deep Learning on Hypergraphs2019 International Conference on Content-Based Multimedia Indexing (CBMI)10.1109/CBMI.2019.8877384(1-6)Online publication date: Sep-2019
https://doi.org/10.1109/CBMI.2019.8877384
Tonge ACaragea CSquicciarini ALee DSastry NWeber I(2018)Privacy-Aware Tag Recommendation for Image SharingProceedings of the 29th on Hypertext and Social Media10.1145/3209542.3209574(52-56)Online publication date: 3-Jul-2018
https://dl.acm.org/doi/10.1145/3209542.3209574
Arya DWorring MAizawa KLew MSatoh S(2018)Exploiting Relational Information in Social Networks using Geometric Deep Learning on HypergraphsProceedings of the 2018 ACM on International Conference on Multimedia Retrieval10.1145/3206025.3206062(117-125)Online publication date: 5-Jun-2018
https://dl.acm.org/doi/10.1145/3206025.3206062
Xie CZhong WXu WMueller K(2018)Visual Analytics of Heterogeneous Data Using Hypergraph LearningACM Transactions on Intelligent Systems and Technology10.1145/320076510:1(1-26)Online publication date: 20-Dec-2018
https://dl.acm.org/doi/10.1145/3200765
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents