research-article

Search intent estimation from user's eye movements for supporting information seeking

Authors:

Kazutoshi Umemoto,

Takehiro Yamamoto,

Satoshi Nakamura,

Katsumi TanakaAuthors Info & Claims

AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Pages 349 - 356

https://doi.org/10.1145/2254556.2254624

Published: 21 May 2012 Publication History

Abstract

In this paper, we propose a two-stage system using user's eye movements to accommodate the increasing demands to obtain information from the Web in an efficient way. In the first stage the system estimates a user's search intent as a set of weighted terms extracted based on the user's eye movements while browsing Web pages. Then in the second stage, the system shows relevant information to the user by using the estimated intent for re-ranking search results, suggesting intent-based queries, and emphasizing relevant parts of Web pages. The system aims to help users to efficiently obtain what they need by repeating these steps throughout the information seeking process. We proposed four types of search intent estimation methods (MLT, nMLT, DLT and nDLT) considering the relationship among intents, term frequencies and eye movements. As a result of an experiment designed for evaluating the accuracy of each method with a prototype system, we confirmed that the nMLT method works best. In addition, by analyzing the extracted intent terms for eight subjects in the experiment, we found that the system could estimate the unique search intent of each user even if they performed the same search tasks.

References

[1]

E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '06, pages 19--26. ACM, 2006.

Digital Library

[2]

P. Boldi, F. Bonchi, C. Castillo, D. Donato, A. Gionis, and S. Vigna. The query-flow graph: model and applications. In Proceedings of the 17th ACM conference on Information and knowledge management, CIKM '08, pages 609--618. ACM, 2008.

Digital Library

[3]

G. Buscher, E. Cutrell, and M. R. Morris. What do you see when you're surfing?: using eye tracking to predict salient regions of web pages. In Proceedings of the 27th international conference on Human factors in computing systems, CHI '09, pages 21--30. ACM, 2009.

Digital Library

[4]

G. Buscher, A. Dengel, and L. van Elst. Query expansion using gaze-based feedback on the subdocument level. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '08, pages 387--394. ACM, 2008.

Digital Library

[5]

G. Buscher, L. van Elst, and A. Dengel. Segment-level display time as implicit feedback: a comparison to eye tracking. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, SIGIR '09, pages 67--74. ACM, 2009.

Digital Library

[6]

I. Campbell and K. van Rijsbergen. The ostensive model of developing information needs. In Proceedings of the 2nd international conference on Conceptions of library and information science, CoLIS 2, pages 251--268, 1996.

[7]

H. Cao, D. Jiang, J. Pei, Q. He, Z. Liao, E. Chen, and H. Li. Context-aware query suggestion by mining click-through and session data. In Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '08, pages 875--883. ACM, 2008.

Digital Library

[8]

N. H. Cuong and H. T. Huang. Eye-gaze detection with a single webcam based on geometry features extraction. In Proceedings of the 11th International Conference on Control, Automation, Robotics and Vision, ICARCV '10, pages 2507--2512. IEEE, 2010.

[9]

E. Cutrell and Z. Guan. What are you looking for?: an eye-tracking study of information usage in web search. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '07, pages 407--416. ACM, 2007.

Digital Library

[10]

B. Hu, Y. Zhang, W. Chen, G. Wang, and Q. Yang. Characterizing search intent diversity into click models. In Proceedings of the 20th international conference on World wide web, WWW '11, pages 17--26. ACM, 2011.

Digital Library

[11]

J. Huang and E. N. Efthimiadis. Analyzing and evaluating query reformulation strategies in web search logs. In Proceedings of the 18th ACM conference on Information and knowledge management, CIKM '09, pages 77--86. ACM, 2009.

Digital Library

[12]

J. Huang, R. W. White, and S. Dumais. No clicks, no problem: using cursor movements to understand and improve search. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI '11, pages 1225--1234. ACM, 2011.

Digital Library

[13]

T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '02, pages 133--142. ACM, 2002.

Digital Library

[14]

D. Kelly, K. Gyllstrom, and E. W. Bailey. A comparison of query and term suggestion features for interactive searching. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, SIGIR '09, pages 371--378. ACM, 2009.

Digital Library

[15]

D. Kelly and J. Teevan. Implicit feedback for inferring user preference: a bibliography. SIGIR Forum, 37:18--28, 2003.

Digital Library

[16]

J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, SIGIR '09, pages 43--50. ACM, 2009.

Digital Library

[17]

C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval, chapter 6. Cambridge University Press, 2008.

Digital Library

[18]

D. Rafiei, K. Bharat, and A. Shukla. Diversifying web search results. In Proceedings of the 19th international conference on World wide web, WWW '10, pages 781--790. ACM, 2010.

Digital Library

[19]

J. J. Rocchio. Relevance feedback in information retrieval. In The SMART Retrieval System -- Experiments in Automatic Document Processing, chapter 14, pages 313--323. Prentice-Hall, 1971.

[20]

K. Rodden and X. Fu. Exploring how mouse movements relate to eye movements on web search results pages. In ACM SIGIR 2007 Workshop on Web Information Seeking and Interaction, pages 29--32. 2007.

[21]

Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 8(5):644--655, 1998.

Digital Library

[22]

B. Shneiderman, D. Byrd, and W. B. Croft. Clarifying search: A user-interface framework for text searches. DLib Magazine, 3(January):18--20, 1997.

[23]

A. Spink, B. J. Jansen, D. Wolfram, and T. Saracevic. From e-sex to e-commerce: Web search changes. Computer, 35:107--109, 2002.

Digital Library

[24]

J. Teevan, E. Cutrell, D. Fisher, S. M. Drucker, G. Ramos, P. André, and C. Hu. Visual snippets: summarizing web pages for search and revisitation. In Proceedings of the 27th international conference on Human factors in computing systems, CHI '09, pages 2023--2032. ACM, 2009.

Digital Library

[25]

S. Xu, H. Jiang, and F. C. Lau. Personalized online document, image and video recommendation via commodity eye-tracking. In Proceedings of the 2008 ACM conference on Recommender systems, RecSys '08, pages 83--90. ACM, 2008.

Digital Library

[26]

S. Xu, H. Jiang, and F. C. Lau. User-oriented document summarization through vision-based eye-tracking. In Proceedings of the 14th international conference on Intelligent user interfaces, IUI '09, pages 7--16. ACM, 2009.

Digital Library

Cited By

Schumacher AKammerer YScharinger CGottschling SHübner NTibus MKasneci EAppel TGerjets PBardach L(2025)How do intellectually curious and interested people learn and attain knowledge? A focus on behavioral traces of information seekingEuropean Journal of Personality10.1177/08902070241309124Online publication date: 19-Jan-2025
https://doi.org/10.1177/08902070241309124
Gao ZLi JDong MYang RLiu L(2022)Human–System Interaction Based on Eye Tracking for a Virtual WorkshopSustainability10.3390/su1411684114:11(6841)Online publication date: 3-Jun-2022
https://doi.org/10.3390/su14116841
Takano HTachi KMorita YNakamura K(2019)[Paper] Statistical Evaluation of Color Components for Pupil Detection and Diameter Measurement Under Visible-light ConditionsITE Transactions on Media Technology and Applications10.3169/mta.7.1187:3(118-125)Online publication date: 2019
https://doi.org/10.3169/mta.7.118
Show More Cited By

Index Terms

Search intent estimation from user's eye movements for supporting information seeking
1. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results
      1. Relevance assessment

Recommendations

User Intent in Multimedia Search: A Survey of the State of the Art and Future Challenges

Today's multimedia search engines are expected to respond to queries reflecting a wide variety of information needs from users with different goals. The topical dimension (“what” the user is searching for) of these information needs is well studied; ...
Predicting Search Intent Based on Pre-Search Context
SIGIR '15: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval

While many studies have been conducted on query understanding, there is limited understanding on why users start searches and how to predict search intent. In this paper, we propose to study this important but less explored problem. Our key intuition is ...
Actively predicting diverse search intent from user browsing behaviors
WWW '10: Proceedings of the 19th international conference on World wide web

This paper is concerned with actively predicting search intent from user browsing behavior data. In recent years, great attention has been paid to predicting user search intent. However, the prediction was mostly passive because it was performed only ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

May 2012

846 pages

ISBN:9781450312875

DOI:10.1145/2254556

Editors:
Genny Tortora
Università di Salerno, Italy
,
Stefano Levialdi
Sapienza Università di Roma, Italy
,
Maurizio Tucci
Università di Salerno, Italy

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Consulta Umbria SRL
University of Salerno: University of Salerno

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Japan Society for the Promotion of Science

Conference

AVI'12

Sponsor:

University of Salerno

AVI'12: International Working Conference on Advanced Visual Interfaces

May 21 - 25, 2012

Capri Island, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
337
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schumacher AKammerer YScharinger CGottschling SHübner NTibus MKasneci EAppel TGerjets PBardach L(2025)How do intellectually curious and interested people learn and attain knowledge? A focus on behavioral traces of information seekingEuropean Journal of Personality10.1177/08902070241309124Online publication date: 19-Jan-2025
https://doi.org/10.1177/08902070241309124
Gao ZLi JDong MYang RLiu L(2022)Human–System Interaction Based on Eye Tracking for a Virtual WorkshopSustainability10.3390/su1411684114:11(6841)Online publication date: 3-Jun-2022
https://doi.org/10.3390/su14116841
Takano HTachi KMorita YNakamura K(2019)[Paper] Statistical Evaluation of Color Components for Pupil Detection and Diameter Measurement Under Visible-light ConditionsITE Transactions on Media Technology and Applications10.3169/mta.7.1187:3(118-125)Online publication date: 2019
https://doi.org/10.3169/mta.7.118
Hienert DKern DMitsui MShah CBelkin NAzzopardi LHalvey MRuthven IJoho HMurdock VQvarfordt P(2019)Reading ProtocolProceedings of the 2019 Conference on Human Information Interaction and Retrieval10.1145/3295750.3298921(73-81)Online publication date: 8-Mar-2019
https://dl.acm.org/doi/10.1145/3295750.3298921
Tamura MNakamura S(2018)A Method for Enriching Video-Watching Experience with Applied Effects Based on Eye MovementsMultiMedia Modeling10.1007/978-3-030-05716-9_44(547-553)Online publication date: 11-Dec-2018
https://doi.org/10.1007/978-3-030-05716-9_44
Wang CFang YTan ZHe YLim EWinslett MSanderson MFu ASun JCulpepper SLo EHo JDonato DAgrawal RZheng YCastillo CSun ATseng VLi C(2017)Improving the Gain of Visual Perceptual Behaviour on Topic Modeling for Text RecommendationProceedings of the 2017 ACM on Conference on Information and Knowledge Management10.1145/3132847.3133122(2339-2342)Online publication date: 6-Nov-2017
https://dl.acm.org/doi/10.1145/3132847.3133122
Nguyen DVrzakova HBednarik RLukowicz PKrüger ABulling ALim YPatel S(2016)WTPProceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct10.1145/2968219.2968338(1696-1705)Online publication date: 12-Sep-2016
https://dl.acm.org/doi/10.1145/2968219.2968338
Kofler CLarson MHanjalic A(2016)User Intent in Multimedia SearchACM Computing Surveys10.1145/295493049:2(1-37)Online publication date: 13-Aug-2016
https://dl.acm.org/doi/10.1145/2954930
Felicio CDe Almeida CAlves GPereira FPaixao KDe Amo SBarcelos C(2016)VP-Rec: A Hybrid Image Recommender Using Visual Perception Network2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI)10.1109/ICTAI.2016.0021(70-77)Online publication date: Nov-2016
https://doi.org/10.1109/ICTAI.2016.0021
Park HLee SLee MChang MKwak H(2016)Using eye movement data to infer human behavioral intentionsComputers in Human Behavior10.1016/j.chb.2016.06.01663:C(796-804)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1016/j.chb.2016.06.016
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten