Article

What are you looking for?: an eye-tracking study of information usage in web search

Authors:

Edward Cutrell,

Zhiwei GuanAuthors Info & Claims

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 407 - 416

https://doi.org/10.1145/1240624.1240690

Published: 29 April 2007 Publication History

Abstract

Web search services are among the most heavily used applications on the World Wide Web. Perhaps because search is used in such a huge variety of tasks and contexts, the user interface must strike a careful balance to meet all user needs. We describe a study that used eye tracking methodologies to explore the effects of changes in the presentation of search results. We found that adding information to the contextual snippet significantly improved performance for informational tasks but degraded performance for navigational tasks. We discuss possible reasons for this difference and the design implications for better presentation of search results.

References

[1]

Broder, A. A taxonomy of web search. SIGIR Forum, 36, 2(2002), 3--10.

Digital Library

[2]

Brumby, D.P. and Howes, A. Good enough but I'll just check: Web-page search as attentional refocusing. Proc. 6th Int'l Conference on Cognitive Modeling, Lawrence Erlbaum (2004), 46--50.

[3]

Card, S.K., Pirolli, P., Van Der Wege, M., Morrision, J.B., Reeder, R.W., Schraedley, P.K. and Boshart, J. Information scent as a driver of web behavior graphs: Results of a protocol analysis method for web usability. In Proc. CHI 2001, ACM Press (2001), 498--505.

Digital Library

[4]

Chi, E., Pirolli, P., Chen, K., & Pitkow, J. Using information scent to model user information needs and actions and the Web. In Proc. CHI 2001, ACM Press (2001), 490--497.

Digital Library

[5]

Cutrell, E., Dumais, S.T., & Teevan, J. Searching to eliminate personal information management. In Communications of the ACM (Special Issue: Personal information management), 49 1(2006), 58--64.

Digital Library

[6]

Cutrell, E., & Guan, Z. Eye tracking in MSN Search: Investigating snippet length, target position and task types. Microsoft Technical Report, MSR-TR-2007-01. ftp://ftp.research.microsoft.com/pub/tr/TR-2007-01.pdf. (2007).

[7]

Dumais, S.T., Cutrell, E. and Chen, H. Optimizing search by showing results in context. In Proc. CHI 2001, ACM Press (2001), 277--284.

Digital Library

[8]

Guan, Z., and Cutrell, E. An eye tracking study of the effect of target rank on Web search. In Proc. CHI 2007, ACM Press (2007).

Digital Library

[9]

Hornof, A.J., and Halverson, T. Cognitive strategies and eye movements for searching hierarchical computer displays. In Proc. CHI 2003, ACM Press (2003), 249--256.

Digital Library

[10]

Hotchkiss, G., Alston, S. and Edwards, G. Eye Tracking Study. http://www.enquiro.com/eyetrackingreport.asp.

[11]

Jansen, B.J. and Pooch, U. A Review of Web Searching Studies and a Framework for Future Research. Journal of the American Society of Information Science and Technology, 52 (2000), 235--246.

Digital Library

[12]

Joachims, T., Granka, L., Pan, B., Hembrooke, H., and Gay, G. Accurately interpreting clickthrough data as implicit feedback. In Proc. SIGIR 2005, ACMPress (2005), 154--161.

Digital Library

[13]

Klöckner, K., Wirschum, N. and Jameson, A. Depth- and breadth-first processing of search result lists. In Ext. Abstracts CHI 2004, ACM Press (2004), 1539--1539.

Digital Library

[14]

Lau, T. and Horvitz, E. Patterns of search: analyzing and modeling web query refinement. Proc. Seventh Int'l Conference on User Modeling, Springer-Verlag (1999), 119--128.

Digital Library

[15]

Lee, U., Liu, Z., and Cho, Junghoo. Automatic identification of user goals in web search. In Proc. WWW 2005, (2005), 391--400.

Digital Library

[16]

Lin, J., Quan, D., Sinha, V., Bakshi, K., Huynh, D., Katz, B., and Karger, D.R. The role of context in question answering systems. In Ext. Abstracts CHI 2003, ACM Press (2003), 1006--1007.

Digital Library

[17]

Lorigo, L., Pan, B., Hembrooke, H., Joachims, T., Granka, L., and Gay, G. The influence of task and gender on search and evaluation behavior using Google. Info. Processing and Management: an Int'l Journal. 42, 4 (2006), 1123--1131.

Digital Library

[18]

Mat-Hassan, M. and Levene, M. Associating search and navigation behavior through log analysis. J American Society for Information Science and Technology, 56 (2005), 913--934.

Digital Library

[19]

Pratt, W. and Fagan, L. The usefulness of dynamically categorizing search results. J American Medical Informatics Association, 7 6(2000), 605--617.

[20]

Rele, R.S. and Duchowski, A.T. Using eye tracking to evaluate alternate search results interfaces. In Proc. HFES,49th Annual Meeting (2005).

[21]

Rose, D.E. Reconciling information-seeking behavior with search user interfaces for the web. J American Society for Information Science and Technology, 57 (2006), 797--799.

Digital Library

[22]

Rose, D.E. and Levinson, D. Understanding user goals in Web search. In Proc. WWW 2004, (2004), 13--19.

Digital Library

[23]

Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. Analysis of a very large AltaVista query log. SRC Technical note #1998-14. http://gatekeeper.dec.com/ pub/DEC/SRC/technical-notes/abstracts/src-tn-1998-014.html. (1998).

[24]

Teevan, J., Alvarado, C., Ackerman, M.S., and Karger, D.R. The perfect search engine is not enough: A study of orienteering behavior in directed search. In Proc. CHI 2004, ACM Press (2004), 415--422.

Digital Library

[25]

Yee, K.P., Swearingen, K., Li, K., and Hearst, M. Faceted metadata for image search and browsing. Proc. SIGCHI 2003, ACM Press (2003), 401--408.

Digital Library

[26]

Zhang, J. and Marchionini, G. Evaluation and evolution of a browse and search interface: relation browser++. In Proc. CHI 2005, ACM Press (2005), 179--188.

Digital Library

Cited By

Lukovics MPrónay SNagy B(2024)Segmented Trust Assessment in Autonomous Vehicles via Eye-TrackingJournal of Intelligent and Connected Vehicles10.26599/JICV.2023.92100377:2(151-161)Online publication date: Jun-2024
https://doi.org/10.26599/JICV.2023.9210037
Simkute ATankelevitch LKewenig VScott ASellen ARintel S(2024)Ironies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI InteractionInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2405782(1-22)Online publication date: 15-Oct-2024
https://doi.org/10.1080/10447318.2024.2405782
Taieb-Maimon MHarush H(2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2376358
Show More Cited By

Index Terms

What are you looking for?: an eye-tracking study of information usage in web search
1. Human-centered computing

Recommendations

An eye tracking study of the effect of target rank on web search
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Web search engines present search results in a rank ordered list. This works when what a user wants is near the top, but sometimes the information that the user really wants is located at the bottom of the page. This study examined how users' search ...
An Analysis of Eye Movements during Browsing Multiple Search Results Pages
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends

In general, most search engines display a certain number of search results on a search results page at one time, separating the entire search results into multiple search results pages. Therefore, lower ranked results (e.g., 11th-ranked result) may be ...
Eye-mouse coordination patterns on web search results pages
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

We analyzed the patterns of coordination between users' eye movements and mouse movements when scanning a web search results page, using data gathered from a study with 32 participants. We discovered 3 patterns of active mouse usage: following the eye ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2007

1654 pages

ISBN:9781595935939

DOI:10.1145/1240624

General Chair:
Mary Beth Rosson
The Pennsylvania State University, USA
,
Program Chair:
David Gilmore
Intel, USA

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI07

Sponsor:

CHI07: CHI Conference on Human Factors in Computing Systems

April 28 - May 3, 2007

California, San Jose, USA

Acceptance Rates

CHI '07 Paper Acceptance Rate 182 of 840 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

289
Total Citations
View Citations
5,916
Total Downloads

Downloads (Last 12 months)184
Downloads (Last 6 weeks)32

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lukovics MPrónay SNagy B(2024)Segmented Trust Assessment in Autonomous Vehicles via Eye-TrackingJournal of Intelligent and Connected Vehicles10.26599/JICV.2023.92100377:2(151-161)Online publication date: Jun-2024
https://doi.org/10.26599/JICV.2023.9210037
Simkute ATankelevitch LKewenig VScott ASellen ARintel S(2024)Ironies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI InteractionInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2405782(1-22)Online publication date: 15-Oct-2024
https://doi.org/10.1080/10447318.2024.2405782
Taieb-Maimon MHarush H(2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2376358
Dosso CChevalier ATamine LPaubel PSalmerón L(2024)People also ask: How does this tool affect exploration-exploitation strategies with regard to prior domain knowledge and search context? An eye-tracking studyApplied Ergonomics10.1016/j.apergo.2024.104367121(104367)Online publication date: Nov-2024
https://doi.org/10.1016/j.apergo.2024.104367
Epstein RLothringer MZankich V(2024)How a Daily Regimen of Operant Conditioning Might Explain the Power of the Search Engine Manipulation Effect (SEME)Behavior and Social Issues10.1007/s42822-023-00155-033:1(82-106)Online publication date: 5-Jan-2024
https://doi.org/10.1007/s42822-023-00155-0
Kameni JBatchakui BNkambou R(2024)Optimization of Information Retrieval Systems for Learning ContextsInternational Journal of Artificial Intelligence in Education10.1007/s40593-024-00415-zOnline publication date: 8-Jul-2024
https://doi.org/10.1007/s40593-024-00415-z
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Pathak KAzzopardi LHalvey M(2024)Ranking Heterogeneous Search Result Pages Using the Interactive Probability Ranking PrincipleAdvances in Information Retrieval10.1007/978-3-031-56060-6_7(96-110)Online publication date: 24-Mar-2024
https://dl.acm.org/doi/10.1007/978-3-031-56060-6_7
Shannaq B(2024)Enhancing Human-Computer Interaction: An Interactive and Automotive Web Application - Digital Associative Tool for Improving Formulating Search QueriesAdvances in Information and Communication10.1007/978-3-031-54053-0_35(511-523)Online publication date: 17-Mar-2024
https://doi.org/10.1007/978-3-031-54053-0_35
Bhattacharya ARobinson SMookherjee SBlöte H(2023)Examining the Impact of Sponsored Search Results on Choice: An Anchoring PerspectiveJournal of Interactive Marketing10.1177/1094996823119585659:2(183-200)Online publication date: 15-Nov-2023
https://doi.org/10.1177/10949968231195856
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten