research-article

Tell me more?: the effects of mental model soundness on personalizing an intelligent agent

Authors:

Margaret Burnett,

Irwin KwanAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1 - 10

https://doi.org/10.1145/2207676.2207678

Published: 05 May 2012 Publication History

Abstract

What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.

References

[1]

Amershi, S., Fogarty, J., Kapoor, A., and Tan, D. Examining multiple potential models in end-user interactive concept learning. In Proc. CHI, ACM (2010), 1357--1360.

Digital Library

[2]

Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review 8, 2 (1977).

[3]

Benedek, J. and Miner, T. Measuring desirability: New methods for evaluating desirability in a usability lab setting. In Proc. Usability Professionals Association International Conference (2002).

[4]

Bozionelos, N. The relationship of instrumental and expressive traits with computer anxiety. Personality and Individual Differences 31 (2001), 955--974.

[5]

Compeau, D. and Higgins, C. Application of social cognitive theory to training for computer skills. Information Systems Research, 6,2 (1995), 118--143.

Digital Library

[6]

Echo Nest, The. http://the.echonest.com (July, 2011).

[7]

Fiebrink, R., Cook, P., and Trueman, D. Human model evaluation in interactive supervised learning. In Proc. CHI, ACM (2011), 147--156.

Digital Library

[8]

Hart, S. and Staveland, L. Development of a NASA-TLX (Task load index): Results of empirical and theoretical research, Hancock, P. and Meshkati, N. (Eds.), Human Mental Workload (1988), 139--183.

[9]

Herlocker, J., Konstan, J., Riedl, J. Explaining collaborative filtering recommendations. In Proc. CSCW, ACM (2000), 241--250.

Digital Library

[10]

Johnson-Laird, P.N. Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. Cambridge University Press (1983).

Digital Library

[11]

Kapoor, A., Lee, B., Tan, D., and Horvitz, E. Interactive optimization for steering machine classification. In Proc. CHI, ACM (2010), 1343--1352.

Digital Library

[12]

Kolb, D. A. Experiential Learning. Prentice-Hall Englewood Cliffs, NJ (1984).

[13]

Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, R., Burnett, M., Oberst, I., and Ko, A. J. Fixing the program my computer learned: barriers for end users, barriers for the machine. In Proc. IUI, ACM (2009), 187--196.

Digital Library

[14]

Kulesza, T., Stumpf, S., Burnett, M., Wong, W., Riche, Y., Moore, T., Oberst, I., Shinsel, A., McIntosh, K. Explanatory debugging: Supporting end-user debugging of machine-learned programs. In Proc. VL/HCC, IEEE (2010), 41--48.

Digital Library

[15]

Lim, B. Y., Dey, A. K., and Avrahami, D. Why and why not explanations improve the intelligibility of contextaware intelligent systems. Proc. CHI, ACM (2009), 2119- 2128.

Digital Library

[16]

Lim, B. Y. and Dey, A. K. Toolkit to support intelligibility in context-aware applications. In Proc. UbiComp, ACM (2010), 13--22.

Digital Library

[17]

McNee, S. M., Lam, S. K., Guetzlaff, C., Konstan, J. A., and Riedl, J. Confidence displays and training in recommender systems. In Proc. INTERACT, IFIP (2003), 176--183.

[18]

Norman, D. Some observations on mental models, Gentner, D. and Stevens, A. (Eds.), Mental Models (1983), 7--14.

[19]

Pandora Media, Inc. Initial Public Offering Form S-1 (2011).

[20]

Rosson, M. B., Carroll, J. M., and Bellamy, R. K. E. Smalltalk scaffolding: a case study of minimalist instruction. In Proc. CHI, ACM (1990), 423--430.

Digital Library

[21]

Sharp, H., Rogers, Y., and Preece, J. Interaction Design: Beyond Human-Computer Interaction (3rd edition), John Wiley (2011).

Digital Library

[22]

Sinha, R. R. and Swearingen, K. The role of transparency in recommender systems. In Proc. CHI Extended Abstracts, ACM (2002), 830--831.

Digital Library

[23]

Stone, P., Dunphy, D., Smith, M., Ogilvie, D., and associates. The General Inquirer: A Computer Approach to Content Analysis. The MIT Press (1966).

[24]

Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T., Sullivan, E., Drummond, R., and Herlocker, J. Toward harnessing user feedback for machine learning. In Proc. IUI, ACM (2007), 82--91.

Digital Library

[25]

Stumpf, S., Rajaram, V., Li, L., Burnett, M., Wong, W.K., Dietterich, T., Sullivan, E., Drummond, R., and Herlocker, J. Interacting meaningfully with machine learning systems: Three experiments. International Journal of Human-Computer Studies 67, 8 (2009).

Digital Library

[26]

Talbot, J., Lee, B., Tan, D., and Kapoor, A. EnsembleMatrix: Interactive visualization to support machine learning with multiple classifiers. In Proc. CHI, ACM (2009), 1283--1292.

Digital Library

[27]

Tintarev, N., and Masthoff, J. Effective explanations of recommendations: User-centered design. In Proc. Recommender Systems (2007), 153--156.

Digital Library

[28]

Tullio, J., Dey, A.K., Chalecki, J., and Fogarty, J. How it works: A field study of non-technical users interacting with an intelligent system. In Proc CHI, ACM (2007).

Digital Library

[29]

Wilfong, J. Computer anxiety and anger: The impact of computer use, computer experience, and self-efficacy beliefs. Computers in Human Behavior 22 (2006).

Cited By

Naveed SStevens GRobin-Kern D(2024)An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAIApplied Sciences10.3390/app14231128814:23(11288)Online publication date: 3-Dec-2024
https://doi.org/10.3390/app142311288
Katzburg ORoimi MFrenkel AIlan RBitan Y(2024)The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation StudyJMIR Human Factors10.2196/5692411(e56924-e56924)Online publication date: 1-Aug-2024
https://doi.org/10.2196/56924
Caterson JLewin AWilliamson E(2024)The application of explainable artificial intelligence (XAI) in electronic health record research: A scoping reviewDIGITAL HEALTH10.1177/2055207624127265710Online publication date: 30-Oct-2024
https://doi.org/10.1177/20552076241272657
Show More Cited By

Index Terms

Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
1. Human-centered computing

Recommendations

User Profiling for Web Page Filtering

To help address pressing problems with information overload, researchers have developed personal agents to provide assistance to users in navigating the Web. To provide suggestions, such agents rely on user profiles representing interests and ...
My Dating Site Thinks I'm a Loser: effects of personal photos and presentation intervals on perceptions of recommender systems
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Receiving poor results from a personalized recommendation system is frustrating. When users try to compensate by putting on a "different face" and game the system, the results can be even more frustrating. This paper investigates how to improve the user ...
Effects of Personalized and Aggregate Top-N Recommendation Lists on User Preference Ratings

Prior research has shown a robust effect of personalized product recommendations on user preference judgments for items. Specifically, the display of system-predicted preference ratings as item recommendations has been shown in multiple studies to bias ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

140
Total Citations
View Citations
2,874
Total Downloads

Downloads (Last 12 months)254
Downloads (Last 6 weeks)23

Reflects downloads up to 22 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Naveed SStevens GRobin-Kern D(2024)An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAIApplied Sciences10.3390/app14231128814:23(11288)Online publication date: 3-Dec-2024
https://doi.org/10.3390/app142311288
Katzburg ORoimi MFrenkel AIlan RBitan Y(2024)The Impact of Information Relevancy and Interactivity on Intensivists’ Trust in a Machine Learning–Based Bacteremia Prediction System: Simulation StudyJMIR Human Factors10.2196/5692411(e56924-e56924)Online publication date: 1-Aug-2024
https://doi.org/10.2196/56924
Caterson JLewin AWilliamson E(2024)The application of explainable artificial intelligence (XAI) in electronic health record research: A scoping reviewDIGITAL HEALTH10.1177/2055207624127265710Online publication date: 30-Oct-2024
https://doi.org/10.1177/20552076241272657
Do HBrachman MDugan CPan QRai PJohnson JThawani R(2024)Evaluating What Others Say: The Effect of Accuracy Assessment in Shaping Mental Models of AI SystemsProceedings of the ACM on Human-Computer Interaction10.1145/36869128:CSCW2(1-26)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686912
Anderson AGuevara JMoussaoui FLi TVorvoreanu MBurnett M(2024)Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving StylesACM Transactions on Interactive Intelligent Systems10.1145/366374014:3(1-90)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3663740
Vincenzi BStumpf STaylor ANakao Y(2024)Lay User Involvement in Developing Human-centric Responsible AI Systems: When and How?ACM Journal on Responsible Computing10.1145/36525921:2(1-25)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3652592
Sungeelee VJarrassé NSanchez TCaramiaux B(2024)Comparing Teaching Strategies of a Machine Learning-based Prosthetic ArmProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645170(715-730)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645170
Kopecka HSuch JLuck M(2024)Preferences for AI Explanations Based on Cognitive Style and Socio-Cultural FactorsProceedings of the ACM on Human-Computer Interaction10.1145/36373868:CSCW1(1-32)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637386
Lee HJung YShin YPark HChoi WLee U(2024)FamilyScope: Visualizing Affective Aspects of Family Social Interactions using Passive Sensor DataProceedings of the ACM on Human-Computer Interaction10.1145/36373348:CSCW1(1-27)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637334
Suchmann LKrämer NZiegler JBoratto LGena CMarras MGermanakos PPopescus E(2024)Dynamic Ridge Plot Sliders: Supporting Users' Understanding of the Item Space Structure and Feature Dependencies in Interactive Recommender SystemsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664872(106-113)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664872
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents