Article

Effects of Interactivity and Presentation on Review-Based Explanations for Recommendations

Authors:

Diana C. Hernandez-Bocanegra,

Jürgen ZieglerAuthors Info & Claims

Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part II

Pages 597 - 618

https://doi.org/10.1007/978-3-030-85616-8_35

Published: 30 August 2021 Publication History

Abstract

User reviews have become an important source for recommending and explaining products or services. Particularly, providing explanations based on user reviews may improve users’ perception of a recommender system (RS). However, little is known about how review-based explanations can be effectively and efficiently presented to users of RS. We investigate the potential of interactive explanations in review-based RS in the domain of hotels, and propose an explanation scheme inspired by dialogue models and formal argument structures. Additionally, we also address the combined effect of interactivity and different presentation styles (i.e. using only text, a bar chart or a table), as well as the influence that different user characteristics might have on users’ perception of the system and its explanations. To such effect, we implemented a review-based RS using a matrix factorization explanatory method, and conducted a user study. Our results show that providing more interactive explanations in review-based RS has a significant positive influence on the perception of explanation quality, effectiveness and trust in the system by users, and that user characteristics such as rational decision-making style and social awareness also have a significant influence on this perception.

References

[1]

Abdul, A., Vermeulen, J., Wang, D., Lim, B.Y., Kankanhalli, M.: Trends and trajectories for explainable, accountable and intelligible systems: an HCI research agenda. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI 2018, p. 1–18 (2018)

[2]

Arioua A and Croitoru M Beierle C and Dekhtyar A Formalizing explanatory dialogues Scalable Uncertainty Management 2015 Cham Springer 282-297

[3]

Bader R, Woerndl W, Karitnig A, and Leitner G Ardissono L and Kuflik T Designing an explanation interface for proactive recommendations in automotive scenarios Advances in User Modeling 2012 Heidelberg Springer 92-104

[4]

Bauman, K., Liu, B., Tuzhilin, A.: Aspect based recommendations: recommending items with the most valuable aspects based on user reviews. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 717–725 (2017)

[5]

Bentahar J, Moulin B, and Belanger M A taxonomy of argumentation models used for knowledge representation Artif. Intell. Rev. 2010 33 3 211-259

[6]

Berkovsky, S., Taib, R., Conway, D.: How to recommend?: user trust factors in movie recommender systems. In: Proceedings of the 22nd International Conference on Intelligent User Interfaces, pp. 287–300 (2017)

[7]

Blair, J.A.: The possibility and actuality of visual arguments. In: Tindale, C. (eds.) Groundwork in the Theory of Argumentation, vol. 21, pp. 205–223 (2012)

[8]

Carenini G, Cheung JCK, and Pauls A Multi document summarization of evaluative text Comput. Intell. 2013 29 545-574

[9]

Carenini G and Moore JD Generating and evaluating evaluative arguments Artif. Intell. 2006 170 925-952

[10]

Casel: 2013 casel guide: Effective social and emotional learning programs - preschool and elementary school edition, collaborative for academic social and emotional learning (2013)

[11]

Chen, C., Zhang, M., Liu, Y., Ma., S.: Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web, pp. 1583–1592. International World Wide Web Conferences Steering Committee (2018)

[12]

Chen, L., Pu, P.: Critiquing-based recommenders: survey and emerging trends 22(1–2), 3085–3094 (2014)

[13]

Cheng, H.F., et al.: Explaining decision-making algorithms through UI: strategies to help non-expert stakeholders. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2019)

[14]

Costa, F., Ouyang, S., Dolog, P., Lawlor, A.: Automatic generation of natural language explanations. In: Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion, pp. 57:1–57:2 (2018)

[15]

Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2019)

[16]

Dong R, O’Mahony MP, and Smyth B Lamontagne L and Plaza E Further experiments in opinionated product recommendation Case-Based Reasoning Research and Development 2014 Cham Springer 110-124

[17]

Donkers, T., Kleemann, T., Ziegler, J.: Explaining recommendations by means of aspect-based transparent memories. In: Proceedings of the 25th International Conference on Intelligent User Interfaces, pp. 166–176 (2020)

[18]

Donkers T and Ziegler J Leveraging arguments in user reviews for generating and explaining recommendations Datenbank-Spektrum 2020 20 2 181-187

[19]

Driver, M.J., Brousseau, K.E., Hunsaker, P.L.: The dynamic decision maker (1990)

[20]

Farkas DK and Farkas JB Guidelines for designing web navigation Tech. Commun. 2000 47 3 341-358

[21]

Faul F, Erdfelder E, Lang AG, and Buchner A G*power 3: a flexible statistical power analysis for the social, behavioral, and biomedical sciences Behav. Res. Methods 2007 39 175-191

[22]

Friedrich G and Zanker M A taxonomy for generating explanations in recommender systems AI Mag. 2011 32 3 90-98

[23]

Habernal I and Gurevych I Argumentation mining in user-generated web discourse Comput. Linguist. 2017 43 1 125-179

[24]

Hamilton K, Shih SI, and Mohammed S The development and validation of the rational and intuitive decision styles scale J. Pers. Assess. 2016 98 5 523-535

[25]

Herlocker, J.L., Konstan, J.A., Riedl, J.: Explaining collaborative filtering recommendations. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 241–250. ACM (2000)

[26]

Hernandez-Bocanegra, D.C., Donkers, T., Ziegler, J.: Effects of argumentative explanation types on the perception of review-based recommendations. In: Adaptation and Personalization (UMAP 2020 Adjunct) (2020)

[27]

Hilton DJ Conversational processes and causal explanation Physcol. Bull. 1990 107 1 65-81

[28]

Kirby JR, Moore PJ, and Schofield NJ Verbal and visual learning styles Contemp. Educ. Psychol. 1988 12 2 169-184

[29]

Klein L Evaluating the potential of interactive media through a new lens: search versus experience goods J. Bus. Res. 1998 41 195-203

[30]

Knijnenburg, B.P., Willemsen, M.C., Gantner, Z., Soncu, H., Newell, C.: Explaining the user experience of recommender systems. In: User Modeling and User-Adapted Interaction, pp. 441–504 (2012)

[31]

Kouki, P., Schaffer, J., Pujara, J., O’Donovan, J., Getoor, L.: Personalized explanations for hybrid recommender systems. In: Proceedings of 24th International Conference on Intelligent User Interfaces (IUI 19), pp. 379–390. ACM (2019)

[32]

Krause, J., Perer, A., Ng, K.: Interacting with predictions: visual inspection of black-box machine learning models. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5686–5697 (2016)

[33]

Lamche, B., Adigüzel, U., Wörndl, W.: Interactive explanations in mobile shopping recommender systems. In: Proceedings of the 4th International Workshop on Personalization Approaches in Learning Environments (PALE 2014), held in conjunction with the 22nd International Conference on User Modeling, Adaptation, and Personalization (UMAP 2014), pp. 92–104 (2012)

[34]

Lipton P Contrastive explanation Royal Inst. Philos. Suppl. 1990 27 247-266

[35]

Liu Y and Shrum LJ What is interactivity and is it always such a good thing? implications of definition, person, and situation for the influence of interactivity on advertising effectiveness J. Advert. 2002 31 4 53-64

[36]

Loepp, B., Herrmanny, K., Ziegler, J.: Blended recommending: integrating interactive information filtering and algorithmic recommender techniques. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI 2015, pp. 975–984 (2015)

[37]

Loepp, B., Hussein, T., Ziegler, J.: Choice-based preference elicitation for collaborative filtering recommender systems. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI 2014, pp. 3085–3094 (2014)

[38]

Madumal, P., Miller, T., Sonenberg, L., Vetere, F.: A grounded interaction protocol for explainable artificial intelligence. In: Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019, pp. 1–9 (2019)

[39]

McKnight DH, Choudhury V, and Kacmar C Developing and validating trust measures for e-commerce: an integrative typology Inf. Syst. Res. 2002 13 334-359

[40]

Miller T Explanation in artificial intelligence: insights from the social sciences Artif. Intell. 2018 267 1-38

[41]

Muhammad, K.I., Lawlor, A., Smyth, B.: A live-user study of opinionated explanations for recommender systems. In: Intelligent User Interfaces (IUI 2016), vol. 2, pp. 256–260 (2016)

[42]

Nelson, P.J.: Consumer Information and Advertising. In: Galatin, M., Leiter, R.D. (eds.) Economics of Information. Social Dimensions of Economics, vol. 3. Springer, Dordrecht (1981).

[43]

Nelson P Information and consumer behavior J. Polit. Econ. 1970 78 2 311-329

[44]

Nunes I and Jannach D A systematic review and taxonomy of explanations in decision support and recommender systems User Model User Adap. 2017 27 393-444

[45]

Perugini M, Gallucci M, and Costantini G A practical primer to power analysis for simple experimental designs Int. Rev. Soc. Psychol. 2018 31 1)(20 1-23

[46]

Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of the Fifth ACM Conference on Recommender Systems - RecSys 2011, pp. 157–164 (2011)

[47]

Rago, A., Cocarascu, O., Bechlivanidis, C., Toni, F.: Argumentation as a framework for interactive explanations for recommendations. In: Proceedings of the Seventeenth International Conference on Principles of Knowledge Representation and Reasoning, pp. 805–815 (2020)

[48]

Schein, A.I., Popescul, A., Ungar, L.H., Pennock, D.M.: Methods and metrics for cold-start recommendations. In: Proceedings of SIGIR 2002, pp. 253–260 (2002)

[49]

Schnotz, W.: Integrated model of text and picture comprehension. In: The Cambridge Handbook of Multimedia Learning, 2nd ed., pp. 72–103 (2014)

[50]

Sniezek JA and Buckley T Cueing and cognitive conflict in judge advisor decision making Organ. Behav. Hum. Decis. Process. 1995 62 2 159-174

[51]

Sokol, K., Flach, P.: LIMEtree: interactively customisable explanations based on local surrogate multi-output regression trees. arXiv preprint arXiv:2005.01427 (2020)

[52]

Sokol, K., Flach, P.: One explanation does not fit all: the promise of interactive explanations for machine learning transparency 34(2), 235–250 (2020)

[53]

Song JH and Zinkhan GM Determinants of perceived web site interactivity J. Mark. 2008 72 2 99-113

[54]

Steuer J Defining virtual reality: dimensions determining telepresence J. Commun. 1992 42 4 73-93

[55]

Tintarev, N.: Explanations of recommendations. In: Proceedings of the 2007 ACM Conference on Recommender Systems, RecSys 2007, pp. 203–206 (2007)

[56]

Tintarev N and Masthoff J Evaluating the effectiveness of explanations for recommender systems User Model. User Adapt. Interact. 2012 22 399-439

[57]

Toulmin, S.E.: The uses of argument (1958)

[58]

Vig, J., Sen, S., Riedl, J.: Tagsplanations: explaining recommendations using tags. In: Proceedings of the 14th International Conference on Intelligent User Interfaces, pp. 47–56. ACM (2009)

[59]

Wachsmuth, H., Trenkmann, M., Stein, B., Engels, G., Palakarska, T.: A review corpus for argumentation analysis. In: 15th International Conference on Intelligent Text Processing and Computational Linguistics, pp. 115–127 (2014)

[60]

Walton D The place of dialogue theory in logic Comput. Sci. Commun. Stud. 2000 123 327-346

[61]

Walton D A new dialectical theory of explanation Philos. Explor. 2004 7 1 71-89

[62]

Walton D A dialogue system specification for explanation Synthese 2011 182 3 349-374

[63]

Walton, D., Krabbe, E.C.W.: Commitment in Dialogue: Basic Concepts of Interpersonal Reasoning. State University of New York Press, New York (1995)

[64]

Wang, N., Wang, H., Jia, Y., Yin, Y.: Explainable recommendation via multi-task learning in opinionated text data. In: Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, pp. 165–174 (2018)

[65]

Weld DS and Bansal G The challenge of crafting intelligible intelligence Commun. ACM 2019 62 6 70-79

[66]

Wu, Y., Ester, M.: Flame: a probabilistic model combining aspect based opinion mining and collaborative filtering. In: Eighth ACM International Conference on Web Search and Data Mining, pp. 153–162. ACM (2015)

[67]

Xiao B and Benbasat I Ecommerce product recommendation agents: use, characteristics, and impact MIS Q. 2007 31 1 137-209

[68]

Yaniv I and Milyavsky M Using advice from multiple sources to revise and improve judgments Organ. Behav. Hum. Decis. Process. 2007 103 104-120

[69]

Zanker, M., Schoberegger, M.: An empirical study on the persuasiveness of fact-based explanations for recommender systems. In: Joint Workshop on Interfaces and Human Decision Making in Recommender Systems, pp. 33–36 (2014)

[70]

Zhang, Y., Lai, G., Zhang, M., Zhang, Y., Liu, Y., Ma., S.: Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In: Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 83–92 (2014)

Cited By

Chatti MGuesmi MMuslim A(2024)Visualization for Recommendation Explainability: A Survey and New PerspectivesACM Transactions on Interactive Intelligent Systems10.1145/367227614:3(1-40)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3672276
Hernandez-Bocanegra DZiegler J(2023)Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of InteractivityACM Transactions on Interactive Intelligent Systems10.1145/357954113:2(1-47)Online publication date: 12-Apr-2023
https://dl.acm.org/doi/10.1145/3579541
Sun YSundar S(2022)Exploring the Effects of Interactive Dialogue in Improving User Control for Explainable Online Symptom CheckersExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519668(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519668

Index Terms

Effects of Interactivity and Presentation on Review-Based Explanations for Recommendations

Index terms have been assigned to the content through auto-classification.

Recommendations

Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of Interactivity
Explaining system-generated recommendations based on user reviews can foster users’ understanding and assessment of the recommended items and the recommender system (RS) as a whole. While up to now explanations have mostly been static, shown in a single ...
On the Negative Perception of Cross-domain Recommendations and Explanations
SIGIR '24: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval

Recommender systems typically operate within a single domain, for example, recommending books based on users' reading habits. If such data is unavailable, it may be possible to make cross-domain recommendations and recommend books based on user ...
Effects of Argumentative Explanation Types on the Perception of Review-Based Recommendations
UMAP '20 Adjunct: Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization

Recommender systems have achieved considerable maturity and accuracy in recent years. However, the rationale behind recommendations mostly remains opaque. Providing textual explanations based on user reviews may increase users' perception of ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part II

Aug 2021

688 pages

ISBN:978-3-030-85615-1

DOI:10.1007/978-3-030-85616-8

Editors:
Carmelo Ardito
Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy
,
Rosa Lanzilotti
Computer Science Department, University of Bari Aldo Moro, Bari, Italy
,
Alessio Malizia
Computer Science Department, University of Pisa, Pisa, Italy
,
Helen Petrie
Department of Computer Science, University of York, York, UK
,
Antonio Piccinno
Computer Science Department, University of Bari Aldo Moro, Bari, Italy
,
Giuseppe Desolda
Computer Science Department, University of Bari Aldo Moro, Bari, Italy
,
Kori Inkpen
Microsoft Research, Redmond, WA, USA

© IFIP International Federation for Information Processing 2021.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 30 August 2021

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chatti MGuesmi MMuslim A(2024)Visualization for Recommendation Explainability: A Survey and New PerspectivesACM Transactions on Interactive Intelligent Systems10.1145/367227614:3(1-40)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3672276
Hernandez-Bocanegra DZiegler J(2023)Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of InteractivityACM Transactions on Interactive Intelligent Systems10.1145/357954113:2(1-47)Online publication date: 12-Apr-2023
https://dl.acm.org/doi/10.1145/3579541
Sun YSundar S(2022)Exploring the Effects of Interactive Dialogue in Improving User Control for Explainable Online Symptom CheckersExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519668(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519668
Hernandez-Bocanegra DZiegler J(2021)Conversational review-based explanations for recommender systems: Exploring users’ query behaviorProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469596(1-11)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469596

View Options

View options

Figures

Tables

Media

View Table of Conten