skip to main content
10.1145/3450741.3465257acmconferencesArticle/Chapter ViewAbstractPublication Pagesc-n-cConference Proceedingsconference-collections
research-article
Open access

“It’s Just a Graph” – The Effect of Post-Hoc Rationalisation on InfoVis Evaluation

Published: 22 June 2021 Publication History

Abstract

A growing body of work in InfoVis explores its user experience (UX), however, emotions remain underexplored. Our study reveals barriers for investigating personal connection and emotional reaction to visualisations. This provides an explanation for why the role of emotions so far received little attention in InfoVis. Twenty-four participants viewed two traditional data visualisations, answered UX questionnaires for each, and were interviewed about their experience. Our findings show that traditional visualisations are seen as ‘just a graph’, that represents neutral information. Participants referred to aesthetics, legibility, and usability, instead of the actual topic. Moreover, to make sense of the data, emotions have to be separated from it. We found four possible explanations underlying this belief and argue that a form of post-hoc rationalisation takes place, which obscures people’s initial connections and affective responses to visualisations. Based on these findings, we discuss implications for future research on the UX of visualisations.

References

[1]
American Psychological Association. [n.d.]. personality – APA Dictionary of Psychology. https://dictionary.apa.org/reverse-counterbalancing
[2]
American Psychological Association. 2018. epiphenomenon – APA Dictionary of Psychology. https://dictionary.apa.org/complete-counterbalancing
[3]
Javier Bargas-Avila and Kasper Hornbæk. 2012. Foci and blind spots in user experience research. Interactions 19, 6 (11 2012), 24–27. https://doi.org/10.1145/2377783.2377790
[4]
Allison Barnes and Paul Thagard. 2003. Emotional decisions., 7 pages. http://cogprints.org/619/1/Emot_Decis.html
[5]
Michelle A. Borkin, Azalea A. Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, and Hanspeter Pfister. 2013. What Makes a Visualization Memorable?IEEE Transactions on Visualization and Computer Graphics 19, 12 (12 2013), 2306–2315. https://doi.org/10.1109/TVCG.2013.234
[6]
Jeremy Boy, Anshul Vikram Pandey, John Emerson, Margaret Satterthwaite, Oded Nov, and Enrico Bertini. 2017. Showing People Behind Data. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 5462–5474. https://doi.org/10.1145/3025453.3025512
[7]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (1 2006), 77–101. https://doi.org/10.1191/1478088706qp063oa
[8]
Damla Cay, Till Nagel, and Asim Evren Yantac. 2020. Understanding User Experience of COVID-19 Maps through Remote Elicitation Interviews. In 2020 IEEE Workshop on Evaluation and Beyond - Methodological Approaches to Visualization (BELIV). IEEE, 65–73. https://doi.org/10.1109/BELIV51497.2020.00015
[9]
CBS. 2018. StatLine - Geboorte; kerncijfers. https://opendata.cbs.nl/statline//CBS/nl/dataset/37422ned/line?ts=1589282698552
[10]
Antonio Damasio. 1994. Descartes’ error: Emotion, rationality and the human brain. G.P. Putnam’s Sons, New York. 344 pages. https://archive.org/details/descarteserrorem00dama/page/n11/mode/2up
[11]
Díaz-Oreiro, López, Quesada, and Guerrero. 2019. Standardized Questionnaires for User Experience Evaluation: A Systematic Literature Review. Proceedings 31, 1 (2019), 14. https://doi.org/10.3390/proceedings2019031014
[12]
Catherine D’Ignazio and Lauren F. Klein. 2020. Data Feminism. The MIT Press, New York. 328 pages. https://doi.org/10.7551/mitpress/11805.001.0001
[13]
Alan Dix. 2009. Human-Computer Interaction. In Encyclopedia of Database Systems. Springer US, Boston, MA, 1327–1331. https://doi.org/10.1007/978-0-387-39940-9_192
[14]
Tommaso Elli, Uta Hinrichs, Adam Bradley, Zachary Hills, Christopher Collins, and Karen Kelsky. 2020. Tied in Knots: A Case Study on Anthropographic Data Visualization About Sexual Harassment in the Academy. In 2020 IEEE VIS Arts Program (VISAP). IEEE, 29–44. https://doi.org/10.1109/VISAP51628.2020.00010
[15]
Eurostat. 2018. Non-EU citizens: 4.4 % of the EU population in 2018 - Product - Eurostat. https://ec.europa.eu/eurostat/web/products-eurostat-news/-/DDN-20190315-1?inheritRedirect=true
[16]
Sarah Faisal, Paul Cairns, and Ann Blandford. 2007. Challenges of Evaluating the Information Visualisation Experience. In Proceedings of the 21st BCS HCI Group Conferenc, Devina Ramduny-Ellis and Dorothy Rachovides (Eds.), Vol. 2. British Computer Society, Lancaster, 4.
[17]
Sarah Faisal, Brock Craft, Paul Cairns, and Ann Blandford. 2008. Internalization, qualitative methods, and evaluation. In Proceedings of the 2008 conference on BEyond time and errors novel evaLuation methods for Information Visualization - BELIV ’08. ACM Press, New York, New York, USA, 1. https://doi.org/10.1145/1377966.1377973
[18]
Michael Friendly. 2008. A Brief History of Data Visualization. In Handbook of Data Visualization. Springer Berlin Heidelberg, Berlin, Heidelberg, 15–56. https://doi.org/10.1007/978-3-540-33037-0_2
[19]
Stefan Gradl, Markus Wirth, Tobias Zillig, and Bjoern M. Eskofier. 2018. Visualization of heart activity in virtual reality: A biofeedback application using wearable sensors. In 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, Las Vegas, 152–155. https://doi.org/10.1109/BSN.2018.8329681
[20]
Guillaume Gronier, Carine Lallemand, and Adélaïde Chauvet. 2015. Mesurer la formation de la première impression d’une interface à l’aide du test des 5 secondes. In 8ème conférence de Psychologie Ergonomique (EPIQUE 2015). Aix-en-Provence. https://www.list.lu/en/research/scientific-publication/mesurer-la-formation-de-la-premiere-impression-dune-interface-homme-machine-a-laide-du-test-des-5/
[21]
Tobias Grundgeiger, Jörn Hurtienne, and Oliver Happel. 2020. Why and How to Approach User Experience in Safety-Critical Domains: The Example of Health Care. Human Factors: The Journal of the Human Factors and Ergonomics Society XX, X (1 2020), 12. https://doi.org/10.1177/0018720819887575
[22]
Steve Haroz, Robert Kosara, and Steven L. Franconeri. 2015. ISOTYPE Visualization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1191–1200. https://doi.org/10.1145/2702123.2702275
[23]
Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction(2004). https://doi.org/10.1207/s15327051hci1904_2
[24]
Marc Hassenzahl. 2008. User experience (UX): Towards an experiential perspective on product quality. ACM International Conference Proceeding Series (2008), 11–15. https://doi.org/10.1145/1512714.1512717
[25]
Marc Hassenzahl, Andreas Beu, and Michael Burmester. 2001. Engineering joy. IEEE Software 18, 1 (2001), 70–76. https://doi.org/10.1109/52.903170
[26]
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & Computer. J.Ziegler & G. Szwillus (Eds.), Stuttgart, 187–196. https://doi.org/10.1007/978-3-322-80058-9_19
[27]
Marc Hassenzahl and Noam Tractinsky. 2006. User experience - a research agenda. Behaviour & Information Technology 25, 2 (3 2006), 91–97. https://doi.org/10.1080/01449290500330331
[28]
Uta Hinrichs, Holly Schmidt, and Sheelagh Carpendale. 2008. EMDialog: Bringing Information Visualization into the Museum. IEEE Transactions on Visualization and Computer Graphics 14, 6 (11 2008), 1181–1188. https://doi.org/10.1109/TVCG.2008.127
[29]
Trevor Hogan, Uta Hinrichs, and Eva Hornecker. 2016. The Elicitation Interview Technique: Capturing People’s Experiences of Data Representations. IEEE Transactions on Visualization and Computer Graphics 22, 12(2016), 2579–2593. https://doi.org/10.1109/TVCG.2015.2511718
[30]
Trevor Hogan and Eva Hornecker. 2013. Blending the repertory grid technique with focus groups to reveal rich design relevant insight. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces - DPPI ’13. ACM Press, New York, New York, USA, 116. https://doi.org/10.1145/2513506.2513519
[31]
Jessica Hullman, Nicholas Diakopoulos, Elaheh Momeni, and Eytan Adar. 2015. Content, Context, and Critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, USA, 1170–1175. https://doi.org/10.1145/2675133.2675207
[32]
Ya-Hsin Hung and Paul Parsons. 2017. Assessing User Engagement in Information Visualization. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Vol. Part F1276. ACM, New York, NY, USA, 1708–1717. https://doi.org/10.1145/3027063.3053113
[33]
Tobias Kauer, Arran Ridley, Marian Dörk, and Benjamin Bach. 2021. The Public Life of Data: Investigating Reactions to Visualizations on Reddit. In CHI Conference on Human Factors in Computing Systems (CHI ’21). 12. https://doi.org/10.1145/3411764.3445720
[34]
Helen Kennedy and Rosemary Lucy Hill. 2018. The Feeling of Numbers: Emotions in Everyday Engagements with Data and Their Visualisation. Sociology 52, 4 (2018), 830–848. https://doi.org/10.1177/0038038516674675
[35]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5298 LNCS (2008), 63–76. https://doi.org/10.1007/978-3-540-89350-9-6
[36]
Effie Lai-Chong Law, Virpi Roto, Marc Hassenzahl, Arnold P.O.S. Vermeeren, and Joke Kort. 2009. Understanding, scoping and defining user experience. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 719. https://doi.org/10.1145/1518701.1518813
[37]
Benjamin Lee, Dave Brown, Bongshin Lee, Christophe Hurter, Steven Drucker, and Tim Dwyer. 2020. Data Visceralization: Enabling Deeper Understanding of Data Using Virtual Reality. IEEE Transactions on Visualization and Computer Graphics x, x(2020), 1–1. https://doi.org/10.1109/TVCG.2020.3030435
[38]
Pierre Livet. 2010. Rational choice, neuroeconomy and mixed emotions. Philosophical Transactions of the Royal Society B: Biological Sciences 365, 1538 (1 2010), 259–269. https://doi.org/10.1098/rstb.2009.0177
[39]
George Loewenstein and Jennifer S. Lerner. 2003. The Role of Affect in Decision Making. In Handbook of Affective Science. Oxford University Press, New York, 619–642.
[40]
Marianne Lykke and Christian Jantzen. 2016. User Experience Dimensions. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. ACM, New York, NY, USA, 81–90. https://doi.org/10.1145/2854946.2854965
[41]
Sascha Mahlke. 2007. Aesthetic and Symbolic Qualities as Antecedents of Overall Judgements of Interactive Products. In People and Computers XX — Engage. Springer London, London, 57–64. https://doi.org/10.1007/978-1-84628-664-3_5
[42]
Camila Loiola Brito Maia and Elizabeth Sucupira Furtado. 2016. A Systematic Review About User Experience Evaluation. In 5th International Conference, DUXU 2016, Vol. 9746. Springer, Cham., Toronto, 445–455. https://doi.org/10.1007/978-3-319-40409-7_42
[43]
Lev Manovich. 2011. What is visualisation?Visual Studies 26, 1 (3 2011), 36–49. https://doi.org/10.1080/1472586X.2011.548488
[44]
Riccardo Mazza and Alessandra Berre. 2007. Focus Group Methodology for Evaluating Information Visualization Techniques and Tools. In 2007 11th International Conference Information Visualization (IV ’07). IEEE, 74–80. https://doi.org/10.1109/IV.2007.51
[45]
Tanja Merčun. 2014. Evaluation of information visualization techniques. In Proceedings of the Fifth Workshop on Beyond Time and Errors Novel Evaluation Methods for Visualization - BELIV ’14. ACM Press, New York, New York, USA, 103–109. https://doi.org/10.1145/2669557.2669565
[46]
Luiz Morais, Yvonne Jansen, Nazareno Andrade, and Pierre Dragicevic. 2020. Showing Data about People: A Design Space of Anthropographics. IEEE Transactions on Visualization and Computer Graphics (2020), 1–1. https://doi.org/10.1109/TVCG.2020.3023013
[47]
Kawa Nazemi, Dirk Burkhardt, David Hoppe, Mariam Nazemi, and Jörn Kohlhammer. 2015. Web-based Evaluation of Information Visualization. Procedia Manufacturing 3(2015), 5527–5534. https://doi.org/10.1016/j.promfg.2015.07.718
[48]
Don Norman. 1998. The Design of Everyday Things. MIT, New York. 272 pages.
[49]
Donald A. Norman. 2004. Emotional design. Ubiquity 2004, January (1 2004), 1–1. https://doi.org/10.1145/985600.966013
[50]
Stanislaw Nowak, Lyn Bartram, and Thecla Schiphorst. 2018. A Micro-Phenomenological Lens for Evaluating Narrative Visualization. In 2018 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV). IEEE, 11–18. https://doi.org/10.1109/BELIV.2018.8634072
[51]
Evan M. Peck, Sofia E. Ayuso, and Omar El-Etr. 2019. Data is Personal. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300474
[52]
Rosalind W. Picard. 1997. Affective Computing. The MIT Press, New York. 306 pages.
[53]
Bahador Saket, Alex Endert, and John Stasko. 2016. Beyond usability and performance: A review of user experience-focused evaluations in Visualization. ACM International Conference Proceeding Series 24-October (2016), 133–142. https://doi.org/10.1145/2993901.2993903
[54]
Bahador Saket, Carlos Scheidegger, and Stephen Kobourov. 2016. Comparing Node-Link and Node-Link-Group Visualizations From An Enjoyment Perspective. Computer Graphics Forum 35, 3 (2016), 41–50. https://doi.org/10.1111/cgf.12880
[55]
Dominique L. Scapin, Bernard Senach, Brigitte Trousse, and Marc Pallot. 2012. User experience: Buzzword or new paradigm?ACHI 2012 - 5th International Conference on Advances in Computer-Human InteractionsFebruary 2015(2012), 336–341.
[56]
Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE Transactions on Visualization and Computer Graphics 16, 6(2010), 1139–1148. https://doi.org/10.1109/TVCG.2010.179
[57]
Duaa Shaalan and Shaidah Jusoh. 2020. Visualization in Medical System Interfaces: UX Guidelines. In 2020 12th International Conference on Electronics, Computers and Artificial Intelligence (ECAI). IEEE, 1–8. https://doi.org/10.1109/ECAI50035.2020.9223236
[58]
SoSci GmhB. [n.d.]. SoSci Survey - the Professional Solution for Your Online Survey. https://www.soscisurvey.de/
[59]
John Stasko. 2014. Value-driven evaluation of visualizations. ACM International Conference Proceeding Series 10-Novembe (2014), 46–53. https://doi.org/10.1145/2669557.2669579
[60]
Robert Sylwester. 1994. How emotions affect learning. Educational Leadership 52, 2 (1994), 60–65. http://www.ascd.org/publications/educational-leadership/oct94/vol52/num02/How-Emotions-Affect-Learning.aspx
[61]
Alice Thudt, Dominikus Baur, Samuel Huron, and Sheelagh Carpendale. 2016. Visual Mementos: Reflecting Memories with Personal Data. IEEE Transactions on Visualization and Computer Graphics 22, 1 (1 2016), 369–378. https://doi.org/10.1109/TVCG.2015.2467831
[62]
Melanie Tory and Torsten Möller. 2005. Evaluating visualizations: Do expert reviews work?, 8–11 pages. https://doi.org/10.1109/MCG.2005.102
[63]
Paul van Schaik and Jonathan Ling. 2008. Modelling user experience with web sites: Usability, hedonic value, beauty and goodness. Interacting with Computers 20, 3 (5 2008), 419–432. https://doi.org/10.1016/j.intcom.2008.03.001
[64]
Sara Värlander. 2008. The role of students’ emotions in formal feedback situations. Teaching in Higher Education 13, 2 (4 2008), 145–156. https://doi.org/10.1080/13562510801923195
[65]
Pierre Vermersch. 2014. L’entretien d’explicitation. ESF, Strasbourg Cedex. 100 pages. https://doi.org/10.14375/NP.9782710127055
[66]
Yun Wang, Adrien Segal, Roberta Klatzky, Daniel F. Keefe, Petra Isenberg, Jorn Hurtienne, Eva Hornecker, Tim Dwyer, Stephen Barrass, and Theresa-Marie Rhyne. 2019. An Emotional Response to the Value of Visualization. IEEE Computer Graphics and Applications 39, 5 (9 2019), 8–17. https://doi.org/10.1109/MCG.2019.2923483
[67]
David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales. Journal of Personality and Social Psychology 54, 6(1988), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
C&C '21: Proceedings of the 13th Conference on Creativity and Cognition
June 2021
581 pages
ISBN:9781450383769
DOI:10.1145/3450741
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. InfoVis
  2. Post-Hoc Rationalisation
  3. Role of Emotions
  4. User Experience

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

C&C '21
Sponsor:
C&C '21: Creativity and Cognition
June 22 - 23, 2021
Virtual Event, Italy

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)180
  • Downloads (Last 6 weeks)9
Reflects downloads up to 24 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media