skip to main content
10.1145/3384657.3384799acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahsConference Proceedingsconference-collections
research-article
Open access

Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant

Published: 06 June 2020 Publication History

Abstract

Human judgments and decisions are prone to errors in reasoning caused by factors such as personal biases and external misinformation. We explore the possibility of enhanced reasoning by implementing a wearable AI system as a human symbiotic counterpart. We present "Wearable Reasoner", a proof-of-concept wearable system capable of analyzing if an argument is stated with supporting evidence or not. We explore the impact of argumentation mining and explainability of the AI feedback on the user through an experimental study of verbal statement evaluation tasks. The results demonstrate that the device with explainable feedback is effective in enhancing rationality by helping users differentiate between statements supported by evidence and without. When assisted by an AI system with explainable feedback, users significantly consider claims supported by evidence more reasonable and agree more with them compared to those without. Qualitative interviews demonstrate users' internal processes of reflection and integration of the new information in their judgment and decision making, emphasizing improved evaluation of presented arguments.

References

[1]
Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y Lim, and Mohan Kankanhalli. 2018. Trends and trajectories for explainable, accountable and intelligible systems: An hci research agenda. In Proceedings of the 2018 CHI conference on human factors in computing systems. ACM, 582.
[2]
Judith Amores, Mae Dotan, and Pattie Maes. 2019. An Exploration of Form Factors for Sleep-Olfactory Interfaces. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 1456--1460.
[3]
Katie Atkinson, Pietro Baroni, Massimiliano Giacomin, Anthony Hunter, Henry Prakken, Chris Reed, Guillermo Simari, Matthias Thimm, and Serena Villata. 2017. Towards artificial argumentation. AI magazine 38, 3 (2017), 25--36.
[4]
Guillermo Bernal, Lily Zhou, Haripriya Mehta, and Pattie Maes. 2019. Paper Dreams: An Interactive Interface for Generative Visual Expression. (2019).
[5]
Maarten Boudry, Fabio Paglieri, and Massimo Pigliucci. 2015. The fake, the flimsy, and the fallacious: Demarcating arguments in real life. Argumentation 29, 4 (2015), 431--456.
[6]
Judith L Bronstein. 2015. Mutualism. Oxford University Press, USA.
[7]
Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. 77--91.
[8]
Daniel Chen and Roel Vertegaal. 2004. Using mental load for managing interruptions in physiologically attentive user interfaces. In CHI'04 extended abstracts on Human factors in computing systems. ACM, 1513--1516.
[9]
Artem Chernodub, Oleksiy Oliynyk, Philipp Heidenreich, Alexander Bondarenko, Matthias Hagen, Chris Biemann, and Alexander Panchenko. 2019. Targer: Neural argument mining at your fingertips. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 195--200.
[10]
E Colin Cherry. 1953. Some experiments on the recognition of speech, with one and with two ears. The Journal of the acoustical society of America 25, 5 (1953), 975--979.
[11]
Oana Cocarascu and Francesca Toni. 2017. Identifying attack and support argumentative relations using deep learning. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 1374--1379.
[12]
Roberto Confalonieri, Tarek R Besold, Tillman Weyde, Kathleen Creel, Tania Lombrozo, Shane Mueller, and Patrick Shafto. 2019. What makes a good explanation? Cognitive dimensions of explaining intelligent machines. CogSci 2019: Creativity+ Cognition+ Computation (2019).
[13]
Jean Costa, Alexander T Adams, Malte F Jung, François Guimbretière, and Tanzeem Choudhury. 2017. EmotionCheck: A Wearable Device to Regulate Anxiety through False Heart Rate Feedback. GetMobile: Mobile Computing and Communications 21, 2 (2017), 22--25.
[14]
Mamoru Deguchi and Kazunori Yamaguchi. 2019. Argument Component Classification by Relation Identification by Neural Network and TextRank. In Proceedings of the 6th Workshop on Argument Mining. 83--91.
[15]
Angela E Douglas. 1994. Symbiotic interactions. Number 577.85 D733s. Oxon, GB: Oxford University Press, 1994.
[16]
Douglas C Engelbart. 1962. Augmenting human intellect: A conceptual framework. Menlo Park, CA (1962).
[17]
Leon Festinger. 1962. Cognitive dissonance. Scientific American 207, 4 (1962), 93--106.
[18]
Susan T Fiske and Shelley E Taylor. 2013. Social cognition: From brains to culture. Sage.
[19]
Gerd Gigerenzer and Reinhard Selten. 2002. Bounded rationality: The adaptive toolbox. MIT press.
[20]
Edward M Glaser. 1985. Educating for responsible citizenship in a democracy. In National Forum, Vol. 65. Honor Society of Phi Kappa Phi, 24.
[21]
Google. 2020. People + AI Guidebook: Explainability + Trust. (2020). https://pair.withgoogle.com/chapter/explainability-trust/
[22]
David Gunning. 2016. Broad Agency Announcement Explainable Artificial Intelligence (XAI). Technical Report. Technical report.
[23]
Adam Haar Horowitz, Ishaan Grover, Pedro Reynolds-Cuéllar, Cynthia Breazeal, and Pattie Maes. 2018. Dormio: Interfacing with Dreams. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, alt10.
[24]
Ivan Habernal and Iryna Gurevych. 2016. Which argument is more convincing? Analyzing and predicting convincingness of Web arguments using bidirectional LSTM. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1589--1599.
[25]
Ivan Habernal, Henning Wachsmuth, Iryna Gurevych, and Benno Stein. 2018. Before name-calling: Dynamics and triggers of ad hominem fallacies in web argumentation. arXiv preprint arXiv:1802.06613 (2018).
[26]
Shohreh Haddadan, Serena Villata, and Elena Cabrio. 2019. Yes, we can! mining arguments in 50 years of us presidential campaign debates. (2019).
[27]
Ali Hasan and Richard Fumerton. 2018. Foundationalist Theories of Epistemic Justification. In The Stanford Encyclopedia of Philosophy (fall 2018 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University.
[28]
Edward F Haskell. 1949. A clarification of social science. Main Currents in Modern Thought 7, 2 (1949), 45--51.
[29]
Robert R Hoffman, Gary Klein, and Shane T Mueller. 2018. Explaining Explanation For "Explainable Ai". In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications Sage CA: Los Angeles, CA, 197--201.
[30]
Andreas Holzinger, Bernd Malle, Peter Kieseberg, Peter M Roth, Heimo Müller, Robert Reihs, and Kurt Zatloukal. 2017. Towards the augmented pathologist: Challenges of explainable-ai in digital pathology. arXiv preprint arXiv:1712.06657 (2017).
[31]
Jochen Huber, Roy Shilkrot, Pattie Maes, and Suranga Nanayakkara. 2018. Assistive Augmentation. Springer.
[32]
Fatih Incekara, Marion Smits, Clemens Dirven, and Arnaud Vincent. 2018. Clinical feasibility of a wearable mixed-reality device in neurosurgery. World neurosurgery 118 (2018), e422-e427.
[33]
Daniel Kahneman. 2011. Thinking, fast and slow. Macmillan.
[34]
Daniel Kahneman and Shane Frederick. 2002. Representativeness revisited: Attribute substitution in intuitive judgment. Heuristics and biases: The psychology of intuitive judgment 49 (2002), 81.
[35]
Daniel Kahneman, Stewart Paul Slovic, Paul Slovic, and Amos Tversky. 1982. Judgment under uncertainty: Heuristics and biases. Cambridge university press.
[36]
Arnav Kapur, Shreyas Kapur, and Pattie Maes. 2018. Alterego: A personalized wearable silent speech interface. In 23rd International Conference on Intelligent User Interfaces. ACM, 43--53.
[37]
Jonathan Kobbe, Juri Opitz, Maria Becker, Ioana Hulpus, Heiner Stuckenschmidt, and Anette Frank. 2019. Exploiting background knowledge for argumentative relation classification. In 2nd Conference on Language, Data and Knowledge (LDK 2019). Schloss Dagstuhl-Leibniz-Zentrum für Informatik.
[38]
Nataliya Kosmyna, Utkarsh Sarawgi, and Pattie Maes. 2018. AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. ACM, 999--1005.
[39]
HA Kusmantini, I Asror, and MA Bijaksana. 2019. Argumentation mining: classifying argumentation components with Partial Tree Kernel and Support Vector Machine for constituent trees on imbalanced persuasive essay. In Journal of Physics: Conference Series, Vol. 1192. IOP Publishing, 012009.
[40]
Mik Lamming and Mike Flynn. 1994. Forget-me-not: Intimate computing in support of human memory. In Proc. FRIEND21, 1994 Int. Symp. on Next Generation Human Interface. 4.
[41]
David MJ Lazer, Matthew A Baum, Yochai Benkler, Adam J Berinsky, Kelly M Greenhill, Filippo Menczer, Miriam J Metzger, Brendan Nyhan, Gordon Pennycook, David Rothschild, and others. 2018. The science of fake news. Science 359, 6380 (2018), 1094--1096.
[42]
Jennifer S Lerner and Philip E Tetlock. 1999. Accounting for the effects of accountability. Psychological bulletin 125, 2 (1999), 255.
[43]
John Licato, Mark Boger, and Zhitian Zhang. 2018. Developing a Dataset for Personal Attacks and Other Indicators of Biases. In 2018 AAAI Spring Symposium Series.
[44]
Joseph Carl Robnett Licklider. 1960. Man-computer symbiosis. IRE transactions on human factors in electronics 1 (1960), 4--11.
[45]
Matthias Liebeck, Katharina Esau, and Stefan Conrad. 2016. What to Do with an Airport? Mining Arguments in the German Online Participation Project Tempelhofer Feld. In Proceedings of the Third Workshop on Argument Mining (ArgMining2016). 144--153.
[46]
Marco Lippi and Paolo Torroni. 2016. Argumentation mining: State of the art and emerging trends. ACM Transactions on Internet Technology (TOIT) 16, 2 (2016), 10.
[47]
Emily G Liquin and Tania Lombrozo. 2020. A functional approach to explanation-seeking curiosity. Cognitive Psychology 119 (2020), 101276.
[48]
Tania Lombrozo and Susan Carey. 2006. Functional explanation and the function of explanation. Cognition 99, 2 (2006), 167--204.
[49]
Anastasios Lytos, Thomas Lagkas, Panagiotis Sarigiannidis, and Kalina Bontcheva. 2019a. The evolution of argumentation mining: From models to social media and emerging tools. Information Processing & Management 56, 6 (2019), 102055.
[50]
Anastasios Lytos, Thomas Lagkas, Panagiotis Sarigiannidis, and Kalina Bontcheva. 2019b. The evolution of argumentation mining: From models to social media and emerging tools. Information Processing& Management 56, 6 (2019), 102055.
[51]
Pattie Maes. 1995. Agents that reduce work and information overload. In Readings in human--computer interaction. Elsevier, 811--821.
[52]
Sarah Mennicken, Jo Vermeulen, and Elaine M Huang. 2014. From today's augmented houses to tomorrow's smart homes: new directions for home automation research. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 105--115.
[53]
Nancy A Moran. 2007. Symbiosis as an adaptive process and source of phenotypic complexity. Proceedings of the National Academy of Sciences 104, suppl 1 (2007), 8627--8633.
[54]
Neville Moray. 1959. Attention in dichotic listening: Affective cues and the influence of instructions. Quarterly journal of experimental psychology 11, 1 (1959), 56--60.
[55]
Gaku Morio and Katsuhide Fujita. 2018. End-to-End Argument Mining for Discussion Threads Based on Parallel Constrained Pointer Architecture. arXiv preprint arXiv:1809.00563 (2018).
[56]
Huy Nguyen and Diane Litman. 2016. Context-aware argumentative relation mining. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1127--1137.
[57]
Huy V Nguyen and Diane J Litman. 2018. Argument mining for improving the automated scoring of persuasive essays. In Thirty-Second AAAI Conference on Artificial Intelligence.
[58]
Brendan Nyhan, Ethan Porter, Jason Reifler, and Thomas J Wood. 2019. Taking fact-checks literally but not seriously? The effects of journalistic fact-checking on factual beliefs and candidate favorability. Political Behavior (2019), 1--22.
[59]
Athina Papadopoulou, Jaclyn Berry, Terry Knight, and Rosalind Picard. 2019. Affective Sleeve: Wearable Materials with Haptic Action for Promoting Calmness. In International Conference on Human-Computer Interaction. Springer, 304--319.
[60]
Seymour Papert. 2005. You can't think about thinking without thinking about thinking about something. Contemporary Issues in Technology and Teacher Education 5, 3 (2005), 366--367.
[61]
Gordon Pennycook and David G Rand. 2019. Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition 188 (2019), 39--50.
[62]
Georgios Petasis. 2019. Segmentation of Argumentative Texts with Contextualised Word Representations. In Proceedings of the 6th Workshop on Argument Mining. 1--10.
[63]
Kashyap Kiritbhai Popat. 2019. Credibility analysis of textual claims with explainable evidence. (2019).
[64]
Bradley J Rhodes. 1997. The wearable remembrance agent: A system for augmented memory. Personal Technologies 1, 4 (1997), 218--224.
[65]
Alexander S Rich and Todd M Gureckis. 2019. Lessons for artificial intelligence from the study of natural stupidity. Nature Machine Intelligence 1, 4 (2019), 174.
[66]
Ruty Rinott, Lena Dankin, Carlos Alzate Perez, Mitesh M. Khapra, Ehud Aharoni, and Noam Slonim. 2015. Show Me Your Evidence - an Automatic Method for Context Dependent Evidence Detection. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Lisbon, Portugal, 440--450.
[67]
Salvador Rizzo. 2020. Analysis | Anatomy of a Trump rally: 67 percent of claims are false or lacking evidence. (Jan 2020). https://www.washingtonpost.com/politics/2020/01/07/anatomy-trump-rally-percent-claims-are-false-or-lacking-evidence/
[68]
Oscar Rosello, Marc Exposito, and Pattie Maes. 2016. NeverMind: using augmented reality for memorization. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 215--216.
[69]
Nancy L Rosenblum and Russell Muirhead. 2020. A lot of people are saying: the new conspiracism and the assault on democracy. Princeton University Press.
[70]
Ishan Sahu. 2016. A study on detecting fact vs non-fact in news articles. Ph.D. Dissertation. Indian Statistical Institute, Kolkata.
[71]
John R Searle and John Rogers Searle. 1969. Speech acts: An essay in the philosophy of language. Vol. 626. Cambridge university press.
[72]
Upendra Shardanand and Pattie Maes. 1995. Social information filtering: algorithms for automating" word of mouth". In Chi, Vol. 95. Citeseer, 210--217.
[73]
Herbert A Simon. 1956. Rational choice and the structure of the environment. Psychological review 63, 2 (1956), 129.
[74]
Herbert Alexander Simon. 1997. Models of bounded rationality: Empirically grounded economic reason. Vol. 3. MIT press.
[75]
Steven A Sloman. 1996. The empirical case for two systems of reasoning. Psychological bulletin 119, 1 (1996), 3.
[76]
Noam Slonim. 2018. Project Debater. In COMMA. 4.
[77]
Kacper Sokol and Peter Flach. 2020. One Explanation Does Not Fit All. KI-Künstliche Intelligenz (2020), 1--16.
[78]
Keith E Stanovich. 2009. What intelligence tests miss: The psychology of rational thought. Yale University Press.
[79]
Keith E Stanovich and Richard F West. 2008. On the failure of cognitive ability to predict myside and one-sided thinking biases. Thinking& Reasoning14, 2 (2008), 129--167.
[80]
Keith E Stanovich, Richard F West, and Maggie E Toplak. 2016. The rationality quotient: Toward a test of rational thinking. MIT press.
[81]
Thad E Starner. 2002. Attention, memory, and wearable interfaces. IEEE pervasive computing 1, 4 (2002), 88--91.
[82]
Oren M Tepper, Hayeem L Rudy, Aaron Lefkowitz, Katie A Weimer, Shelby M Marks, Carrie S Stern, and Evan S Garfein. 2017. Mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room. Plastic and reconstructive surgery 140, 5 (2017), 1066--1070.
[83]
Jacob Thebault-Spieker, Loren Terveen, and Brent Hecht. 2017. Toward a geographic understanding of the sharing economy: Systemic biases in UberX and TaskRabbit. ACM Transactions on Computer-Human Interaction (TOCHI) 24, 3 (2017), 21.
[84]
Ottokar Tilk and Tanel Alumäe. 2016. Bidirectional Recurrent Neural Network with Attention Mechanism for Punctuation Restoration. In Interspeech 2016.
[85]
Dietrich Trautmann, Johannes Daxenberger, Christian Stab, Hinrich Schütze, and Iryna Gurevych. 2019. Robust Argument Unit Recognition and Classification. arXiv preprint arXiv:1904.09688 (2019).
[86]
Davide Valeriani, Caterina Cinel, and Riccardo Poli. 2019. Hybrid Collaborative Brain-Computer Interfaces to Augment Group Decision-Making. In Neuroergonomics. Elsevier, 187--190.
[87]
Jay J Van Bavel and Andrea Pereira. 2018. The partisan brain: An Identity-based model of political belief. Trends in cognitive sciences 22, 3 (2018), 213--224.
[88]
Randall VanderMey. 2012. Comp 2. Wadsworth.
[89]
Tomás Alfonso Vega Gálvez. 2019. uJawstures: Jaw-teeth microgestures for discreet hands-and-eyes-free mobile device interaction. Ph.D. Dissertation. Massachusetts Institute of Technology.
[90]
Sunil Vemuri, Chris Schmandt, and Walter Bender. 2006. iRemember: a personal, long-term memory prosthesis. In Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences. ACM, 65--74.
[91]
Rayoung Yang and Mark W Newman. 2013. Learning from a learning thermostat: lessons for intelligent systems for the home. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, 93--102.

Cited By

View all

Index Terms

  1. Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      AHs '20: Proceedings of the Augmented Humans International Conference
      March 2020
      296 pages
      ISBN:9781450376037
      DOI:10.1145/3384657
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 06 June 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Argumentation Mining
      2. Assisted Reasoning
      3. Augmented Humans
      4. Cognitive Enhancement
      5. Decision Making
      6. Explainable Artificial Intelligence
      7. Human-Machine Symbiosis
      8. Informal Logic
      9. Judgment
      10. Wearable Computing

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      AHs '20
      AHs '20: Augmented Humans International Conference
      March 16 - 17, 2020
      Kaiserslautern, Germany

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)451
      • Downloads (Last 6 weeks)49
      Reflects downloads up to 25 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media