research-article

Open access

Towards a Computational Architecture for Co-Constructive Explainable Systems

Authors:

Meisam Booshehri,

Hendrik Buschmeier,

Philipp Cimiano,

Jaroslaw Kornowicz,

Olesja Lammert,

Marco Matarese,

Dimitry Mindlin,

Amelie Sophie Robrecht,

Anna-Lisa Vollmer,

Britta WredeAuthors Info & Claims

ExEn '24: Proceedings of the 2024 Workshop on Explainability Engineering

Pages 20 - 25

https://doi.org/10.1145/3648505.3648509

Published: 25 July 2024 Publication History

Abstract

In this paper we consider the interactive processes by which an explainer and an explainee cooperate to produce an explanation, which we refer to as co-construction. Explainable Artificial Intelligence (XAI) is concerned with the development of intelligent systems and robots that can explain and justify their actions, decisions, recommendations, and so on. However, the cooperative construction of explanations remains a key but under-explored issue. This short paper proposes an architecture for intelligent systems that promotes a co-constructive and interactive approach to explanation generation. By outlining its basic components and their specific roles, we aim to contribute to the advancement of XAI computational frameworks that actively engage users in the explanation process.

References

[1]

Sule Anjomshoae, Amro Najjar, Davide Calvaresi, and Kary Främling. 2019. Explainable agents and robots: Results from a systematic literature review. In Proceedings of the 18th International Conference on Autonomous Agents and Multi-Agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, Montreal, Canada, 1078--1088.

[2]

Agnes Axelsson, Hendrik Buschmeier, and Gabriel Skantze. 2022. Modelling feedback in interaction with conversational agents -- A review. Frontiers in Computer Science 4 (2022), 744574.

[3]

Agnes Axelsson and Gabriel Skantze. 2023. Do you follow?: A fully automated system for adaptive robot presenters. In Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. Association for Computing Machinery, Stockholm Sweden, 102--111.

Digital Library

[4]

Mathias Blumreiter, Joel Greenyer, Francisco Javier Chiyah Garcia, Verena Klös, Maike Schwammberger, Christoph Sommer, Andreas Vogelsang, and Andreas Wortmann. 2019. Towards self-explainable cyber-physical systems. In 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C). IEEE, Munich, Germany, 543--548.

Digital Library

[5]

Sarah Brown-Schmidt, Si On Yoon, and Rachel Anna Ryskin. 2015. People as contexts in conversation. In Psychology of Learning and Motivation, Brian H. Ross (Ed.). Vol. 62. Academic Press, New York, NY, USA, 59--99.

[6]

Jane Cleland-Huang, Theodore Chambers, Sebastian Zudaire, Muhammed Tawfiq Chowdhury, Ankit Agrawal, and Michael Vierhauser. 2023. Human-machine teaming with small unmanned aerial systems in a MAPE-K environment. ACM Transactions on Autonomous and Adaptive Systems (2023), 34 pages.

Digital Library

[7]

Judith Degen. 2023. The Rational Speech Act framework. Annual Review of Linguistics 9 (2023), 519--540.

[8]

Mark Dingemanse and Nick J. Enfield. 2023. Interactive repair and the foundations of language. Trends in Cognitive Sciences 28 (2023), 30--42.

[9]

Goerschwin Fey, Martin Fränzle, and Rolf Drechsler. 2022. Self-explanation in systems of systems. In 2022 IEEE 30th International Requirements Engineering Conference Workshops (REW). IEEE, Melbourne, Australia, 85--91.

[10]

Michael C. Frank and Noah D. Goodman. 2012. Predicting pragmatic reasoning in language games. Science 336 (2012), 998.

[11]

Ilias Gerostathopoulos and Evangelos Pournaras. 2019. TRAPPed in Traffic? A Self-Adaptive Framework for Decentralized Traffic Optimization. In 2019 IEEE/ACM 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). IEEE, Montreal, Canada, 32--38.

Digital Library

[12]

IBM. 2006. An Architectural Blueprint for Autonomic Computing. Technical Report. IBM.

[13]

Sally Jacoby and Elinor Ochs. 1995. Co-construction: An introduction. Research on Language and Social Interaction 28, 3 (1995), 171--183.

[14]

Pooyan Jamshidi, Javier Cámara, Bradley Schmerl, Christian Käestner, and David Garlan. 2019. Machine learning meets quantitative planning: Enabling self-adaptation in autonomous robots. In 2019 IEEE/ACM 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). IEEE, Montreal, Canada, 39--50.

Digital Library

[15]

J.O. Kephart and D.M. Chess. 2003. The vision of autonomic computing. Computer 36 (2003), 41--50.

Digital Library

[16]

Bertram F. Malle. 2006. How The Mind Explains Behavior: Folk Explanations, Meaning, and Social Interaction. MIT Press, Cambridge, MA, USA.

[17]

Judith Michael, Maike Schwammberger, and Andreas Wortmann. 2024. Explaining cyberphysical system behavior with digital twins. IEEE Software 41 (2024), 55--63.

Digital Library

[18]

Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences.

[19]

Jiyoung Oh, Claudia Raibulet, and Joran Leest. 2022. Analysis of MAPE-K loop in self-adaptive systems for cloud, IoT and CPS. In International Conference on Service-Oriented Computing. Springer, Sevilla, Spain, 130--141.

Digital Library

[20]

Karola Pitsch, Anna-Lisa Vollmer, Katharina J Rohlfing, Jannik Fritsch, and Britta Wrede. 2014. Tutoring in adult-child interaction: On the loop of the tutor's action modification and the recipient's gaze. Interaction Studies 15 (2014), 55--98.

[21]

Amelie Sophie Robrecht and Stefan Kopp. 2023. SNAPE: A sequential non-stationary decision process model for adaptive explanation generation. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART. SciTePress, Lisbon, Portugal, 48--58.

[22]

Katharina Rohlfing, Philipp Cimiano, Ingrid Scharlau, Tobias Matzner, Heike Buhl, Hendrik Buschmeier, Angela Grimminger, Barbara Hammer, Reinhold Häb-Umbach, Ilona Horwath, Eyke Hüllermeier, Friederike Kern, Stefan Kopp, Kirsten Thommes, Axel-Cyrille Ngonga Ngomo, Carsten Schulte, Henning Wachsmuth, Petra Wagner, and Britta Wrede. 2021. Explanation as a social practice: Toward a conceptual framework for the social design of AI systems. IEEE Transactions on Cognitive and Developmental Systems 13 (2021), 717--728.

[23]

Ben R Slugoski, Mansur Lalljee, Roger Lamb, and Gerald P Ginsburg. 1993. Attribution in conversational context: Effect of mutual knowledge on explanation-giving. European Journal of Social Psychology 23 (1993), 219--238.

[24]

Beate Sodian. 2011. Theory of Mind in infancy. Child Development Perspectives 5 (2011), 39--43.

[25]

Kacper Sokol and Peter Flach. 2020. One explanation does not fit all: The promise of interactive explanations for machine learning transparency. KI-Künstliche Intelligenz 34 (2020), 235--250.

[26]

Sarath Sreedharan, Tathagata Chakraborti, and Subbarao Kambhampati. 2021. Foundations of explanations as model reconciliation. Artificial Intelligence 301 (2021), 103558.

[27]

Stephanie Stacy, Siyi Gong, Aishni Parab, Minglu Zhao, Kaiwen Jiang, and Tao Gao. 2023. A Bayesian theory of mind approach to modeling cooperation and communication. WIREs Computational Statistics 16 (2023), e1631.

Digital Library

[28]

Marc Swerts, Emiel Krahmer, Pashiera Barkhuysen, and Lennard van de Laar. 2003. Audiovisual cues to uncertainty. In Proceedings of the ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems. ISCA, Château d'Oex, Vaud, Switzerland, 25--30.

[29]

Sam Thellman and Tom Ziemke. 2021. The perceptual belief problem: Why explainability is a tough challenge in social robotics. Journal of Human-Robot Interaction 10 (2021), 15 pages.

Digital Library

[30]

Alexander Todorov, Mansur Lalljee, and William Hirst. 2000. Communication context, explanation, and social judgment. European Journal of Social Psychology 30 (2000), 199--209. <199::AID-EJSP984>3.0.CO;2-L

[31]

Anna-Lisa Vollmer, Daniel Leidner, Michael Beetz, and Britta Wrede. 2023. From interactive to co-constructive task learning. In Proceedings of the ICRA 2023 Workshop on Life-Long Learning with Human Help (L3H2). arXiv, London, UK, 7 pages.

[32]

James V Wertsch. 1984. The zone of proximal development: Some conceptual issues. New Directions for Child Development 23 (1984), 7--18.

[33]

Danny Weyns. 2019. Software Engineering of Self-adaptive Systems. In Handbook of Software Engineering, Sungdeok Cha, Richard N. Taylor, and Kyochul Kang (Eds.). Springer, Cham, Switzerland, 399--443.

Cited By

Belosevic MBuschmeier H(2024)Quote to Explain: Using Multimodal Metalinguistic Markers to Explain Large Language Models' Understanding CapabilitiesCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3689203(225-227)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3689203
Alpsancar SBuhl HMatzner TScharlau I(2024)Explanation needs and ethical demands: unpacking the instrumental value of XAIAI and Ethics10.1007/s43681-024-00622-3Online publication date: 3-Dec-2024
https://doi.org/10.1007/s43681-024-00622-3

Recommendations

Explainable artificial intelligence, lawyer's perspective
ICAIL '21: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law

Explainable artificial intelligence (XAI) is a research direction that was already put under scrutiny, in particular in the AI&Law community. Whilst there were notable developments in the area of (general, not necessarily legal) XAI, user experience ...
Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence
Abstract
Artificial intelligence (AI) is currently being utilized in a wide range of sophisticated applications, but the outcomes of many AI models are challenging to comprehend and trust due to their black-box nature. Usually, it is essential to ...
Highlights
- A novel four-axis framework to examine a model for robustness and explainability.
- Formulation of research questions at each axis and its corresponding taxonomy.
- Discussion of different explainability assessment methods.
- A novel ...
Explainable artificial intelligence: A survey of needs, techniques, applications, and future direction
Abstract
Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses these ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ExEn '24: Proceedings of the 2024 Workshop on Explainability Engineering

April 2024

30 pages

ISBN:9798400705960

DOI:10.1145/3648505

Conference Chairs:
Jakob Droste
Leibniz University Hannover, Hannover, Germany
,
Verena Klös
TU Dresden, Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany
,
Maike Schwammberger
Karlsruhe Institute of Technology, Karlsruhe, Germany
,
Timo Speith
University of Bayreuth, Bayreuth, Germany

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

In-Cooperation

Faculty of Engineering of University of Porto

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2024

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft (DFG)

Conference

ExEn '24

Sponsor:

SIGSOFT

ExEn '24: 2024 Workshop on Explainability Engineering

April 20, 2024

Lisbon, Portugal

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
146
Total Downloads

Downloads (Last 12 months)146
Downloads (Last 6 weeks)28

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Belosevic MBuschmeier H(2024)Quote to Explain: Using Multimodal Metalinguistic Markers to Explain Large Language Models' Understanding CapabilitiesCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3689203(225-227)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3689203
Alpsancar SBuhl HMatzner TScharlau I(2024)Explanation needs and ethical demands: unpacking the instrumental value of XAIAI and Ethics10.1007/s43681-024-00622-3Online publication date: 3-Dec-2024
https://doi.org/10.1007/s43681-024-00622-3

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents