Cited By
View all- Bex F(2024)AI, Law and beyond. A transdisciplinary ecosystem for the future of AI & LawArtificial Intelligence and Law10.1007/s10506-024-09404-yOnline publication date: 16-May-2024
Do agents dream of abiding by the rules?: Learning norms via behavioral exploration and sparse human supervision
Authors: 
Peter Fratrič, Mostafa Mohajeri Parizi, Giovanni Sileno, Tom van Engers, Sander KlousAuthors Info & Claims
Peter Fratrič, Mostafa Mohajeri Parizi, Giovanni Sileno, Tom van Engers, Sander KlousAuthors Info & ClaimsAbstract
In recent years, several normative systems have been presented in the literature. Relying on formal methods, these systems support the encoding of legal rules into machine-readable formats, enabling, e.g. to check whether a certain workflow satisfies or agents abide by these rules. However, not all rules can be easily expressed (see for instance the unclear boundaries between tax planning and tax avoidance). The paper introduces a framework for norm identification and norm induction that automates the formalization of norms about non-compliant behavior by exploring the behavioral space via simulation, and integrating inputs from humans via active learning. The proposed problem formulation sets also a bridge between AI & law and more general branches of AI concerned by the adaptation of artificial agents to human directives.
References
[1]
David W Aha. 1991. Case-based learning algorithms. In Proceedings of the 1991 DARPA case-based reasoning workshop, Vol. 1. 147--158.
[2]
Robert Amor and Johannes Dimyadi. 2021. The promise of automated compliance checking. Developments in the built environment 5 (2021), 100039.
[3]
Kevin D. Ashley. 1992. Case-Based Reasoning and its Implications for Legal Expert Systems. Artificial Intelligence and Law 1, 2-3 (1992), 113--208.
[4]
Massimo Bartoletti, Salvatore Carta, Tiziana Cimoli, and Roberto Saia. 2020. Dissecting Ponzi schemes on Ethereum: identification, analysis, and impact. Future Generation Computer Systems 102 (2020), 259--277.
[5]
Michaela Beals, Marguerite DeLiema, and Martha Deevy. 2015. Framework for a taxonomy of fraud. Financial Fraud Research Center (2015).
[6]
Rafael C Cardoso, Brian Logan, Felipe Meneguzzi, Nir Oren, and Bruno Yun. 2022. Resilience, reliability, and coordination in autonomous multi-agent systems. AI Communications Preprint (2022), 1--18.
[7]
Domenico Corapi, Alessandra Russo, Marina De Vos, Julian Padget, and Ken Satoh. 2011. Normative design using inductive learning. Theory and Practice of Logic Programming 11, 4-5 (2011), 783--799.
[8]
Stephen Cranefield and Ashish Dhiman. 2021. Identifying Norms from Observation Using MCMC Sampling. In IJCAI. 118--124.
[9]
Stephen Cranefield, Felipe Meneguzzi, Nir Oren, and Bastin Tony Roy Savarimuthu. 2016. A Bayesian approach to norm identification. ECAI 2016 (2016).
[10]
Stephen Cranefield and Bastin Tony Roy Savarimuthu. 2021. Normative Multi-Agent Systems and Human-Robot Interaction. In Workshop on Robot Behavior Adaptation to Human Social Norms (TSAR).
[11]
Marina De Vos, Sabrina Kirrane, Julian Padget, and Ken Satoh. 2019. ODRL policy modelling and compliance checking. In International Joint Conference on Rules and Reasoning. Springer, 36--51.
[12]
Peter Fratrič, Giovanni Sileno, Tom van Engers, and Sander Klous. 2022. Computational Discovery of Transaction-Based Financial Crime via Grammatical Evolution: The Case of Ponzi Schemes. In Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XV: International Workshop, COINE 2022, Virtual Event, May 9, 2022, Revised Selected Papers. Springer, 109--120.
[13]
Javier Garcia-Bernardo, Jan Fichtner, Frank W Takes, and Eelke M Heemskerk. 2017. Uncovering offshore financial centers: Conduits and sinks in the global corporate ownership network. Scientific reports 7, 1 (2017), 1--10.
[14]
Mustafa Hashmi, Guido Governatori, Ho Pun Lam, and Moe Thandar Wynn. 2018. Are we done with business process compliance: state of the art and challenges ahead. Knowledge and Information Systems 57 (10 2018), 79--133. Issue 1. https://doi.org/10.1007/s10115-017-1142-1
[15]
Erik Hemberg, Jacob Rosen, Geoff Warner, Sanith Wijesinghe, and Una-May O'Reilly. 2016. Detecting tax evasion: a co-evolutionary approach. Artificial Intelligence and Law 24 (2016), 149--182.
[16]
Yu-Chi Ho and Xi-Ren Cao. 1991. Perturbation Analysis of Discrete Event Dynamic Systems. Springer US. https://doi.org/10.1007/978-1-4615-4024-3
[17]
Chris Jones, Yama Temouri, and Alex Cobham. 2018. Tax haven networks and the role of the Big 4 accountancy firms. Journal of World Business 53, 2 (2018), 177--193. https://doi.org/10.1016/j.jwb.2017.10.004
[18]
Robert Kowalski and Akber Datoo. 2021. Logical English meets legal English for swaps and derivatives. Artificial Intelligence and Law (2021), 1--35.
[19]
Naeimeh Laleh and Mohammad Abdollahi Azgomi. 2009. A taxonomy of frauds and fraud detection techniques. In Information Systems, Technology and Management: Third International Conference, ICISTM 2009, Ghaziabad, India, March 12-13, 2009. Proceedings 3. Springer, 256--267.
[20]
Dewei Li and Yingjie Tian. 2018. Survey and experimental study on metric learning methods. Neural Networks 105 (9 2018), 447--462. https://doi.org/10.1016/j.neunet.2018.06.003
[21]
Siqi Liu, Guy Lever, Zhe Wang, Josh Merel, SM Ali Eslami, Daniel Hennes, Wojciech M Czarnecki, Yuval Tassa, Shayegan Omidshafiei, Abbas Abdolmaleki, et al. 2022. From motor control to team play in simulated humanoid football. Science Robotics 7, 69 (2022), eabo0235.
[22]
Bertram F Malle, Eric Rosen, Vivienne B Chi, Matthew Berg, and Peter Haas. 2020. A general methodology for teaching norms to social robots. In 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 1395--1402.
[23]
Paulus Merks. 2006. Tax Evasion, Tax Avoidance and Tax Planning. Intertax (2006), 272--281.
[24]
Kevin Miller, Jack Mauro, Jason Setiadi, Xoaquin Baca, Zhan Shi, Jeff Calder, and Andrea L Bertozzi. 2022. Graph-based active learning for semi-supervised classification of SAR data. In Algorithms for Synthetic Aperture Radar Imagery XXIX, Vol. 12095. SPIE, 126--139.
[25]
Cyril Onwubiko. 2020. Fraud matrix: A morphological and analysis-based classification and taxonomy of fraud. Computers & Security 96 (2020), 101900.
[26]
Monica Palmirani, Guido Governatori, Antonino Rotolo, Said Tabet, Harold Boley, and Adrian Paschke. 2011. LegalRuleML: XML-Based Rules and Norms. In Rule-Based Modeling and Computing on the Semantic Web. Springer Berlin Heidelberg, Berlin, Heidelberg, 298--312.
[27]
Edwina L Rissland, Kevin D Ashley, and L Karl Branting. 2005. Case-based reasoning and law. The Knowledge Engineering Review 20, 3 (2005), 293--298.
[28]
Vasanth Sarathy, Matthias Scheutz, and Bertram F Malle. 2017. Learning behavioral norms in uncertain and changing contexts. In 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom). IEEE, 000301--000306.
[29]
Bastin Tony Roy Savarimuthu, Stephen Cranefield, Maryam A Purvis, and Martin K Purvis. 2010. Obligation norm identification in agent societies. Journal of Artificial Societies and Social Simulation 13, 4 (2010), 3.
[30]
Burr Settles. 2011. From theories to queries: Active learning in practice. In Active learning and experimental design workshop in conjunction with AISTATS 2010. JMLR Workshop and Conference Proceedings, 1--18.
[31]
Sepehr Sharifi, Alireza Parvizimosaed, Daniel Amyot, Luigi Logrippo, and John Mylopoulos. 2020. Symboleo: Towards a specification language for legal contracts. In 2020 IEEE 28th International Requirements Engineering Conference (RE). IEEE, 364--369.
[32]
Michael Siering, Benjamin Clapham, Oliver Engel, and Peter Gomber. 2017. A taxonomy of financial market manipulations: establishing trust and market integrity in the financialized economy through automated fraud detection. Journal of Information Technology 32, 3 (2017), 251--269.
[33]
Giovanni Sileno, Alexander Boer, and Tom van Engers. 2017. Reading agendas between the lines, an exercise. Artificial Intelligence and Law 25 (2017), 89--106.
[34]
Amarnag Subramanya and Partha Pratim Talukdar. 2014. Graph-Based Semi-Supervised Learning. Springer International Publishing. https://doi.org/10.1007/978-3-031-01571-7
[35]
Zhi-Xuan Tan, Jake Brawer, and Brian Scassellati. 2019. That's mine! learning ownership relations and norms for robots. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 8058--8065.
[36]
L Thomas Van Binsbergen, Lu-Chi Liu, Robert van Doesburg, and Tom van Engers. 2020. eFLINT: a domain-specific language for executable norm specifications. In Proceedings of the 19th ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences. 124--136.
[37]
Jesper E. van Engelen and Holger H. Hoos. 2020. A survey on semi-supervised learning. Machine Learning 109 (2 2020), 373--440. Issue 2. https://doi.org/10.1007/s10994-019-05855-6
[38]
Vladimir N. Vapnik. 2000. The Nature of Statistical Learning Theory. Springer New York. https://doi.org/10.1007/978-1-4757-3264-1
[39]
Christopher JCH Watkins and Peter Dayan. 1992. Q-learning. Machine learning 8 (1992), 279--292.
[40]
Xiaojin Zhu, Zoubin Ghahramani, and John Lafferty. 2003. Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions. In Proceedings of the Twentieth International Conference on International Conference on Machine Learning (Washington, DC, USA) (ICML'03). AAAI Press, 912--919.
Index Terms
- Do agents dream of abiding by the rules?: Learning norms via behavioral exploration and sparse human supervision
Recommendations
Programming norm-aware agents
AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 2Normative organisations provide a means to coordinate the activities of individual agents in multiagent settings. The coordination is realized at run time by creating obligations and prohibitions (norms) for individual agents. If an agent cannot meet an ...
Identifying prohibition norms in agent societies
In normative multi-agent systems, the question of "how an agent identifies norms in an open agent society" has not received much attention. This paper aims at addressing this question. To this end, this paper proposes an architecture for norm ...
Norms of Behaviour and Their Identification and Verification in Open Multi-Agent Societies
Norms have an obvious role in the coordinating and predicting behaviours in societies of software agents. Most researchers assume that agents already know the norms of their societies beforehand at design time. Others assume that norms are assigned by a ...
Comments
Information & Contributors
Information
Published In
June 2023
499 pages
ISBN:9798400701979
DOI:10.1145/3594536
- Conference Chair:
- Francisco Andrade,
- Program Chair:
- Matthias Grabmair
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NoDerivatives International 4.0 License.
Sponsors
- IAAIL: Intl Asso for Artifical Intel & Law
In-Cooperation
- UMinho: University of Minho
- SIGAI: ACM Special Interest Group on Artificial Intelligence
- AAAI: Am Assoc for Artifical Intelligence
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 September 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Dutch Research Council (NWO)
Conference
ICAIL 2023
Sponsor:
- IAAIL
ICAIL 2023: Nineteenth International Conference on Artificial Intelligence and Law
June 19 - 23, 2023
Braga, Portugal
Acceptance Rates
Overall Acceptance Rate 69 of 169 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 208Total Downloads
- Downloads (Last 12 months)162
- Downloads (Last 6 weeks)20
Reflects downloads up to 24 Jan 2025
Other Metrics
Citations
Cited By
View all- Bex F(2024)AI, Law and beyond. A transdisciplinary ecosystem for the future of AI & LawArtificial Intelligence and Law10.1007/s10506-024-09404-yOnline publication date: 16-May-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in