Explainability in Mechanism Design: Recent Advances and the Road Ahead

Sharadhi Alape Suryanarayana; David Sarne; Sarit Kraus

doi:10.1007/978-3-031-20614-6_21

Explainability in Mechanism Design: Recent Advances and the Road Ahead

Sharadhi Alape Suryanarayana
, David Sarne
, Sarit Kraus

Department of Computer Science

University of Oulu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as machine learning and deep learning has occupied most of the limelight, systems that attempt to explain decisions (even simple ones) in the context of social choice are steadily catching up. In this paper, we provide a comprehensive survey of explainability in mechanism design, a domain characterized by economically motivated agents and often having no single choice that maximizes all individual utility functions. We discuss the main properties and goals of explainability in mechanism design, distinguishing them from those of Explainable AI in general. This discussion is followed by a thorough review of the challenges one may face when working on Explainable Mechanism Design and propose a few solution concepts to those.

Original language	English
Title of host publication	Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings
Editors	Dorothea Baumeister, Jörg Rothe
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	364-382
Number of pages	19
ISBN (Print)	9783031206139
DOIs	https://doi.org/10.1007/978-3-031-20614-6_21
State	Published - 2022
Event	19th European Conference on Multi-Agent Systems, EUMAS 2022 - Düsseldorf, Germany Duration: 14 Sep 2022 → 16 Sep 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13442 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th European Conference on Multi-Agent Systems, EUMAS 2022
Country/Territory	Germany
City	Düsseldorf
Period	14/09/22 → 16/09/22

Bibliographical note

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Funding

Acknowledgements. This work was supported in part by the Data Science Institute at Bar-Ilan University, the EU Project TAILOR under grant 952215 and the Israeli Ministry of Science & Technology under grant 89583. The research was carried out with the technological support and funding from the HRI Consortium – the Israel Innovation Authority. Sharadhi Alape Suryanarayana is grateful for the President’s Scholarship and Erasmus+ Global Mobility Programme that has supported this research.

Funders	Funder number
Data Science Institute at Bar-Ilan University
HRI Consortium – the Israel Innovation Authority
European Commission	952215
Ministry of science and technology, Israel	89583

Keywords

Explainability
Justification
Mechanism design

Access to Document

10.1007/978-3-031-20614-6_21

Cite this

Suryanarayana, S. A., Sarne, D., & Kraus, S. (2022). Explainability in Mechanism Design: Recent Advances and the Road Ahead. In D. Baumeister, & J. Rothe (Eds.), Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings (pp. 364-382). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13442 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-20614-6_21

Suryanarayana, Sharadhi Alape ; Sarne, David ; Kraus, Sarit. / Explainability in Mechanism Design : Recent Advances and the Road Ahead. Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings. editor / Dorothea Baumeister ; Jörg Rothe. Springer Science and Business Media Deutschland GmbH, 2022. pp. 364-382 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{be771fa8a19642f09e4c9eca64709d15,

title = "Explainability in Mechanism Design: Recent Advances and the Road Ahead",

abstract = "Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as machine learning and deep learning has occupied most of the limelight, systems that attempt to explain decisions (even simple ones) in the context of social choice are steadily catching up. In this paper, we provide a comprehensive survey of explainability in mechanism design, a domain characterized by economically motivated agents and often having no single choice that maximizes all individual utility functions. We discuss the main properties and goals of explainability in mechanism design, distinguishing them from those of Explainable AI in general. This discussion is followed by a thorough review of the challenges one may face when working on Explainable Mechanism Design and propose a few solution concepts to those.",

keywords = "Explainability, Justification, Mechanism design",

author = "Suryanarayana, \{Sharadhi Alape\} and David Sarne and Sarit Kraus",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 19th European Conference on Multi-Agent Systems, EUMAS 2022 ; Conference date: 14-09-2022 Through 16-09-2022",

year = "2022",

doi = "10.1007/978-3-031-20614-6\_21",

language = "אנגלית",

isbn = "9783031206139",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "364--382",

editor = "Dorothea Baumeister and J{\"o}rg Rothe",

booktitle = "Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings",

address = "גרמניה",

}

Suryanarayana, SA, Sarne, D & Kraus, S 2022, Explainability in Mechanism Design: Recent Advances and the Road Ahead. in D Baumeister & J Rothe (eds), Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13442 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 364-382, 19th European Conference on Multi-Agent Systems, EUMAS 2022, Düsseldorf, Germany, 14/09/22. https://doi.org/10.1007/978-3-031-20614-6_21

Explainability in Mechanism Design: Recent Advances and the Road Ahead. / Suryanarayana, Sharadhi Alape; Sarne, David ; Kraus, Sarit.
Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings. ed. / Dorothea Baumeister; Jörg Rothe. Springer Science and Business Media Deutschland GmbH, 2022. p. 364-382 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13442 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Explainability in Mechanism Design

T2 - 19th European Conference on Multi-Agent Systems, EUMAS 2022

AU - Suryanarayana, Sharadhi Alape

AU - Sarne, David

AU - Kraus, Sarit

PY - 2022

Y1 - 2022

N2 - Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as machine learning and deep learning has occupied most of the limelight, systems that attempt to explain decisions (even simple ones) in the context of social choice are steadily catching up. In this paper, we provide a comprehensive survey of explainability in mechanism design, a domain characterized by economically motivated agents and often having no single choice that maximizes all individual utility functions. We discuss the main properties and goals of explainability in mechanism design, distinguishing them from those of Explainable AI in general. This discussion is followed by a thorough review of the challenges one may face when working on Explainable Mechanism Design and propose a few solution concepts to those.

AB - Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as machine learning and deep learning has occupied most of the limelight, systems that attempt to explain decisions (even simple ones) in the context of social choice are steadily catching up. In this paper, we provide a comprehensive survey of explainability in mechanism design, a domain characterized by economically motivated agents and often having no single choice that maximizes all individual utility functions. We discuss the main properties and goals of explainability in mechanism design, distinguishing them from those of Explainable AI in general. This discussion is followed by a thorough review of the challenges one may face when working on Explainable Mechanism Design and propose a few solution concepts to those.

KW - Explainability

KW - Justification

KW - Mechanism design

UR - https://www.scopus.com/pages/publications/85145250506

U2 - 10.1007/978-3-031-20614-6_21

DO - 10.1007/978-3-031-20614-6_21

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85145250506

SN - 9783031206139

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 364

EP - 382

BT - Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings

A2 - Baumeister, Dorothea

A2 - Rothe, Jörg

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 14 September 2022 through 16 September 2022

ER -

Suryanarayana SA, Sarne D , Kraus S. Explainability in Mechanism Design: Recent Advances and the Road Ahead. In Baumeister D, Rothe J, editors, Multi-Agent Systems - 19th European Conference, EUMAS 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 364-382. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-20614-6_21