Summarizing agent strategies

Ofra Amir, Finale Doshi-Velez, David Sarne

Research output: Contribution to journalArticlepeer-review

39 Scopus citations

Abstract

Intelligent agents and AI-based systems are becoming increasingly prevalent. They support people in different ways, such as providing users with advice, working with them to achieve goals or acting on users’ behalf. One key capability missing in such systems is the ability to present their users with an effective summary of their strategy and expected behaviors under different conditions and scenarios. This capability, which we see as complementary to those currently under development in the context of “interpretable machine learning” and “explainable AI”, is critical in various settings. In particular, it is likely to play a key role when a user needs to collaborate with an agent, when having to choose between different available agents to act on her behalf, or when requested to determine the level of autonomy to be granted to an agent or approve its strategy. In this paper, we pose the challenge of developing capabilities for strategy summarization, which is not addressed by current theories and methods in the field. We propose a conceptual framework for strategy summarization, which we envision as a collaborative process that involves both agents and people. Last, we suggest possible testbeds that could be used to evaluate progress in research on strategy summarization.

Original languageEnglish
Pages (from-to)628-644
Number of pages17
JournalAutonomous Agents and Multi-Agent Systems
Volume33
Issue number5
DOIs
StatePublished - 1 Sep 2019

Bibliographical note

Publisher Copyright:
© 2019, Springer Science+Business Media, LLC, part of Springer Nature.

Funding

The research was partially supported by a J.P. Morgan faculty research award and by the Israel Science Foundation (Grant No. 1162/17).

FundersFunder number
Israel Science Foundation1162/17

    Keywords

    • Explainable AI
    • Human–agent interaction
    • Strategy summarization

    Fingerprint

    Dive into the research topics of 'Summarizing agent strategies'. Together they form a unique fingerprint.

    Cite this