Known Unknowns: Learning Novel Concepts Using Reasoning-by-Elimination

Harsh Agrawal, Eli A. Meirom, Yuval Atzmon, Shie Mannor, Gal Chechik

Research output: Contribution to conferencePaperpeer-review

1 Scopus citations

Abstract

People can learn new visual concepts without any samples, from information given by language or by deductive reasoning. For instance, people can use elimination to infer the meaning of novel labels from their context. While recognizing novel concepts was intensively studied in zero-shot learning with semantic descriptions, training models to learn by elimination is much less studied. Here we describe the first approach to train an agent to reason-by-elimination, by providing instructions that contain both familiar concepts and unfamiliar ones (“pick the red box and the green wambim”). In our framework, the agent combines a perception module with a reasoning module that includes internal memory. It uses reinforcement learning to construct a reasoning policy that, by considering all available items in a room, can make a correct inference even for never-seen objects or concepts. Furthermore, it can then perform one-shot learning and use newly learned concepts for inferring additional novel concepts. We evaluate this approach in a new set of environments, showing that agents successfully learn to reason by elimination, and can also learn novel concepts and use them for further reasoning. This approach paves the way to handle open-world environments by extending the abundant supervised learning approaches with reasoning frameworks that can handle novel concepts.

Original languageEnglish
Pages504-514
Number of pages11
StatePublished - 2021
Externally publishedYes
Event37th Conference on Uncertainty in Artificial Intelligence, UAI 2021 - Virtual, Online
Duration: 27 Jul 202130 Jul 2021

Conference

Conference37th Conference on Uncertainty in Artificial Intelligence, UAI 2021
CityVirtual, Online
Period27/07/2130/07/21

Bibliographical note

Publisher Copyright:
© 2021 37th Conference on Uncertainty in Artificial Intelligence, UAI 2021. All Rights Reserved.

Fingerprint

Dive into the research topics of 'Known Unknowns: Learning Novel Concepts Using Reasoning-by-Elimination'. Together they form a unique fingerprint.

Cite this