Abstract
The cerebellum is an integral part of the human brain and understanding its role in learning might present an opportunity for reciprocal enrichment of the fields of artificial intelligence and neuroscience. In this paper, we present a novel idea that the cerebellum's role goes beyond functioning as a supervised learning machine to performing model-based reinforcement learning. We revisit the current theories about the cerebellum's role in human learning processes and propose a novel way of evaluating it in the context of the simulated cerebellum. Based on the recent experimental findings, we propose that the cerebellum performs modelbased reinforcement learning and we propose a way to evaluate the hypothesis using a simulated cerebellum. Finally, we discuss the necessary conditions to evaluate the hypothesis and the potential implications for future research of the hypothesis holds.
Original language | English |
---|---|
State | Published - 2021 |
Externally published | Yes |
Event | Adaptive and Learning Agents Workshop, ALA 2021 at AAMAS 2021 - Virtual, Online, United Kingdom Duration: 3 May 2021 → 4 May 2021 |
Conference
Conference | Adaptive and Learning Agents Workshop, ALA 2021 at AAMAS 2021 |
---|---|
Country/Territory | United Kingdom |
City | Virtual, Online |
Period | 3/05/21 → 4/05/21 |
Bibliographical note
Publisher Copyright:© 2021 Association for Computing Machinery.
Funding
This work has taken place in the Learning Agents Research Group (LARG) at UT Austin. LARG research is supported in part by NSF (CPS-1739964, IIS-1724157, NRI-1925082), ONR (N00014-18-2243), FLI (RFP2-000), ARO (W911NF-19-2-0333), DARPA, Lockheed Martin, GM, and Bosch. Peter Stone serves as the Executive Director of Sony AI America and receives financial compensation for this work. The terms of this arrangement have been reviewed and approved by the University of Texas at Austin in accordance with its policy on objectivity in research.
Funders | Funder number |
---|---|
National Science Foundation | IIS-1724157, NRI-1925082, CPS-1739964 |
Office of Naval Research | N00014-18-2243 |
Army Research Office | W911NF-19-2-0333 |
Defense Advanced Research Projects Agency | |
University of Texas at Austin | |
Robert Bosch (Australia) Pty | |
Future of Life Institute | RFP2-000 |
Keywords
- Cerebellum
- Forward models
- Neuroscience
- Reinforcement learning
- Reward function