Abstract
Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and analyze the behavior of this agent, we designed and released our own reinforcement learning agent environment, “the Room”, where an agent has to learn how to encode, store, and retrieve memories to maximize its return by answering questions. We show that our deep Q-learning based agent successfully learns whether a short-term memory should be forgotten, or rather be stored in the episodic or semantic memory systems. Our experiments indicate that an agent with human-like memory systems can outperform an agent without this memory structure in the environment.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 37th AAAI Conference on Artificial Intelligence |
| Subtitle of host publication | AAAI-23 Technical Tracks 1 |
| Editors | Brian Williams, Yiling Chen, Jennifer Neville |
| Publisher | AAAI Press |
| Pages | 48-56 |
| Number of pages | 9 |
| ISBN (Electronic) | 9781577358800 |
| DOIs | |
| Publication status | Published - 2023 |
| Event | 37th AAAI Conference on Artificial Intelligence, AAAI 2023 - Washington, United States Duration: 7 Feb 2023 → 14 Feb 2023 |
Publication series
| Name | Proceedings of the ... AAAI Conference on Artificial Intelligence |
|---|---|
| Number | 1 |
| Volume | 37 |
| ISSN (Print) | 2159-5399 |
| ISSN (Electronic) | 2374-3468 |
Conference
| Conference | 37th AAAI Conference on Artificial Intelligence, AAAI 2023 |
|---|---|
| Country/Territory | United States |
| City | Washington |
| Period | 7/02/23 → 14/02/23 |
Bibliographical note
Host title: Thirty-Seventh AAAI Conference on Artificial IntelligenceThirty-Fifth Conference on Innovative Applications of Artificial Intelligence
Thirteenth Symposium on Educational Advances in Artificial Intelligence
Edited by Brian Williams, Yiling Chen, Jennifer Neville
Sponsored by the Association for the Advancement of Artificial Intelligence
February 7–14, 2023, Washington DC, USA.
ISBN 978-1-57735-880-0 (Online, 13 issue set).
Funding Information:
This research was (partially) funded by the Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organization for Scientific Research, https:// www.hybrid-intelligence-centre.nl/.
Funding Information:
This research was (partially) funded by the Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organization for Scientific Research, https://www.hybrid-intelligence-centre.nl/.
Publisher Copyright:
Copyright © 2023, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
Funding
This research was (partially) funded by the Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organization for Scientific Research, https:// www.hybrid-intelligence-centre.nl/. This research was (partially) funded by the Hybrid Intelligence Center, a 10-year program funded by the Dutch Ministry of Education, Culture and Science through the Netherlands Organization for Scientific Research, https://www.hybrid-intelligence-centre.nl/.