Open Access
Brain Informatics, volume 9, issue 1, publication number 8
Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments
Publication type: Journal Article
Publication date: 2022-04-02
Journal:
Brain Informatics
Quartile SCImago
Q1
Quartile WOS
—
Impact factor: —
ISSN: 21984018, 21984026
PubMed ID:
35366128
Computer Science Applications
Neurology
Cognitive Neuroscience
Abstract
Biologically plausible models of learning may provide a crucial insight for building autonomous intelligent agents capable of performing a wide range of tasks. In this work, we propose a hierarchical model of an agent operating in an unfamiliar environment driven by a reinforcement signal. We use temporal memory to learn sparse distributed representation of state–actions and the basal ganglia model to learn effective action policy on different levels of abstraction. The learned model of the environment is utilized to generate an intrinsic motivation signal, which drives the agent in the absence of the extrinsic signal, and through acting in imagination, which we call dreaming. We demonstrate that the proposed architecture enables an agent to effectively reach goals in grid environments.
Citations by journals
|
1
|
|
|
Procedia Computer Science
|
Procedia Computer Science
1 publication, 16.67%
|
|
Sensors
|
Sensors
1 publication, 16.67%
|
|
Neural Networks
|
Neural Networks
1 publication, 16.67%
|
|
Pattern Recognition and Image Analysis
|
Pattern Recognition and Image Analysis
1 publication, 16.67%
|
|
Optical Memory and Neural Networks (Information Optics)
|
Optical Memory and Neural Networks (Information Optics)
1 publication, 16.67%
|
|
Lecture Notes in Computer Science
|
Lecture Notes in Computer Science
1 publication, 16.67%
|
|
1
|
Citations by publishers
|
1
2
|
|
|
Elsevier
|
Elsevier
2 publications, 33.33%
|
|
Pleiades Publishing
|
Pleiades Publishing
2 publications, 33.33%
|
|
Multidisciplinary Digital Publishing Institute (MDPI)
|
Multidisciplinary Digital Publishing Institute (MDPI)
1 publication, 16.67%
|
|
Springer Nature
|
Springer Nature
1 publication, 16.67%
|
|
1
2
|
- We do not take into account publications that without a DOI.
- Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
- Statistics recalculated weekly.
{"yearsCitations":{"type":"bar","data":{"show":true,"labels":[2022,2023],"ids":[0,0],"codes":[0,0],"imageUrls":["",""],"datasets":[{"label":"Citations number","data":[1,5],"backgroundColor":["#3B82F6","#3B82F6"],"percentage":["16.67","83.33"],"barThickness":null}]},"options":{"indexAxis":"x","maintainAspectRatio":true,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":1,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Citations per year","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"journals":{"type":"bar","data":{"show":true,"labels":["Procedia Computer Science","Sensors","Neural Networks","Pattern Recognition and Image Analysis","Optical Memory and Neural Networks (Information Optics)","Lecture Notes in Computer Science"],"ids":[14281,18435,14360,9753,2179,1022],"codes":[0,0,0,0,0,0],"imageUrls":["\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/oZgeErrVFhuDksyqFURLvYS1wtVSBWczh001igGo_medium.webp","\/storage\/images\/resized\/oZgeErrVFhuDksyqFURLvYS1wtVSBWczh001igGo_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp"],"datasets":[{"label":"","data":[1,1,1,1,1,1],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[16.67,16.67,16.67,16.67,16.67,16.67],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Journals","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"publishers":{"type":"bar","data":{"show":true,"labels":["Elsevier","Pleiades Publishing","Multidisciplinary Digital Publishing Institute (MDPI)","Springer Nature"],"ids":[17,101,202,8],"codes":[0,0,0,0],"imageUrls":["\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/oZgeErrVFhuDksyqFURLvYS1wtVSBWczh001igGo_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp"],"datasets":[{"label":"","data":[2,2,1,1],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[33.33,33.33,16.67,16.67],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Publishers","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}}}
Metrics
Cite this
GOST |
RIS |
BibTex
Cite this
GOST
Copy
Dzhivelikian E. et al. Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments // Brain Informatics. 2022. Vol. 9. No. 1. 8
GOST all authors (up to 50)
Copy
Dzhivelikian E., Latyshev A., Kuderov P., Panov A. I. Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments // Brain Informatics. 2022. Vol. 9. No. 1. 8
Cite this
RIS
Copy
TY - JOUR
DO - 10.1186/s40708-022-00156-6
UR - https://doi.org/10.1186%2Fs40708-022-00156-6
TI - Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments
T2 - Brain Informatics
AU - Kuderov, Petr
AU - Panov, Aleksandr I
AU - Dzhivelikian, Evgenii
AU - Latyshev, Artem
PY - 2022
DA - 2022/04/02 00:00:00
PB - Springer Nature
IS - 1
VL - 9
PMID - 35366128
SN - 2198-4018
SN - 2198-4026
ER -
Cite this
BibTex
Copy
@article{2022_Dzhivelikian,
author = {Petr Kuderov and Aleksandr I Panov and Evgenii Dzhivelikian and Artem Latyshev},
title = {Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments},
journal = {Brain Informatics},
year = {2022},
volume = {9},
publisher = {Springer Nature},
month = {apr},
url = {https://doi.org/10.1186%2Fs40708-022-00156-6},
number = {1},
doi = {10.1186/s40708-022-00156-6}
}