東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

The Role of the Cerebellum in Reinfo...

Sendhilnathan, Naveen.

FindBook

Google Book

Amazon

博客來

The Role of the Cerebellum in Reinforcement Learning.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	The Role of the Cerebellum in Reinforcement Learning./
作者:	Sendhilnathan, Naveen.
出版者:	Ann Arbor : ProQuest Dissertations & Theses, : 2021,
面頁冊數:	219 p.
附註:	Source: Dissertations Abstracts International, Volume: 83-02, Section: B.
Contained By:	Dissertations Abstracts International83-02B.
標題:	Neurosciences. -
電子資源:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28646878
ISBN:	9798535510552

The Role of the Cerebellum in Reinforcement Learning.
Sendhilnathan, Naveen.

The Role of the Cerebellum in Reinforcement Learning. - Ann Arbor : ProQuest Dissertations & Theses, 2021 - 219 p.

Source: Dissertations Abstracts International, Volume: 83-02, Section: B.

Thesis (Ph.D.)--Columbia University, 2021.

This item must not be sold to any third party vendors.

How do we learn to establish associations between arbitrary visual cues (like a red light) and movements (like braking the car)? We investigated the neural correlates of visuomotor association learning in the mid-lateral cerebellum. Although cerebellum has been considered to be a motor control center involved in monitoring and correcting the motor error through supervised learning, in this thesis, we show that its role can also be extended to non-motor learning. Specifically, when primates learned to associate arbitrary visual cues with well-learned stereotypic movements, the simple spikes of the mid-lateral cerebellar Purkinje cells reported the monkey's most recent decision's outcome during learning. The magnitude of this reinforcement error signal changed with learning, finally disappearing when the association had been overlearned. We modeled this change in neural activity through a drift diffusion-reinforcement learning based model. The concurrent complex spikes, contrary to traditional theories, did not play the role of teaching signal, but encoded the probability of error as a function of the state of learning. They also encoded features that indicate the beginning of a trial. Inactivating the mid-lateral cerebellum significantly affected the monkey's learning performance while it did not affect motor performance. This is because the mid-lateral cerebellum is in a loop with other cognitive processing centers of the brain including the prefrontal cortex and the basal ganglia. Finally, we verified that the features we identified in primate experiments can also be extended to humans, by studying the visuomotor association learning in humans through functional magnetic resonance imaging. In summary, through electrophysiological and causal experiments in monkeys, imaging in humans, computational models and an anatomical framework, we delineate mechanisms through which the cerebellum can be involved in reinforcement learning and specifically, learning new visuomotor associations.

ISBN: 9798535510552Subjects--Topical Terms:

588700
Neurosciences.
Subjects--Index Terms:

Cerebellum

The Role of the Cerebellum in Reinforcement Learning.
LDR:03174nmm a2200397 4500 001 2285376
005 20211129133352.5
008 220723s2021 ||||||||||||||||| ||eng d
020 $a 9798535510552
035 $a (MiAaPQ)AAI28646878
035 $a AAI28646878
040 $a MiAaPQ $c MiAaPQ
100 1 $a Sendhilnathan, Naveen. $3 3564690
245 1 4 $a The Role of the Cerebellum in Reinforcement Learning.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2021
300 $a 219 p.
500 $a Source: Dissertations Abstracts International, Volume: 83-02, Section: B.
500 $a Advisor: Goldberg, Michael E.
502 $a Thesis (Ph.D.)--Columbia University, 2021.
506 $a This item must not be sold to any third party vendors.
520 $a How do we learn to establish associations between arbitrary visual cues (like a red light) and movements (like braking the car)? We investigated the neural correlates of visuomotor association learning in the mid-lateral cerebellum. Although cerebellum has been considered to be a motor control center involved in monitoring and correcting the motor error through supervised learning, in this thesis, we show that its role can also be extended to non-motor learning. Specifically, when primates learned to associate arbitrary visual cues with well-learned stereotypic movements, the simple spikes of the mid-lateral cerebellar Purkinje cells reported the monkey's most recent decision's outcome during learning. The magnitude of this reinforcement error signal changed with learning, finally disappearing when the association had been overlearned. We modeled this change in neural activity through a drift diffusion-reinforcement learning based model. The concurrent complex spikes, contrary to traditional theories, did not play the role of teaching signal, but encoded the probability of error as a function of the state of learning. They also encoded features that indicate the beginning of a trial. Inactivating the mid-lateral cerebellum significantly affected the monkey's learning performance while it did not affect motor performance. This is because the mid-lateral cerebellum is in a loop with other cognitive processing centers of the brain including the prefrontal cortex and the basal ganglia. Finally, we verified that the features we identified in primate experiments can also be extended to humans, by studying the visuomotor association learning in humans through functional magnetic resonance imaging. In summary, through electrophysiological and causal experiments in monkeys, imaging in humans, computational models and an anatomical framework, we delineate mechanisms through which the cerebellum can be involved in reinforcement learning and specifically, learning new visuomotor associations.
590 $a School code: 0054.
650 4 $a Neurosciences. $3 588700
650 4 $a Behavioral psychology. $3 2122788
650 4 $a Physiological psychology. $3 2144820
650 4 $a Cognitive psychology. $3 523881
650 4 $a Gait. $3 1362772
650 4 $a Kinematics. $3 571109
650 4 $a Eye movements. $3 3564691
650 4 $a Neurons. $3 588699
650 4 $a Memory. $3 522110
650 4 $a Hypotheses. $3 3560118
650 4 $a Experiments. $3 525909
650 4 $a Adaptation. $3 3562958
650 4 $a Reptiles & amphibians. $3 3560366
650 4 $a Climbing. $3 3564692
650 4 $a Spinal cord. $3 895443
650 4 $a Feedback. $3 677181
650 4 $a Animal cognition. $3 3563972
653 $a Cerebellum
653 $a Cognition
653 $a Motor
653 $a Primate
653 $a Reinforcement learning
653 $a Reward
690 $a 0317
690 $a 0633
690 $a 0989
690 $a 0384
710 2 $a Columbia University. $b Neurobiology and Behavior. $3 3173198
773 0 $t Dissertations Abstracts International $g 83-02B.
790 $a 0054
791 $a Ph.D.
792 $a 2021
793 $a English
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28646878