東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

FindBook

Google Book

Amazon

博客來

Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making./
作者:	Beron, Celia Claire.
面頁冊數:	1 online resource (157 pages)
附註:	Source: Dissertations Abstracts International, Volume: 84-12, Section: B.
Contained By:	Dissertations Abstracts International84-12B.
標題:	Neurosciences. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30486734click for full text (PQDT)
ISBN:	9798379614430

Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making.
Beron, Celia Claire.

Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making. - 1 online resource (157 pages)

Source: Dissertations Abstracts International, Volume: 84-12, Section: B.

Thesis (Ph.D.)--Harvard University, 2023.

Includes bibliographical references

Adaptive behavior requires animals to flexibly switch between actions to obtain reward. It is unknown how the brain mediates transitions when the relative value between actions is unclear. To study these processes, we examined decision-making strategies employed by mice in a probabilistic two-armed bandit task (2ABT). We found that switching behavior in this task is modulated by previous action and outcome history, producing two distinct behavioral regimes. In one, given certain trial histories, mice nearly deterministically repeat their previous actions. In contrast, following other experiences, mice appear to choose actions randomly. We were able to capture the trial history dependence of switching behavior through several mathematically equivalent models, namely a recursively formulated logistic regression, an action-value reinforcement learning algorithm, and sticky Bayesian inference. Each model required a combined representation of action-outcome history, a perseverative bias, and a stochastic action policy.Using externally observable variables alone, it was necessary that our behavior models capture the probabilistic nature of switching to recapitulate the structure of mouse trial-to-trial decision making. However, we examined whether accessing neural activity would reveal internally determined signatures of switching embedded in the action selection circuitry. We collected fiber photometry recordings of dopamine release into ventrolateral striatum (VLS) in a head-fixed 2ABT in which mice lick both to express decisions and evaluate outcomes. We have previously shown that lick direction and lick action outcome (i.e., the presence or absence of water) are dependent on and encoded in neural activity in VLS. We found evidence that dopamine activity in VLS is modulated by the same set of features necessary to model the behavioral strategy, producing responses to reward outcome consistent with reward prediction error (RPE) theory from reinforcement learning. Other components of VLS dopamine activity produce patterns that are distinct from RPE-encoding and are perhaps better aligned with features such as motivation or salience. Finally, we fail to connect modulation of VLS dopamine activity with future switching behavior through simple linear discrimination, despite the prior evidence that its encoding profile contains features behaviorally predictive of switching, suggesting an anatomical separation between evaluation and action selection.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2023

Mode of access: World Wide Web

ISBN: 9798379614430Subjects--Topical Terms:

588700
Neurosciences.
Subjects--Index Terms:

Basal gangliaIndex Terms--Genre/Form:

542853
Electronic books.

Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making.
LDR:03907nmm a2200409K 4500 001 2363018
005 20231109104734.5
006 m o d
007 cr mn ---uuuuu
008 241011s2023 xx obm 000 0 eng d
020 $a 9798379614430
035 $a (MiAaPQ)AAI30486734
035 $a AAI30486734
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Beron, Celia Claire. $3 3703764
245 1 0 $a Relationship of Striatal Dopamine to Reward History and Action During Probabilistic Decision Making.
264 0 $c 2023
300 $a 1 online resource (157 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 84-12, Section: B.
500 $a Advisor: Sabatini, Bernardo.
502 $a Thesis (Ph.D.)--Harvard University, 2023.
504 $a Includes bibliographical references
520 $a Adaptive behavior requires animals to flexibly switch between actions to obtain reward. It is unknown how the brain mediates transitions when the relative value between actions is unclear. To study these processes, we examined decision-making strategies employed by mice in a probabilistic two-armed bandit task (2ABT). We found that switching behavior in this task is modulated by previous action and outcome history, producing two distinct behavioral regimes. In one, given certain trial histories, mice nearly deterministically repeat their previous actions. In contrast, following other experiences, mice appear to choose actions randomly. We were able to capture the trial history dependence of switching behavior through several mathematically equivalent models, namely a recursively formulated logistic regression, an action-value reinforcement learning algorithm, and sticky Bayesian inference. Each model required a combined representation of action-outcome history, a perseverative bias, and a stochastic action policy.Using externally observable variables alone, it was necessary that our behavior models capture the probabilistic nature of switching to recapitulate the structure of mouse trial-to-trial decision making. However, we examined whether accessing neural activity would reveal internally determined signatures of switching embedded in the action selection circuitry. We collected fiber photometry recordings of dopamine release into ventrolateral striatum (VLS) in a head-fixed 2ABT in which mice lick both to express decisions and evaluate outcomes. We have previously shown that lick direction and lick action outcome (i.e., the presence or absence of water) are dependent on and encoded in neural activity in VLS. We found evidence that dopamine activity in VLS is modulated by the same set of features necessary to model the behavioral strategy, producing responses to reward outcome consistent with reward prediction error (RPE) theory from reinforcement learning. Other components of VLS dopamine activity produce patterns that are distinct from RPE-encoding and are perhaps better aligned with features such as motivation or salience. Finally, we fail to connect modulation of VLS dopamine activity with future switching behavior through simple linear discrimination, despite the prior evidence that its encoding profile contains features behaviorally predictive of switching, suggesting an anatomical separation between evaluation and action selection.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2023
538 $a Mode of access: World Wide Web
650 4 $a Neurosciences. $3 588700
650 4 $a Behavioral sciences. $3 529833
650 4 $a Physiological psychology. $3 2144820
653 $a Basal ganglia
653 $a Decision making
653 $a Dopamine
653 $a Flexible behavior
653 $a Reinforcement learning
653 $a Stochasticity
655 7 $a Electronic books. $2 lcsh $3 542853
690 $a 0317
690 $a 0602
690 $a 0989
710 2 $a ProQuest Information and Learning Co. $3 783688
710 2 $a Harvard University. $b Medical Sciences. $3 3181716
773 0 $t Dissertations Abstracts International $g 84-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30486734 $z click for full text (PQDT)