東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Brain, Body, and Behavior in Audiovi...

Sun, Yile.

Linked to FindBook

Google Book

Amazon

博客來

Brain, Body, and Behavior in Audiovisual Interaction.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Brain, Body, and Behavior in Audiovisual Interaction./
Author:	Sun, Yile.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2021,
Description:	132 p.
Notes:	Source: Dissertations Abstracts International, Volume: 82-08, Section: B.
Contained By:	Dissertations Abstracts International82-08B.
Subject:	Psychobiology. -
Online resource:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28157396
ISBN:	9798569985906

Brain, Body, and Behavior in Audiovisual Interaction.
Sun, Yile.

Brain, Body, and Behavior in Audiovisual Interaction. - Ann Arbor : ProQuest Dissertations & Theses, 2021 - 132 p.

Source: Dissertations Abstracts International, Volume: 82-08, Section: B.

Thesis (Ph.D.)--Brandeis University, 2021.

This item must not be sold to any third party vendors.

Our brain has incredible ability to receive sensory information from multiple modalities, integrate it, and use it to construct a best guess about what's going on around us. However, not every integration is beneficial. Discrepancy in the information carried by different senses may offset or cancel the multisensory benefit. I set out to investigate the costs and benefits of audio-visual integration with a video game platform. In the game, the visual signal is the rhythmic size oscillation of the game target whereas the auditory signal is an amplitude modulated sound that accompanies the oscillation in size. In the game, two species of fish were identical in appearance but differed in the rate at which their size fluctuates.The game requires players to discriminate between the two species of fish. The first study manipulated the coherence of temporal dynamics between the visual and auditory signals and examined the role of temporal coherence on multisensory integration. Study 1 showed a performance advantage rather than a cost associated with temporally matched visual and auditory signals. Study 2 Phase One identified the behavioral and EEG signatures of multisensory integration and found low alpha power and high theta power linked to the audio-visual incongruent condition. The changes seen in alpha and theta power reflects how the brain registers a mismatch between auditory and visual signals. In Study 2 Phase Two, game was modified to incorporate a mild stressor caused by increasingly reduced inter-fish interval, with the maximum allowed response time held constant. In addition to compromised task performance, the negative impact of reducing inter-trial interval was indexed by pulse rate and pulse rate variability. The result suggests perception of time pressure adversely affect the efficacy of cognitive decision making and the ability to adapt to changes. In summary, our brain and body are sensitive to pick up the discrepancies in the signals from different sensory channels. There will be a cost of cognitive flexibility with even the idea of time limitation.

ISBN: 9798569985906Subjects--Topical Terms:

555678
Psychobiology.
Subjects--Index Terms:

Brain

Brain, Body, and Behavior in Audiovisual Interaction.
LDR:03177nmm a2200361 4500 001 2281883
005 20210927083420.5
008 220723s2021 ||||||||||||||||| ||eng d
020 $a 9798569985906
035 $a (MiAaPQ)AAI28157396
035 $a AAI28157396
040 $a MiAaPQ $c MiAaPQ
100 1 $a Sun, Yile. $0 (orcid)0000-0002-7568-6057 $3 3560592
245 1 0 $a Brain, Body, and Behavior in Audiovisual Interaction.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2021
300 $a 132 p.
500 $a Source: Dissertations Abstracts International, Volume: 82-08, Section: B.
500 $a Advisor: Sekuler, Robert.
502 $a Thesis (Ph.D.)--Brandeis University, 2021.
506 $a This item must not be sold to any third party vendors.
520 $a Our brain has incredible ability to receive sensory information from multiple modalities, integrate it, and use it to construct a best guess about what's going on around us. However, not every integration is beneficial. Discrepancy in the information carried by different senses may offset or cancel the multisensory benefit. I set out to investigate the costs and benefits of audio-visual integration with a video game platform. In the game, the visual signal is the rhythmic size oscillation of the game target whereas the auditory signal is an amplitude modulated sound that accompanies the oscillation in size. In the game, two species of fish were identical in appearance but differed in the rate at which their size fluctuates.The game requires players to discriminate between the two species of fish. The first study manipulated the coherence of temporal dynamics between the visual and auditory signals and examined the role of temporal coherence on multisensory integration. Study 1 showed a performance advantage rather than a cost associated with temporally matched visual and auditory signals. Study 2 Phase One identified the behavioral and EEG signatures of multisensory integration and found low alpha power and high theta power linked to the audio-visual incongruent condition. The changes seen in alpha and theta power reflects how the brain registers a mismatch between auditory and visual signals. In Study 2 Phase Two, game was modified to incorporate a mild stressor caused by increasingly reduced inter-fish interval, with the maximum allowed response time held constant. In addition to compromised task performance, the negative impact of reducing inter-trial interval was indexed by pulse rate and pulse rate variability. The result suggests perception of time pressure adversely affect the efficacy of cognitive decision making and the ability to adapt to changes. In summary, our brain and body are sensitive to pick up the discrepancies in the signals from different sensory channels. There will be a cost of cognitive flexibility with even the idea of time limitation.
590 $a School code: 0021.
650 4 $a Psychobiology. $3 555678
650 4 $a Neurosciences. $3 588700
650 4 $a Behavioral psychology. $3 2122788
653 $a Brain
653 $a Body
653 $a Behavior
653 $a Audiovisual interaction
690 $a 0349
690 $a 0317
690 $a 0384
710 2 $a Brandeis University. $b Psychology. $3 1033658
773 0 $t Dissertations Abstracts International $g 82-08B.
790 $a 0021
791 $a Ph.D.
792 $a 2021
793 $a English
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28157396