東華大學圖書館 |

Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications./
作者:	Islam, Rifatul.
出版者:	Ann Arbor : ProQuest Dissertations & Theses, : 2022,
面頁冊數:	148 p.
附註:	Source: Dissertations Abstracts International, Volume: 83-11, Section: B.
Contained By:	Dissertations Abstracts International83-11B.
標題:	Computer science. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29170746
ISBN:	9798438751083

Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications.
Islam, Rifatul.

Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications. - Ann Arbor : ProQuest Dissertations & Theses, 2022 - 148 p.

Source: Dissertations Abstracts International, Volume: 83-11, Section: B.

Thesis (Ph.D.)--The University of Texas at San Antonio, 2022.

This item must not be sold to any third party vendors.

Virtual reality (VR) has gained immense popularity in recent years with the rapid development of head-mounted displays (HMDs). The use of VR applications in entertainment, education, training, rehabilitation, and low-cost HMDs, created a widespread userbase for VR. However, VR experience often creates motion-sickness-like discomforts, commonly known as Cybersickness which can cause general discomfort, headache, nausea, fatigue, etc. Commonly, researchers use pre and post-immersive subjective questionnaires (e.g., simulator-sickness questionnaire) to measure the severity of Cybersickness, which does not provide a sufficient granular understanding of the severity during immersion. Recent research has reported that Cybersickness affects a user's physiological signals such as heart rate, breathing rate, galvanic skin response, eye blinking rate, delta, and beta power of electroencephalogram - brain signals. These feedback data are highly correlated with Cybersickness reported by prior research, which can be utilized to predict the onset of Cybersickness during VR immersion. In this dissertation, I have developed several novel approaches for automatic cybersickness detection, prediction, and reduction. In my first research, I collected the user's physiological feedback such as heart rate, breathing rate, galvanic skin responses during a roller-coaster VR immersion from 23 participants. I used a convolutional long-short-term memory-based neural network to detect cybersickness severity with an accuracy of 97.4%.Furthermore, I also presented how to predict the onset of Cybersickness two minutes earlier using physiological data with an accuracy of 87.38%. However, this work heavily relies on external physiological sensors such as heart rate and galvanic skin response sensors, which are often difficult to integrate as standalone systems. Therefore, it was not suitable for consumer VR use. To address this problem, I conducted further user studies with 30 individuals. I developed a multimodal deep-fusion network to predict the onset of Cybersickness using only eye-tracking and head-tracking data with an accuracy of 87.7%, which is more effective as it does not rely on any external sensors for cybersickness prediction. Later, I developed a closed-loop framework that utilized the prior cybersickness severity prediction approaches and based on the predicted cybersickness severity. It applies different cybersickness reduction strategies in real-time. However, prior research reported that once cybersickness onsets have started, it is likely to persist. Therefore, applying reduction techniques once the onset has begun might not be effective (i.e., real-time cybersickness detection). Forecasting (i.e., early prediction) of cybersickness severity could facilitate sufficient time to apply cybersickness reduction techniques, potentially reducing the severity before the discomforts occur. Therefore, I evaluated several state-of-the-art forecasting models such as Attention-based LSTM, Neural basis expansion analysis for interpretable time series(NBEATs), deep temporal convolutional neural network (DeepTCN) to forecast (i.e., 30, 60, 90, 120, and 150 seconds prior) the onset of Cybersickness. The results suggested that the multimodal DeepTCN model can forecast the onset of Cybersickness 90 seconds earlier than the actual Cybersickness occurs, with a root-mean-square error value of 0.54 (on a scale from 0-10). The results also suggested that fusing eye-tracking, heart-rate, and galvanic skin response data outperformed the other data fusion approaches. This investigation provides insight into utilizing deep neural networks to automatically forecast and detect cybersickness severity during VR immersion and adaptively apply cybersickness reduction techniques. Furthermore, this research can be used as a guideline to develop automated cybersickness reduction toolkits for VR applications.

ISBN: 9798438751083Subjects--Topical Terms:

523869
Computer science.
Subjects--Index Terms:

Automated cybersickness detection

Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications.
LDR:05157nmm a2200385 4500 001 2352248
005 20221118093855.5
008 241004s2022 ||||||||||||||||| ||eng d
020 $a 9798438751083
035 $a (MiAaPQ)AAI29170746
035 $a AAI29170746
040 $a MiAaPQ $c MiAaPQ
100 1 $a Islam, Rifatul. $0 (orcid)0000-0002-4305-9964 $3 3691868
245 1 0 $a Towards Automatic Cybersickness Detection, Early-Prediction, and Reductions for Virtual Reality Applications.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2022
300 $a 148 p.
500 $a Source: Dissertations Abstracts International, Volume: 83-11, Section: B.
500 $a Advisor: Quarles, John.
502 $a Thesis (Ph.D.)--The University of Texas at San Antonio, 2022.
506 $a This item must not be sold to any third party vendors.
520 $a Virtual reality (VR) has gained immense popularity in recent years with the rapid development of head-mounted displays (HMDs). The use of VR applications in entertainment, education, training, rehabilitation, and low-cost HMDs, created a widespread userbase for VR. However, VR experience often creates motion-sickness-like discomforts, commonly known as Cybersickness which can cause general discomfort, headache, nausea, fatigue, etc. Commonly, researchers use pre and post-immersive subjective questionnaires (e.g., simulator-sickness questionnaire) to measure the severity of Cybersickness, which does not provide a sufficient granular understanding of the severity during immersion. Recent research has reported that Cybersickness affects a user's physiological signals such as heart rate, breathing rate, galvanic skin response, eye blinking rate, delta, and beta power of electroencephalogram - brain signals. These feedback data are highly correlated with Cybersickness reported by prior research, which can be utilized to predict the onset of Cybersickness during VR immersion. In this dissertation, I have developed several novel approaches for automatic cybersickness detection, prediction, and reduction. In my first research, I collected the user's physiological feedback such as heart rate, breathing rate, galvanic skin responses during a roller-coaster VR immersion from 23 participants. I used a convolutional long-short-term memory-based neural network to detect cybersickness severity with an accuracy of 97.4%.Furthermore, I also presented how to predict the onset of Cybersickness two minutes earlier using physiological data with an accuracy of 87.38%. However, this work heavily relies on external physiological sensors such as heart rate and galvanic skin response sensors, which are often difficult to integrate as standalone systems. Therefore, it was not suitable for consumer VR use. To address this problem, I conducted further user studies with 30 individuals. I developed a multimodal deep-fusion network to predict the onset of Cybersickness using only eye-tracking and head-tracking data with an accuracy of 87.7%, which is more effective as it does not rely on any external sensors for cybersickness prediction. Later, I developed a closed-loop framework that utilized the prior cybersickness severity prediction approaches and based on the predicted cybersickness severity. It applies different cybersickness reduction strategies in real-time. However, prior research reported that once cybersickness onsets have started, it is likely to persist. Therefore, applying reduction techniques once the onset has begun might not be effective (i.e., real-time cybersickness detection). Forecasting (i.e., early prediction) of cybersickness severity could facilitate sufficient time to apply cybersickness reduction techniques, potentially reducing the severity before the discomforts occur. Therefore, I evaluated several state-of-the-art forecasting models such as Attention-based LSTM, Neural basis expansion analysis for interpretable time series(NBEATs), deep temporal convolutional neural network (DeepTCN) to forecast (i.e., 30, 60, 90, 120, and 150 seconds prior) the onset of Cybersickness. The results suggested that the multimodal DeepTCN model can forecast the onset of Cybersickness 90 seconds earlier than the actual Cybersickness occurs, with a root-mean-square error value of 0.54 (on a scale from 0-10). The results also suggested that fusing eye-tracking, heart-rate, and galvanic skin response data outperformed the other data fusion approaches. This investigation provides insight into utilizing deep neural networks to automatically forecast and detect cybersickness severity during VR immersion and adaptively apply cybersickness reduction techniques. Furthermore, this research can be used as a guideline to develop automated cybersickness reduction toolkits for VR applications.
590 $a School code: 1283.
650 4 $a Computer science. $3 523869
650 4 $a Computer engineering. $3 621879
650 4 $a Pathology. $3 643180
650 4 $a Bioinformatics. $3 553671
650 4 $a Information technology. $3 532993
650 4 $a Information science. $3 554358
653 $a Automated cybersickness detection
653 $a Virtual reality sickness
653 $a VR sickness
690 $a 0984
690 $a 0489
690 $a 0464
690 $a 0723
690 $a 0715
690 $a 0571
710 2 $a The University of Texas at San Antonio. $b Computer Science. $3 1065531
773 0 $t Dissertations Abstracts International $g 83-11B.
790 $a 1283
791 $a Ph.D.
792 $a 2022
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29170746