東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

FindBook

Google Book

Amazon

博客來

Recognizing and Understanding User Behaviors from Screencasts.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Recognizing and Understanding User Behaviors from Screencasts./
作者:	Zhao, Dehai.
面頁冊數:	1 online resource (122 pages)
附註:	Source: Dissertations Abstracts International, Volume: 84-08, Section: B.
Contained By:	Dissertations Abstracts International84-08B.
標題:	Language. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30209917click for full text (PQDT)
ISBN:	9798371943408

Recognizing and Understanding User Behaviors from Screencasts.
Zhao, Dehai.

Recognizing and Understanding User Behaviors from Screencasts. - 1 online resource (122 pages)

Source: Dissertations Abstracts International, Volume: 84-08, Section: B.

Thesis (Ph.D.)--The Australian National University (Australia), 2021.

Includes bibliographical references

User interacts with computers or mobile devices, leading to user behaviors on screen. In the context of software engineering, analyzing user behavior enables many applications such as intelligent bug fix, code completion and knowledge recommendation for developers. Such technique can be extended to more general knowledge worker environment, in which users have to manipulate devices according to specific guidelines. Existing works rely heavily on software instrumentation to obtain user actions from operation systems, which is hard to deploy and maintain. In addition, considering the security and privacy of some scenarios, non-intrusive is the major requirement to be included in the system.In this work, we leverage Computer Vision and Natural Language Processing techniques to recognize and understand user behaviors from screencasts, which is a non-intrusive and cross-platform method. We first recognize 10 categories of low level user actions such as mouse moving and type text, then summarize them to higher level abstractions (i.e. line-granularity coding steps). We also try to interpret user interaction with applications by multi-task learning and generate structured language descriptions (i.e. command, widget and location). Finally, unsupervised learning method is introduced for GUI linting problem, which is taken as a case study of user behavior analysis. To train the deep neural networks, we collect diverse video data from YouTube, Twitch and Bugzilla, and manually label them to build the dataset. The experiment results demonstrate the high performance of proposed method, and the user study validate the practical applications of many downstream tasks.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2023

Mode of access: World Wide Web

ISBN: 9798371943408Subjects--Topical Terms:

643551
Language.
Index Terms--Genre/Form:

542853
Electronic books.

Recognizing and Understanding User Behaviors from Screencasts.
LDR:02944nmm a2200349K 4500 001 2358160
005 20230725095006.5
006 m o d
007 cr mn ---uuuuu
008 241011s2021 xx obm 000 0 eng d
020 $a 9798371943408
035 $a (MiAaPQ)AAI30209917
035 $a (MiAaPQ)AustNatlU1885276083
035 $a AAI30209917
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Zhao, Dehai. $3 3698696
245 1 0 $a Recognizing and Understanding User Behaviors from Screencasts.
264 0 $c 2021
300 $a 1 online resource (122 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 84-08, Section: B.
500 $a Advisor: Xing, Zhenchang.
502 $a Thesis (Ph.D.)--The Australian National University (Australia), 2021.
504 $a Includes bibliographical references
520 $a User interacts with computers or mobile devices, leading to user behaviors on screen. In the context of software engineering, analyzing user behavior enables many applications such as intelligent bug fix, code completion and knowledge recommendation for developers. Such technique can be extended to more general knowledge worker environment, in which users have to manipulate devices according to specific guidelines. Existing works rely heavily on software instrumentation to obtain user actions from operation systems, which is hard to deploy and maintain. In addition, considering the security and privacy of some scenarios, non-intrusive is the major requirement to be included in the system.In this work, we leverage Computer Vision and Natural Language Processing techniques to recognize and understand user behaviors from screencasts, which is a non-intrusive and cross-platform method. We first recognize 10 categories of low level user actions such as mouse moving and type text, then summarize them to higher level abstractions (i.e. line-granularity coding steps). We also try to interpret user interaction with applications by multi-task learning and generate structured language descriptions (i.e. command, widget and location). Finally, unsupervised learning method is introduced for GUI linting problem, which is taken as a case study of user behavior analysis. To train the deep neural networks, we collect diverse video data from YouTube, Twitch and Bugzilla, and manually label them to build the dataset. The experiment results demonstrate the high performance of proposed method, and the user study validate the practical applications of many downstream tasks.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2023
538 $a Mode of access: World Wide Web
650 4 $a Language. $3 643551
650 4 $a User interface. $3 3681528
650 4 $a Democratization. $3 570502
650 4 $a User behavior. $3 3564661
650 4 $a Design. $3 518875
650 4 $a Human-computer interaction. $3 560071
650 4 $a Animation. $3 2032987
650 4 $a Software engineering. $3 559826
650 4 $a Natural language. $3 3562052
650 4 $a Computer science. $3 523869
655 7 $a Electronic books. $2 lcsh $3 542853
690 $a 0389
690 $a 0679
690 $a 0984
710 2 $a ProQuest Information and Learning Co. $3 783688
710 2 $a The Australian National University (Australia). $3 1952885
773 0 $t Dissertations Abstracts International $g 84-08B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30209917 $z click for full text (PQDT)