東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Communication beyond words: Multimed...

Ma, Xiaojuan.

Linked to FindBook

Google Book

Amazon

博客來

Communication beyond words: Multimedia approaches to bridging language disabilities and barriers.

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Communication beyond words: Multimedia approaches to bridging language disabilities and barriers./
Author:	Ma, Xiaojuan.
Description:	322 p.
Notes:	Source: Dissertation Abstracts International, Volume: 71-07, Section: B, page: 4350.
Contained By:	Dissertation Abstracts International71-07B.
Subject:	Multimedia Communications. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3414165
ISBN:	9781124070841

Communication beyond words: Multimedia approaches to bridging language disabilities and barriers.
Ma, Xiaojuan.

Communication beyond words: Multimedia approaches to bridging language disabilities and barriers. - 322 p.

Source: Dissertation Abstracts International, Volume: 71-07, Section: B, page: 4350.

Thesis (Ph.D.)--Princeton University, 2010.

Human communication takes place in both spoken and written modes, as in face-to-face conversations, books reading, television watching and Internet browsing. However, for people with language disabilities (e.g. aphasia), people with low literacy, and people with poor command of a language, receiving and expressing information via a language is difficult. Because of the inability to comprehend words and/or to find words that express intended concepts, people with language barriers may encounter great challenges performing everyday tasks such as ordering food and visiting a doctor. As an alternative to words, pictures and sounds have been designed, tested, and used to evoke concepts in computer-based interfaces, education, industry, and advertisement. However, icons created by artists, user-uploaded photos, auditory icons and earcons cannot always satisfy the need for communicating everyday concepts for people with language barriers. Furthermore, the iconic vocabularies in current communication support systems have ambiguous representations and difficult to use vocabulary organization.

ISBN: 9781124070841Subjects--Topical Terms:

1057801
Multimedia Communications.

Communication beyond words: Multimedia approaches to bridging language disabilities and barriers.
LDR:04415nam 2200313 4500 001 1399865
005 20110930095853.5
008 130515s2010 ||||||||||||||||| ||eng d
020 $a 9781124070841
035 $a (UMI)AAI3414165
035 $a AAI3414165
040 $a UMI $c UMI
100 1 $a Ma, Xiaojuan. $3 1678877
245 1 0 $a Communication beyond words: Multimedia approaches to bridging language disabilities and barriers.
300 $a 322 p.
500 $a Source: Dissertation Abstracts International, Volume: 71-07, Section: B, page: 4350.
500 $a Adviser: Perry R. Cook.
502 $a Thesis (Ph.D.)--Princeton University, 2010.
520 $a Human communication takes place in both spoken and written modes, as in face-to-face conversations, books reading, television watching and Internet browsing. However, for people with language disabilities (e.g. aphasia), people with low literacy, and people with poor command of a language, receiving and expressing information via a language is difficult. Because of the inability to comprehend words and/or to find words that express intended concepts, people with language barriers may encounter great challenges performing everyday tasks such as ordering food and visiting a doctor. As an alternative to words, pictures and sounds have been designed, tested, and used to evoke concepts in computer-based interfaces, education, industry, and advertisement. However, icons created by artists, user-uploaded photos, auditory icons and earcons cannot always satisfy the need for communicating everyday concepts for people with language barriers. Furthermore, the iconic vocabularies in current communication support systems have ambiguous representations and difficult to use vocabulary organization.
520 $a My thesis research addresses issues in the above paragraph and explores building multimedia support for information delivery. The work is unique in that it provides different channels (visual and auditory) to support nonverbal communication, and that it has a disambiguated sense-level network structure with semantic links between related concepts. The development of such a multimedia-enhanced lexical database is challenging, due to the lack of guidance in the creation and evaluation of multimodal representations. To construct the lexical database, I went through a cycle of design, construction, evaluation, and modification for each media modality-to-concept association. I have introduced novel representations that are under investigated (e.g. videos and environmental sounds). I have explored difference sources of multimedia data (designed by specialists, designed by general users, and web resources not tailored for communication purposes). I have experimented with new methodologies for generating and evaluating multimedia-concept associations. I have also come up with essential guidelines for better multimedia vocabulary design.
520 $a A communication support system, the Online Multimedia Language Assistant (OMLA), which employs various multimedia forms, including web images, icons, animations, videos, and environmental sounds, was built on top of my research on multimedia representations with the goal of assisting comprehension of common concepts across language barriers. OMLA is implemented as a popup dictionary in the form of a web browser extension. Users can select an unfamiliar word on a webpage to view its associated visual/auditory representation in a popup box. The Language Assistant can enhance concept understanding as people browse information on the Internet, and support face-to-face communication when people want to illustrate a term via a picture, a video or a sound.
520 $a Through a series of studies, I verified that web images are as effective as stylized icons in conveying nouns, that videos outperformed other stimuli in illustrating verbs, and that nonspeech sounds are better in distinguishing many concepts like thunder, alarms, and sneezing. The Multimedia Augmented Online Language Assistant was shown to enhance information comprehension, and I am exploring its application in real life scenarios such as medical care.
590 $a School code: 0181.
650 4 $a Multimedia Communications. $3 1057801
650 4 $a Computer Science. $3 626642
690 $a 0558
690 $a 0984
710 2 $a Princeton University. $3 645579
773 0 $t Dissertation Abstracts International $g 71-07B.
790 1 0 $a Cook, Perry R., $e advisor
790 $a 0181
791 $a Ph.D.
792 $a 2010
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3414165