東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

Investigating the Jusifiability of a...

Wang, Huan.

FindBook

Google Book

Amazon

博客來

Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.

紀錄類型:	書目-語言資料,印刷品 : Monograph/item
正題名/作者:	Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test./
作者:	Wang, Huan.
面頁冊數:	160 p.
附註:	Source: Dissertation Abstracts International, Volume: 72-03, Section: A, page: .
Contained By:	Dissertation Abstracts International72-03A.
標題:	Education, Tests and Measurements. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3441468
ISBN:	9781124450087

Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.
Wang, Huan.

Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test. - 160 p.

Source: Dissertation Abstracts International, Volume: 72-03, Section: A, page: .

Thesis (Ph.D.)--University of California, Los Angeles, 2010.

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for purposes for which it was not intended or developed. Current frameworks for assessment design and assessment use justification, such as the Messickian conceptualization of a unified validity, an interpretive argument, and the Evidence-Centered Design, provide insight into such issues, but have varying degrees of limitation in guiding the description and evaluation of multiple uses of a given assessment and in relating these uses to assessment design and administration. The present study aims to assist test developers of a college-level English as a Foreign Language (EFL) proficiency test in identifying the most critical area(s) in the current test design and administration for supporting an added use of the testing program. To achieve this goal, the study compared the original and added assessment uses and linked the observed differences to desired modified or additional conditions for justifying the added use. The comparison and linking were guided by the assessment use argument (AUA) framework with expansion proposed by the researcher. Based on the comparison and linking results, five key modified warrants were identified for supporting the added use. Among them, the warrant of the equitability of decisions was identified as the potentially most questionable one. The warrant was elaborated into six sub-warrants, and the backing for each sub-warrant was related to the test design and administration. Two pieces of the backing were then chosen for further investigation. Specifically, information was collected to address issues on the construct of the paper test and the inter-rater inconsistency of the oral test. To facilitate the investigation, structural equation modeling and generalizahility studies were conducted, as well as other procedures including two-group dependent t-tests and Spearman rank-order correlation studies. Based on the study results, it was concluded that the most critical area in the current test design and administration for supporting the added use is likely to he the observed substantial measurement errors of the paper test due to construct-irrelevant factors. Accordingly, test developers are recommended to focus most on identifying construct-irrelevant factors measured in the paper test and addressing them accordingly. Implications and limitations of the study were also discussed.

ISBN: 9781124450087Subjects--Topical Terms:

1017589
Education, Tests and Measurements.

Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.
LDR:03677nam 2200289 4500 001 1399745
005 20110926095515.5
008 130515s2010 ||||||||||||||||| ||eng d
020 $a 9781124450087
035 $a (UMI)AAI3441468
035 $a AAI3441468
040 $a UMI $c UMI
100 1 $a Wang, Huan. $3 1678751
245 1 0 $a Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.
300 $a 160 p.
500 $a Source: Dissertation Abstracts International, Volume: 72-03, Section: A, page: .
500 $a Adviser: Lyle F. Bachman.
502 $a Thesis (Ph.D.)--University of California, Los Angeles, 2010.
520 $a Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for purposes for which it was not intended or developed. Current frameworks for assessment design and assessment use justification, such as the Messickian conceptualization of a unified validity, an interpretive argument, and the Evidence-Centered Design, provide insight into such issues, but have varying degrees of limitation in guiding the description and evaluation of multiple uses of a given assessment and in relating these uses to assessment design and administration. The present study aims to assist test developers of a college-level English as a Foreign Language (EFL) proficiency test in identifying the most critical area(s) in the current test design and administration for supporting an added use of the testing program. To achieve this goal, the study compared the original and added assessment uses and linked the observed differences to desired modified or additional conditions for justifying the added use. The comparison and linking were guided by the assessment use argument (AUA) framework with expansion proposed by the researcher. Based on the comparison and linking results, five key modified warrants were identified for supporting the added use. Among them, the warrant of the equitability of decisions was identified as the potentially most questionable one. The warrant was elaborated into six sub-warrants, and the backing for each sub-warrant was related to the test design and administration. Two pieces of the backing were then chosen for further investigation. Specifically, information was collected to address issues on the construct of the paper test and the inter-rater inconsistency of the oral test. To facilitate the investigation, structural equation modeling and generalizahility studies were conducted, as well as other procedures including two-group dependent t-tests and Spearman rank-order correlation studies. Based on the study results, it was concluded that the most critical area in the current test design and administration for supporting the added use is likely to he the observed substantial measurement errors of the paper test due to construct-irrelevant factors. Accordingly, test developers are recommended to focus most on identifying construct-irrelevant factors measured in the paper test and addressing them accordingly. Implications and limitations of the study were also discussed.
590 $a School code: 0031.
650 4 $a Education, Tests and Measurements. $3 1017589
650 4 $a Language, Linguistics. $3 1018079
650 4 $a Education, English as a Second Language. $3 1030294
690 $a 0288
690 $a 0290
690 $a 0441
710 2 $a University of California, Los Angeles. $3 626622
773 0 $t Dissertation Abstracts International $g 72-03A.
790 1 0 $a Bachman, Lyle F., $e advisor
790 $a 0031
791 $a Ph.D.
792 $a 2010
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3441468