東華大學圖書館 |

語系: 繁體中文

說明(常見問題)

回圖書館首頁

手機版館藏查詢

登入

回首頁

切換: 標籤 | MARC模式 | ISBD

Rater expertise in a second language...

Davis, Lawrence Edward.

FindBook

Google Book

Amazon

博客來

Rater expertise in a second language speaking assessment: The influence of training and experience.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Rater expertise in a second language speaking assessment: The influence of training and experience./
作者:	Davis, Lawrence Edward.
面頁冊數:	279 p.
附註:	Source: Dissertation Abstracts International, Volume: 74-08(E), Section: A.
Contained By:	Dissertation Abstracts International74-08A(E).
標題:	Educational tests & measurements. -
電子資源:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3569056
ISBN:	9781303035203

Rater expertise in a second language speaking assessment: The influence of training and experience.
Davis, Lawrence Edward.

Rater expertise in a second language speaking assessment: The influence of training and experience. - 279 p.

Source: Dissertation Abstracts International, Volume: 74-08(E), Section: A.

Thesis (Ph.D.)--University of Hawai'i at Manoa, 2012.

Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by training and experience, as well as the features that distinguish more proficient raters from their less proficient counterparts. This dissertation examined the nature of rater expertise within a speaking test, and how training and increasing experience influenced raters' scoring patterns, cognition, and behavior.

ISBN: 9781303035203Subjects--Topical Terms:

3168483
Educational tests & measurements.

Rater expertise in a second language speaking assessment: The influence of training and experience.
LDR:03405nmm a2200313 4500 001 2070041
005 20160602092048.5
008 170521s2012 ||||||||||||||||| ||eng d
020 $a 9781303035203
035 $a (MiAaPQ)AAI3569056
035 $a AAI3569056
040 $a MiAaPQ $c MiAaPQ
100 1 $a Davis, Lawrence Edward. $3 3185062
245 1 0 $a Rater expertise in a second language speaking assessment: The influence of training and experience.
300 $a 279 p.
500 $a Source: Dissertation Abstracts International, Volume: 74-08(E), Section: A.
500 $a Adviser: John Norris.
502 $a Thesis (Ph.D.)--University of Hawai'i at Manoa, 2012.
520 $a Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by training and experience, as well as the features that distinguish more proficient raters from their less proficient counterparts. This dissertation examined the nature of rater expertise within a speaking test, and how training and increasing experience influenced raters' scoring patterns, cognition, and behavior.
520 $a Experienced teachers of English (N=20) scored recorded examinee responses from the TOEFL iBT speaking test prior to training and in three sessions following training (100 responses for each session). For an additional 20 responses, raters verbally reported (via stimulated recall) what they were thinking as they listened to the examinee response and made a scoring decision, with the resulting data coded for language features mentioned. Scores were analyzed using many-facet Rasch analysis, with scoring phenomena including consistency, severity, and use of the rating scale compared across dates. Various aspects of raters' interaction with the scoring instrument were also recorded to determine if certain behaviors, such as the time taken to reach a scoring decision, were associated with the reliability and accuracy of scores.
520 $a Prior to training, rater severity and internal consistency (measured via Rasch analysis) were already of a standard typical for operational language performance tests, but training resulted in increased inter-rater correlation and agreement and improved correlation and agreement with established reference scores, although little change was seen in rater severity. Additional experience gained after training appeared to have little effect on rater scoring patterns, although agreement with reference scores continued to increase. More proficient raters reviewed benchmark responses more often and took longer to make scoring decisions, suggesting that rater behavior while scoring may influence the accuracy and reliability of scores. On the other hand, no obvious relationship was seen between raters' comments and their scoring patterns, with considerable individual variation seen in the frequency with which raters mentioned various language features.
590 $a School code: 0085.
650 4 $a Educational tests & measurements. $3 3168483
650 4 $a English as a second language. $3 516208
650 4 $a Language. $3 643551
690 $a 0288
690 $a 0441
690 $a 0679
710 2 $a University of Hawai'i at Manoa. $3 1017511
773 0 $t Dissertation Abstracts International $g 74-08A(E).
790 $a 0085
791 $a Ph.D.
792 $a 2012
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3569056