東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Exploring the validity evidence of t...

Lim, Hyo Jung.

Linked to FindBook

Google Book

Amazon

博客來

Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective./
Author:	Lim, Hyo Jung.
Description:	181 p.
Notes:	Source: Dissertation Abstracts International, Volume: 76-05(E), Section: A.
Contained By:	Dissertation Abstracts International76-05A(E).
Subject:	English as a second language. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3668323
ISBN:	9781321433241

Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective.
Lim, Hyo Jung.

Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective. - 181 p.

Source: Dissertation Abstracts International, Volume: 76-05(E), Section: A.

Thesis (Ph.D.)--Michigan State University, 2014.

This item must not be sold to any third party vendors.

Language tests must be cognitively valid and are expected to elicit from test takers the same type and level of cognitive processing as similar real-world tasks (Bax & Weir, 2012; Bax, 2013; Field, 2009, 2011). However, recent test validations of language tests have heavily relied on correlation-based psychometric methods, which primarily assess test outcomes rather than test-taking processes. Such a statistical approach is limited because numbers do not convey conceptual information and test scores do not explain how test takers derive their answers (Weir, 2005). Psychometricians have emphasized the importance of cognitively based test validation and development (Borsboom, 2005; Gorin, 2007). Though language testers have agreed that understanding test takers' cognition is important for test validation, empirical studies of high-stakes academic reading tests are relatively scarce (e.g., Bax, 2013; Bax & Weir, 2012; Chapelle, Enright, & Jamieson, 2008; Cohen & Upton, 2007).

ISBN: 9781321433241Subjects--Topical Terms:

516208
English as a second language.

Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective.
LDR:04773nmm a2200349 4500 001 2063298
005 20151027100450.5
008 170521s2014 ||||||||||||||||| ||eng d
020 $a 9781321433241
035 $a (MiAaPQ)AAI3668323
035 $a AAI3668323
040 $a MiAaPQ $c MiAaPQ
100 1 $a Lim, Hyo Jung. $3 3177801
245 1 0 $a Exploring the validity evidence of the TOEFL iBT reading test from a cognitive perspective.
300 $a 181 p.
500 $a Source: Dissertation Abstracts International, Volume: 76-05(E), Section: A.
500 $a Adviser: Paula Winke.
502 $a Thesis (Ph.D.)--Michigan State University, 2014.
506 $a This item must not be sold to any third party vendors.
506 $a This item must not be added to any third party search indexes.
520 $a Language tests must be cognitively valid and are expected to elicit from test takers the same type and level of cognitive processing as similar real-world tasks (Bax & Weir, 2012; Bax, 2013; Field, 2009, 2011). However, recent test validations of language tests have heavily relied on correlation-based psychometric methods, which primarily assess test outcomes rather than test-taking processes. Such a statistical approach is limited because numbers do not convey conceptual information and test scores do not explain how test takers derive their answers (Weir, 2005). Psychometricians have emphasized the importance of cognitively based test validation and development (Borsboom, 2005; Gorin, 2007). Though language testers have agreed that understanding test takers' cognition is important for test validation, empirical studies of high-stakes academic reading tests are relatively scarce (e.g., Bax, 2013; Bax & Weir, 2012; Chapelle, Enright, & Jamieson, 2008; Cohen & Upton, 2007).
520 $a The present study explores cognitive evidence of the validity of the TOEFL iBT reading test by examining Chinese ESL students' test-taking behaviors. More specifically, it investigates whether the test exploits construct-relevant cognitive resources and activates the intended cognitive processes while concomitantly investigating the effect of the construct-irrelevant variable (e.g., test-taking strategy). The guiding research questions are 1) to what extent does the TOEFL iBT reading test measure the reading construct?; 2) to what extent does the TOEFL iBT reading test activate the cognitive processes being measured?; 3) to what extent does test format affect students' test scores and test-taking processes?
520 $a Ninety Chinese ESL students attending a large midwestern university participated in the main experiment, and 206 Chinese students in the US completed the reading difficulty survey questionnaire online. During the experiment period, participants took two reading testlets, one with multiple-choice questions and the other with open-ended questions, on a computer whose screen was fitted with a Tobii TX300 eye-tracker. Their eye movements were recorded while taking the test. Participants also completed a vocabulary test, a grammar test, a lexical processing task, a sentence processing task, a working memory task, a strategy questionnaire, and a stimulated recall interview.
520 $a The results of three different analyses were found to be inconsistent: the regression analysis showed that the most important construct-relevant variables (vocabulary knowledge, grammar knowledge, and word recognition skill) best predicted test scores, while the effect of the construct-irrelevant variable (e.g., test-taking strategy) was not significant. However, according to the eye-tracking analysis, some of the test items failed to activate the intended reading processes: expeditious reading skills were rarely activated, especially at the global level, and participants did not necessarily read to find the key answer, especially in the vocabulary and reading-to-learn questions. Furthermore, successful readers were not always faster at reading and locating key information. Lastly, the investigation on the test format effect revealed that participants scored higher on the multiple-choice questions and used different reading processes depending on the test format. Because the effects of test format suggest the possible involvement of test-taking strategies (Rogers & Harley, 1999), the result of the third analysis may contradict the result of the earlier regression analysis. Discussed are the implications for validity arguments, test development, and further research.
590 $a School code: 0128.
650 4 $a English as a second language. $3 516208
650 4 $a Educational evaluation. $3 526425
650 4 $a Educational psychology. $3 517650
690 $a 0441
690 $a 0443
690 $a 0525
710 2 $a Michigan State University. $b Second Language Studies. $3 1678770
773 0 $t Dissertation Abstracts International $g 76-05A(E).
790 $a 0128
791 $a Ph.D.
792 $a 2014
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3668323