This review departs from current practice in reviewing tests in that it employs an "argument-based approach" to test validation to guide the review (e.g. Bachman, 2005; Kane, 2006; Mislevy, Steinberg, & Almond, 2002). Specifically, it follows an approach to test development and use that Bachman and Palmer (2010) call the process of "assessment…

This study investigated the validity of four theoretically motivated traits of writing ability across English and Korean, based on elementary school students' responses to letter- and story-writing tasks. Their responses were scored analytically and analyzed using confirmatory factor analysis. The findings include the following. A model of writing…

The No Child Left Behind (NCLB) Act has made a great impact on states' policies in assessing English language learner (ELL) students. The legislation requires states to develop or adopt sound assessments in order to validly measure the ELL students' English language proficiency (ELP), as well as content knowledge and skills. Although states have…

The No Child Left Behind Act of 2001 (NCLB, 2002) has had a great impact on states' policies in assessing English language learner (ELL) students. The legislation requires states to develop or adopt sound assessments in order to validly measure the ELL students' English language proficiency, as well as content knowledge and skills. While states…

Discusses problems in task-based language assessment, including the definition and sampling of tasks, generalizations across tasks, interpretations about broad ability and language use domains, and the notion of task difficulty. (Author/VWL)

The fields of language testing and educational and psychological measurement have not, as yet, developed a set of principles and procedures for linking test scores and score-based inferences to test use and the consequences of test use. Although Messick (1989) discusses test use and consequences, his framework provides virtually no guidance on how…

Presents study designed to examine trait structure of a cloze test using confirmatory factor analysis. Results suggest that a modified cloze passage, using rational deletions, is capable of measuring syntactic- and discourse-level relationships in a text, and this advantage may outweigh considerations of reduced redundancy which underlie random…

Applied linguistics and psychometrics have influenced language testing, providing additional tools for investigating factors affecting language test performance and assuring measurement reliability. An examination is presented of language testing, including the theoretical issues involved, the methodological advances, language test development,…

Discusses three research/testing interfaces in second-language (L2) testing: the covariance structure analysis of ex post facto correlational data, the qualitative investigation of test-taking processes, and the development of L2 assessment instruments based on developmental sequences in L2 acquisition. (61 references) (GLR)

An empirical investigation into the construct validity of tests of speaking and reading English as a second language (ESL) was performed using the multitrait-multimethod convergent-divergent design of Campbell and Fiske. Interview, translation, and self-rating tests of the two hypothesized traits, "speaking ability" and "reading ability," were…

The abilities measured by the First Certificate of English (FCE) administered by the Cambridge Local Examinations Syndicate are compared with the Test of English as a Foreign Language (TOEFL) administered by the Educational Testing Service. The analyses suggest that the FCE and TOEFL appear to measure the same common aspect of language…

Describes a study that developed criteria for rationally selecting the words to delete in developing a cloze test. The study also tried to determine the extent to which performance on a cloze test with rational deletions differs from that on a cloze test developed by the fixed-ratio deletion procedure. (SED)

This study is part of a larger one examining the comparability of the First Certificate in English and the Test of English as a Foreign Language. The general assumption of unidimensionality and goodness-of-fit were tested. Findings raise questions about the consequences of rejecting or retaining misfitting items. (60 references) (LB)

Discusses the problem of measuring the validity of interview ratings in the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interviews (OPI), proposes frameworks to distinguish abilities from testing methods, and considers factors affecting test performance. Suggestions for research and development on the ACTFL OPI…

Reviews developments in language testing research and practice over the last 20 years, and suggests future directions in the areas of professionalizing the field and validation research. Argues that concerns for ethical conduct must be grounded in valid test use, so that professionalization and validation research are inseparable. (Author/VWL)