I started out as a budding English as a second language (ESL) teacher in 1976 at UCLA where I went through the M.A. TESL (Teaching English as a Second Language) and Applied Linguistics Ph.D. programs. Sadly, those two programs were "disestablished" in 2014, which provides a stark lesson to any departments that think they are hot stuff…

This article begins by defining "world Englishes" (WEs) and the related paradigm of inner-, outer-, and expanding-circle English(es). The discussion then turns to the central concerns of the WEs and language testing (LT) communities with regard to how English tests can best be constructed to include various WEs by discussing (a) what…

Cloze tests have been the subject of numerous studies regarding their function and use in both first language and second language contexts (e.g., Jonz & Oller, 1994; Watanabe & Koyama, 2008). From a validity standpoint, one area of investigation has been the extent to which cloze tests measure reading ability beyond the sentence level.…

In this interview, JD Brown reflects on language testing/assessment. He suggests that language testing can be seen as a continuum with hard core positivist approaches at one end and post modernist interpretive perspectives at the other, and also argues that norm referencing (be it proficiency, placement, or aptitude testing) and criterion…

In 1996, we published an article that investigated the characteristics of basic language testing courses in terms of the instructors, course characteristics, and students. The present study is designed to describe the same characteristics of basic language testing courses in 2007 and to examine how such courses have changed since 1996. To those…

In keeping with the theme of the International Language Testing Association/Language Testing Research Colloquium Conference in 2008, "Focusing on the Core: Justifying the Use of Language Assessments to Stakeholders," I define "stakeholder-friendly tests," "defensible testing," and "testing-context analysis."…

Discusses a serious problem that has existed for years in language research with regard to the use of the inferential statistic known as the t test. (12 references) (JL)

This study investigates the Test of English as a Foreign Language (TOEFL), in particular the relative contributions to score dependability (analogous to classical theory reliability) of various numbers of items and subtests as well as the decision dependability at different cut points. Research questions that apply to the overall TOEFL battery and…

Presents simplified methods for deriving estimates of the consistency of criterion-referenced, English-as-a-Second-Language tests, including (1) the threshold loss agreement approach using agreement or kappa coefficients, (2) the squared-error loss agreement approach using the phi(lambda) dependability approach, and (3) the domain score…

Explored the relative contributions to Test of English as a Foreign Language (TOEFL) score dependability of various numbers of persons, items, subtests, languages, and their various interactions. Sampled 15,000 test takers, 1000 each from 15 different language backgrounds. (Author/VWL)

Discusses a study of the reliability of a categorical instrument for evaluating compositions written by upper intermediate university English as a second language students. The instrument tests organization, logical development of ideas, grammar, mechanics, and style. Results indicate that the scoring instrument is moderately reliable. (SED)

Anthony Bruton comments on Brown and Hudson's article "The Alternatives in Language Assessment," (v32 n4 Win 1998). Raises questions about some of their definitions and categories and suggests additional items that need to be considered by test takers. Brown and Hudson reply with clarifications of terms and definition of the scope of their paper.…

Explores recent developments in the use of computers in language testing in four areas: (1) item banking; (2) computer-assisted language testing; (3) computerized-adaptive language testing; and (4) research on the effectiveness of computers in language testing. Examines educational measurement literature in an attempt to forecast the directions…

This technical report focuses on the decision-making potential provided by second language performance assessments. First, performance assessment is situated within the broader discussion of alternatives in language assessment and in educational assessment in general. Next, issues in performance assessment design, implementation, reliability, and…

The reliability and validity of a cloze procedure used as an English-as-a-second-language (ESL) test in China were improved by applying traditional item analysis and selection techniques. The 'best' test items were chosen on the basis of item facility and discrimination indices, and were administered as a 'tailored cloze.' 29 references listed.…