The design of a valid and reliable test of test-wiseness is reported: a 33-item multiple-choice instrument with 4 subscales trialed with several groups of English-as-a-Second-Language students. Findings indicate differential skills in test-taking; some learner scores are influenced by skills that are not the focus of the test. (13 references)…

Two studies are reported that examined translation from second language to first language as a testing procedure. Results suggest that the widespread rejection of translation as a language testing procedure by teachers and testers is probably not warranted on psychometric grounds, but that it should be used with extreme care. (10 references)…

Analyzes simulated performance ratings on a six-point scale by two independent raters to account for nonsystematic error in performance ratings. Results suggest that rater agreement or covariance is not always a dependable estimate of score reliability and that the practice of seeking additional raters for adjudication of discrepant ratings is not…

Discusses approaches to the standardized assessment of content knowledge for English language learners (ELLS), including testing in the students' first language, the use of test accommodations, and measuring growth in English as an alternative for accountability until student control of English is sufficient to assure validity of test scores.…

Describes a study which submitted data from a multiple-choice English as a second language reading comprehension test to classical test theory item analysis and latent trait measurement. The purpose was to identify weak items and to compare the number of weak items indicated by the two different approaches. (SED)

Discusses the three main approaches to defining language knowledge and use: (1) the structural approach, (2) the functional approach, and (3) the general proficiency approach. Asserts that each approach has specific consequences for language testing and that no one approach can claim to be the only way of representing that knowledge. (Author/SED)

Presents the design and validation of an English-as-a-Second-Language (ESL) test for a commercial publisher. (Author/VWL)

Explored the relative impact of the test-developer on the performance of test takers using multiple-choice reading comprehension tests that had no specifications. Six passages each with three different sets of multiple-choice items constructed by three groups of individuals were trialled on 335 Iranian English-as-a-Foreign-Language (EFL) learners.…

Investigated the impact of performance conditions on perceptions of task difficulty in a test of spoken language, in light of the cognitive complexity framework proposed by Skehan (1998). Candidates performed narrative tasks whose characteristics and the conditions under which they were performed were manipulated, and the impact of these on task…

Analyzed Francophone university students' (N=182) performance on eight English-As-a-Second-Language cloze tests (in terms of cloze-taking ability, language knowledge, content domain, and knowledge of contextual constraints). Results revealed that cloze performance was dependent on language factors and nonlinguistic-specific knowledge related to…

Discusses the development of an interview test of English proficiency in the 0 to 1+ range on the Australian Second Language Proficiency Rating Scale. Items were written toward 29 specified objectives using specially developed algorithms. A sample set of algorithms used in one of the tests and 23 references are appended. (Author/LMO)

The assumption called PIRC (proportional item response curve) was tested in which PIRC was used to predict item scores of selected examinees on selected items. Findings show approximate accuracies of prediction for PIRC, the three-parameter logist model, and a modified Rasch model. (12 references) (Author/LB)

The effect of five types of topical structure (including initial sentence element, mood subject, and surface subject) on the item difficulty of reading comprehension questions was investigated. Results indicated differences in the item difficulty of questions according to the type of topical structure on which the questions were based. (21…

Examines what opportunities test takers have to display their knowledge of managing conversations in the second language in two types of tasks: nonscripted interviews and guided role-play activities. Data consists of 30 interviews and 30 role-play activities between near-native examiners and intermediate learners used in language exams in Hungary.…

Considers the ecological validity of tests in predicting the effects of speech and language impairment on communicative performance in real-world settings and the need for systematic observation of communicative behaviors, particularly of individuals from other cultures. Discusses whether standardized testing and systematic observation are…