Reports on the results of research conducted by the American Council on the Teaching of Foreign Languages (ACTFL) on the construct validity of the ACTFL Proficiency Guidelines and Oral Interview procedure. A discussion of the results and suggestions for further research are included. (Author/VWL)

This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

An English-as-a-second-language reading comprehension test is analyzed, first using classical measurement procedures and then using the Rasch Model latent trait procedures. Results indicate that the Rasch Model analysis procedure produced numerous advantages for the test developer. Summarizes and describes 13 of these advantages. (SED)

Reports results of variety of validity analyses involving American Council on Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview as it was administered to 59 learners of English and 60 learners of French. Concludes that ACTFL guidelines can be useful as an assessment tool and offer advantages that warrant serious consideration in the…

Testing issues and concerns that should receive renewed and increased professional attention are highlighted. These include curriculum concerns, developmental matters; generalizability, content and format considerations, contextualization issues, and technology concerns. (JL)

Violations of item unidimensionality on language tests produced distorted estimates of person ability, and violations of person unidimensionality produced distorted estimates of item difficulty. The Bejar Method was sensitive to such distortions. (Author)

Analyzes simulated performance ratings on a six-point scale by two independent raters to account for nonsystematic error in performance ratings. Results suggest that rater agreement or covariance is not always a dependable estimate of score reliability and that the practice of seeking additional raters for adjudication of discrepant ratings is not…

Investigation of the use of a multiple-trait scoring procedure to obtain communicative writing profiles of adult nonnative English speakers found that the scoring method was highly reliable in composite assessment, but provided little psychometric support for assessing certain individual writing components. (28 references) (Author/CB)

Although programs for teaching and testing of English as a second language (ESL) are often evaluated for their attention to communicative competence, there is no consensus on the nature of the communicative competence construct(s) and little empirical support for the various explanatory models. The theoretical literature related to communicative…

A study evaluated a composition grading scale used in the University of California at Los Angeles' program of English as a second language (ESL). It looked at (1) the comparative difficulty of the subscale categories; (2) the interrelationships of the subscale categories; (3) the incremental arrangement of the subscale categories and performance…

"Listening Recall" is a listening comprehension test which discriminates over a wide range of proficiency. Unlike traditional tests, requiring multiple choice responses, it is a listening cloze procedure; a narrative passage accompanied by a written version with deletions. Particularly suited to low proficiency learners, test has high…

A study was done to identify the cultural or linguistic bias present in an English as a second language placement examination at the university level. Test items exhibiting bias in their respective skill domains were identified by comparing 34 native Spanish speakers and 77 native Chinese speakers. (SED)

Examines the effectiveness of an automated language proficiency test assembly system at an air force base English Language Center. The study focuses on the equivalence of mean score difficulty, total score variance, and intercorrelation covariance across test norms and finds a high level of test-form equivalence and internal consistency. (nine…

A prototype revised form of the Test of Spoken English (TSE) was compared with the current version of the same test, comparing interrater reliability, frequency of rater discrepancy at all score levels, component task adequacy, scoring efficacy, and other concurrent and construct validity evidence, including the oral proficiency interview…

This study provides information about the total and component scores of the Test of English as a Foreign Language (TOEFL). First, the study provides comparative global and component estimates of test-retest, alternate-form, and internal-consistency reliability, controlling for sources of measurement error inherent in the examinees and the testing…