This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

Reports results of variety of validity analyses involving American Council on Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview as it was administered to 59 learners of English and 60 learners of French. Concludes that ACTFL guidelines can be useful as an assessment tool and offer advantages that warrant serious consideration in the…

Testing issues and concerns that should receive renewed and increased professional attention are highlighted. These include curriculum concerns, developmental matters; generalizability, content and format considerations, contextualization issues, and technology concerns. (JL)

Analyzes simulated performance ratings on a six-point scale by two independent raters to account for nonsystematic error in performance ratings. Results suggest that rater agreement or covariance is not always a dependable estimate of score reliability and that the practice of seeking additional raters for adjudication of discrepant ratings is not…