Describes procedures for calculating conditional standard error of measurement (CSEM) and reliability of scale scores and classification of consistency of performance levels. Applied these procedures to data from the American College Testing Program's Work Keys Writing Assessment with sample sizes of 7,097, 1,035, and 1,793. Results show that the…

The use of the Work Keys Listening and Writing Assessment, part of an assessment system of the generic employability skills of individuals, needs to be accompanied by systematic evaluation of its technical qualities. This study examined sampling variability and generalizability of Listening and Writing scores when multiple forms, raters, and…

The Work Keys (trademark) system of the American College Testing program has combined assessments of listening and writing into a single test administration. The Listening and Writing assessment uses independent scorings of the examinee's written responses to audiotaped prompts to assess both listening and writing skills separately. This paper…

Generalizability theory is used to examine the psychometric characteristics of the Listening and Writing Tests developed by American College Testing for its Work Keys program. Results with samples of 50 suggest the desirability of a minimum number of the tests' tape-recorded messages and the use of at least 2 raters. (SLD)

Work Keys (occupational tests developed by American College Testing) could support an employer's human resource function in a number of ways: (1) communicating to educators the skill requirements for an employer's particular jobs on a national basis; (2) providing students with a realistic preview of skills needed for jobs and an assessment of…