Computer-based testing (CBT) is typically implemented using one of three general test delivery models: (1) multiple fixed testing (MFT); (2) computer-adaptive testing (CAT); or (3) multistage testing (MSTs). This article reviews some of the real cost drivers associated with CBT implementation--focusing on item production costs, the costs…

Lessons derived from the Job Performance Measurement (JPM) Project, which is overseen by the Office of the Assistant Secretary of Defense for Force Management and Personnel, for educational assessment are explored. The JPM Project was initiated to develop high fidelity measures of performance on the job that can be used to evaluate personnel…

Internal structure and external validity of 39 multiple-choice visual arts achievement test items were examined. These items were developed to assess grade 3 visual arts achievement for a statewide model of a fine arts curriculum. Item responses were evaluated in terms of: (1) fit to the one-parameter Rasch measurement model; (2) item-total…

The field testing process for the collection of data on the norms, reliability, and concurrent validity of the Career Decision-Making System (CDM) is described. The CDM is a comprehensive career planning instrument that surveys interests, values, abilities, and training plans and relates them to career information in client-oriented interpretive…

A basic technical framework is provided for the design and use of mastery tests. The Mastery Testing Project (MTP) prepared this framework using advanced mathematics supplemented with computer simulation based on real test data collected by the South Carolina Statewide Testing Program. The MTP focused on basic technical issues encountered in using…

The reliability and validity of the Myself as a Teacher Scale (MTS), developed to assess the self-concept of teachers, were studied. Materials developed by David P. Butts and Robert Howe were used to construct a 62-item Likert-type scale asking individuals to rate themselves on certain criteria. After a pilot study with 92 preservice teachers and…

In fall 1986, a study was conducted at Florence-Darlington Technical College (South Carolina) to measure the reliability and validity of the TEC-MAT, a newly developed entrance test. The TEC-MAT instrument, a criterion-referenced test consisting of 100 items assessing numerical skills, was field tested among a group of entry-level freshmen already…

Teacher-made mastery tests were administered in a classroom-sized sample to study their decision consistency. Decision-consistency of criterion-referenced tests is usually defined in terms of the proportion of examinees who are classified in the same way after two test administrations. Single-administration estimates of decision consistency were…

The Florida Teacher Certification Examination (FTCE) is based upon selected competencies that have been identified as minimal entry-level skills for prospective teachers. A description is given of the four subtests which make up the FTCE: (1) writing--essay on general topics; (2) reading--multiple choice "cloze" procedure on general…

The Florida Teacher Certification Examination (FTCE) is based upon selected competencies that have been identified as minimal entry-level skills for prospective teachers. A description is given of the four subtests which make up the FTCE: (1) writing--essay on general topics; (2) reading--multiple choice "cloze" procedure on general…

The Auditory Automotive Mechanics Diagnostic Achievement Test assesses an automobile mechanic's ability to determine mechanical faults from auditory cues alone. The 44-item test and its instructions are recorded on magnetic tape; answer choices are presented on tape, and are also written in the printed test booklets. The norming and validity…

Debate on criteria for assessing sex fairness in occupational interest inventories has centered on four issues: (1) whether interpretational material should stress the prospect of social change or the reality of present occupational segregation by sex; (2) the appropriate form for reporting scores (raw, pooled sex norms, or separate sex norms);…

This study examines the relationship between an open-ended cloze test and its multiple-choice versions generated from three sources: (1) interlingual learner-generated distractors--distractors selected from one language group and administered to a different language group, (2) intralingual learner-generated distractors--distractors selected from…

The issue of using language proficiency or language dominance to assess programs for high school students with limited English speaking backgrounds is addressed. The development and initial analyses of the Competency Based Oral Language Assessment (COLA) are discussed. Three components of oral language are rated separately: semantics; syntax and…

Most of the information in this booklet is useful for both formative and summative evaluations. The booklet offers information to help the evaluator develop skills in designing and using instruments to measure affective objectives or attitudes. The chapters cover: (1) an introduction to the measurement of attitudes and attitude change; (2)…