For classical, norm-referenced test reliability, Cronbach's alpha has been shown to be equal to the mean of all possible split-half Pearson product-moment correlation coefficients, adjusted by the Spearman-Brown prophecy formula. For criterion-referenced test reliability, in an analogous vein, this paper provides the rationale behind, the analysis…

Though domain-oriented and norm-referenced tests are appropriate for some situations, objective-oriented and criterion-referenced tests must be used to gather additional information. Objectives for such tests must include a statement of the desired performance, the test conditions, and the standards of acceptance. When tests are constructed the…

The objectives of this study were to first determine whether or not the empirical item analysis of domain referenced tests (DR) was justified; and second, in the event that it was, which of a set of recommended procedures was most effective for determining item quality. The analysis that followed led to the conclusion that empirical procedures…

The relationship between criterion, test items, and instruction is discussed to show the problems of the pretest and posttest evaluation of criterion referenced items. (JY)

The purpose of the current study is to test the proposition that the relative contribution of narrow abilities (but not of "g") may have been obscured in prior research due to a failure to employ fully multidimensional latent variable analyses. The current study corrects for these deficiencies and examines the relationships between cognitive…

Brantmeier [Brantmeier, C., 2006. "Advanced L2 learners and reading placement: self-assessment, computer-based testing, and subsequent performance." 'System 34" (1), 15-35] found that self-assessment (SA) of second language (L2) reading ability is not an accurate predictor for computer-based testing or subsequent classroom performance. With 359…

The Indiana Department of Education, at the direction of Phyllis Lewis, commissioned the National Association of Peer Programs (NAPP: formerly known as the National Peer Helpers Association) and the authors listed above to develop a rubric for peer helping programs. Development of the rubric began with a review of the NAPP Programmatic Standards…

The types of test score interpretive information considered useful to failing examinees were studied through interviews with Educational Testing Service (ETS) staff members. Research literature on interpretive information for failing test takers was reviewed, and procedures currently used at ETS were determined. Managers of 23 testing programs…

Some fundamental concepts of criterion referenced test (CRT) reliability are highlighted. Emphasis is given to the procedures for determining reliability of scores for individual pupils because this is an area requiring increased awareness by classroom teachers and practitioners. Reliability issues encountered in the evaluation of instructional…

The Criterion-Referenced Test is designed to be used in conjunction with the SEL/Project Language, Level II, Kindergarten program. The test consists of 28 items to which the child responds verbally or nonverbally. The examiner records and tallies correct responses to obtain the child's total score. To administer this test, the examiner must have…

Traditional grading practices are a source of anxiety and ambivalence for teachers from the elementary grades through college. The ambivalence stems from a conflict between the assumptions of traditional practice and modern educational purpose; however, criterion referenced evaluation has its own dangers. (Author/JC)

The Multimedia Assisted Test of English Speaking was designed to assess global speaking competence of Korean speakers of English at Sookmyung Women's University. The test was developed with the help of the American Council on the Teaching of Foreign Languages for their proficiency guidelines and of the Center for Applied Linguistics for their…

K-12 school practitioners and schools administrators need reliable results about the effects of instructional technology products as they strive to meet achievement compliance levels in politically accountable local and national contexts in the U.S. This study presents evidence regarding the effects of extensive engagement with computer-based…

In keeping with the theme of the International Language Testing Association/Language Testing Research Colloquium Conference in 2008, "Focusing on the Core: Justifying the Use of Language Assessments to Stakeholders," I define "stakeholder-friendly tests," "defensible testing," and "testing-context analysis."…