School accountability systems have been roundly criticized for their narrowness, being largely informed by standardized achievement scores. With the passage of the Every Student Succeeds Act, accountability systems may become more multifaceted in coming years. This study examines pilot results of an alternative school quality framework--one…

In this study, the researchers examined how 64 university students engaged in self-directed group learning and used a self-developed e-portfolio system. A sixweek event was held where the students made entries to the e-portfolio individually each week, received feedback from advisors, studied in groups on a voluntary basis, and reflected on their…

This study examines the relationship between certification examination test results and Emergency Medical Technician (EMT) career success. The sample was drawn from the Longitudinal Emergency Medical Technician Attributes and Demographics Study (LEADS). LEADS participants were matched with National Registry of Emergency Medical Technician (NREMT)…

Using results from the Collegiate Learning Assessment (CLA) administered at Central Connecticut State University, a public Carnegie master's-larger programs university in the Northeast, this study demonstrates time on spent on the test, student motivation, and to a lesser extent the local institutional administration procedures represent…

Because reliability is a function of scores, and not tests per se, it is inaccurate to hold that a given test will yield scores with the same reliability across samples. Therefore, score reliability should always be reported and interpreted in both measurement and substantive studies. In an effort to facilitate this outcome, this paper is intended…

Validity is concerned with the clarification and justification of the intended interpretations and uses of observed scores. It has not been easy to formulate a general methodology set of principles for validation, but progress has been made, especially as the field has moved from relatively limited criterion-related models to sophisticated…

Given the potential value of reliability generalization (RG) studies in the development of cumulative psychometric knowledge, the purpose of this paper is to provide a tutorial on how to conduct such studies and to serve as a guide for researchers wishing to use this methodology. After some brief comments on classical test theory, the paper…

The purpose of this study was to investigate the relationship between testing condition and student test scores. The testing conditions studied were: independent, cheat sheet, homogenous grouping with cheat sheet, and heterogeneous group without cheat sheet. Participants were 141 undergraduates in a course required for entry into the teacher…

Previous studies have indicated that the reliability of test scores composed of testlets might be overestimated by conventional item-based reliability estimation methods (R. Thorndike, 1953; A. Anastasi, 1988; S. Sireci, D. Thissen, and H. Wainer, 1991; H. Wainer and D. Thissen, 1996). This study used generalizability theory to investigate the…

Candidates who had taken examinations for certification required by the American Production and Inventory Control Society (APICS) were surveyed to acquire feedback about the effectiveness of score interpretive information given to test takers. Those sampled included 488 passers and 389 failers of the Inventory Management (IM) examination and 457…

The purpose of this study was to investigate the relationship between the scores students earned on their statistics final examinations and the number of minutes students required to complete the exams. In a previous study, K. Bridges (1985) extended the range of interest in this relationship from a single study to a course-based series, examining…

Cut scores, quartile ranking, sample size, and overall classification scheme were studied as personnel selection procedures in two samples. The first was 120 simulated observations of employee scores based on actual selection procedures for applicants for administrative assistant positions. The other sample was composed of test results for 73…

Test specifications dictate the kind of content that should be included on each form of an examination, and the relative weight that each content domain should contribute to the determination of examinees' test scores by specifying the proportion of items to be included in each content area. This paper addresses a step in the development of…

Stochastic models are developed in this article to examine the rate of test misgrading in educational and psychological measurement. The estimation of inadvertent grading errors can serve as a basis for quality control in measurement. Limitations of traditional Poisson models have been reviewed to highlight the need to introduce new models using…

This study explored the relationship between Oregon high school students' performance in a standards-based system and their subsequent performance in the first year of college. Findings from 6,082 students from the Oregon University System and 12,519 from Oregon community colleges led to the conclusion that the 10th grade benchmark performance may…