Three statistical problems related to criterion-referenced testing are investigated: estimation of the likelihood of a false-positive or false-negative decision with a mastery test, estimation of true scores in the Compound Binomial Error Model, and comparison of the examinees to a control. Two methods for estimating the likelihood of…

Two studies are presented in this report. The first is titled "Empirical Studies of Multilevel Approaches to Test Development and Interpretation: Measuring Between-Group Differences in Instruction." Because of a belief that schooling does affect student achievement, researchers have questioned the empirical and measurement techniques…

This study used the Montague-Riley Test to introduce a new scoring procedure that revealed errors in cognitive processes occurring at subcomponents of an electricity problem. The test, consisting of four parts with 36 open-ended problems each, was administered to 250 high school students. A computer program, ELTEST, was written applying a…

Clues in the answers given to the Spanish Advanced Placement Examination questions can identify the test-taker as having learned the language in the classroom or as a native speaker. The Educational Testing Service has found mechanisms to ensure that the tests are equally suited to the two groups. (MSE)

Background: English-speaking children with specific language impairment (SLI) perform more poorly than their typically developing peers in verbal working memory tasks where processing and storage are simultaneously required. Hungarian is a language with a relatively free word order and a rich agglutinative morphology. Aims: To examine the effect…

Generalizability theory is described and applied to data collection methods for student ratings of instruction. Three generalizability coefficients (generalizing over both students and items, generalizing over students only, and generalizing over items only) are defined, and the appropriateness of each for various purposes is discussed.…

Classifies errors as either systematic or blunder and uncertainties as either systematic or random. Discusses use of error/uncertainty analysis in direct/indirect measurement, describing the process of planning experiments to ensure lowest possible uncertainty. Also considers appropriate level of error analysis for high school physics students'…

Failure to consider errors of measurement when using partial correlation or analysis of covariance techniques can result in erroneous conclusions. Certain aspects of this problem are discussed and particular attention is given to issues raised in a recent article by Brewar, Campbell, and Crano. (Author)

The focus of the presentation pertains to the informational consequences of knowledge of results. Knowledge of results is assumed to be corrective in that the learner is informed that a previous response(s) was wrong. Provided the learner has an opportunity to rehearse or practice following feedback, the feedback procedure or session is in a sense…

Synthetic estimation is a statistical technique that estimates small-area statistics by combining national estimates of the relevant characteristics with estimates of other known characteristics of the small geographic area. The advantages of the synthetic estimation approach to local estimation are its intuitive appeal, its simplicity, and its…

The type, number, and scope of errors on Basic Educational Opportunity Grant (BEOG) program applications were estimated in a replication of a 1976-1977 Internal Revenue Service (IRS) Comparison Study. Information reported on BEOG applicants and IRS income tax returns was compared for various categories of applicants. The study provides information…

Parameters and procedures for developing an error-prone model (EPM) to predict financial aid applicants who are likely to misreport on Basic Educational Opportunity Grant (BEOG) applications are introduced. Specifications to adapt these general parameters to secondary data analysis of the Validation, Edits, and Applications Processing Systems…

The impact of quality assurance procedures on the correct award of Basic Educational Opportunity Grants (BEOGs) for 1979-1980 was assessed, and a model for detecting error-prone applications early in processing was developed. The Bureau of Student Financial Aid introduced new comments into the edit system in 1979 and expanded the pre-established…

The general objective of a research program on adaptive testing was to identify several sources of potential error in test scores, and to study adaptive testing as a means for reducing these errors. Errors can result from the mismatch of item difficulty to the individual's ability; the psychological effects of testing and the test environment; the…

An evaluation of existing and proposed mechanisms to ensure data accuracy for the Pell Grant program is reported, and recommendations for efficient detection of fraud and error in the program are offered. One study objective was to examine the existing system of pre-established criteria (PEC), which are validation criteria that select students on…