ERIC Number: EJ734922
Record Type: Journal
Publication Date: 2006
Pages: 14
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
A Monte Carlo Comparison of Measures of Relative and Absolute Monitoring Accuracy
Nietfeld, John L.; Enders, Craig K; Schraw, Gregory
Educational and Psychological Measurement, v66 n2 p258-271 2006
Researchers studying monitoring accuracy currently use two different indexes to estimate accuracy: relative accuracy and absolute accuracy. The authors compared the distributional properties of two measures of monitoring accuracy using Monte Carlo procedures that fit within these categories. They manipulated the accuracy of judgments (i.e., chance level or 60% and above) and the number of items per test (i.e., 20, 50, or 1,000) using 10,000 computer-generated cases. Gamma, an estimate of relative accuracy, yielded a skewed, leptokurtic distribution under the 50-item, 60% accuracy conditions. The Hamann coefficient, an estimate of absolute accuracy, yielded a normal distribution under the same conditions. Both statistics yielded normal distributions under the 1,000-item, 60% conditions, although parameter estimates differed widely. The two statistics were similar, and normally distributed, under the 50- and 1,000-item, chance conditions. Recommendations are made regarding the use of each measure in applied monitoring accuracy research. (Contains 1 figure and 1 table.)
Descriptors: Monte Carlo Methods, Test Items, Computation, Metacognition, Effect Size, Computer Assisted Testing, Indexes, Matrices, Statistical Analysis, Learning Processes, Object Manipulation, Comparative Analysis, Test Reliability, Methods Research
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A