ERIC Number: EJ933561
Record Type: Journal
Publication Date: 2011-Aug
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1556-1623
EISSN: N/A
Statistical Estimates of Learners' Judgments about Knowledge in Calibration of Achievement
Winne, Philip H.; Muis, Krista Renee
Metacognition and Learning, v6 n2 p179-193 Aug 2011
In theoretical models of self-regulated learning, calibration is one important component in successful learning. Two issues of calibration are explored. First, Nelson (1987) suggested the "G" (gamma) coefficient is the most appropriate measure of calibration (judgment accuracy) and rejected signal detection theory's "d'" statistic because data commonly challenge distributional assumptions. We empirically examined this issue, comparing "G" and "d'." Second, we examined whether a learner's calibration varies across three domains of knowledge: general, word, and mathematics. A sample of 266 university students volunteered to participate in the study. Participants were selected from various undergraduate and graduate courses. Participants first answered demographic items. Then they completed three knowledge tests (general, word, and mathematics) and judged correctness for each answer provided. Order of domains was randomly counterbalanced among participants. Results show that "d'" is a valid measure of calibration, that assumptions about underlying distributions can be tested, and that preliminary evidence suggests that "d'" may be a superior measure of accuracy compared to "G." Finally, calibration varied by domain.
Descriptors: Foreign Countries, Learner Controlled Instruction, Mathematics, College Students, Psychometrics, Measurement Techniques, Statistical Analysis, Vocabulary, Tests, Metacognition, Evaluative Thinking, Accuracy, Confidence Testing
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://bibliotheek.ehb.be:2189
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada
Grant or Contract Numbers: N/A