Using Generalizability Theory To Estimate the Reliability of Writing Scores Derived from Holistic and Analytical Scoring Methods.

Swartz, Carl W.; Hooper, Stephen R.; Mongomery, James W.; Wakely, Melissa B.; De Kruif, Renee E. L.; Reed, Martha; Brown, Timothy T.; Levine, Melvin D.; White, Kinnard P.

Notes FAQ Contact Us

Back to results

Peer reviewed

ERIC Number: EJ594286

Record Type: Journal

Publication Date: 1999

Pages: N/A

Abstractor: N/A

ISBN: N/A

ISSN: ISSN-0013-1644

EISSN: N/A

Using Generalizability Theory To Estimate the Reliability of Writing Scores Derived from Holistic and Analytical Scoring Methods.

Swartz, Carl W.; Hooper, Stephen R.; Mongomery, James W.; Wakely, Melissa B.; De Kruif, Renee E. L.; Reed, Martha; Brown, Timothy T.; Levine, Melvin D.; White, Kinnard P.

Educational and Psychological Measurement, v59 n3 p492-506 Jun 1999

Used generalizability theory to investigate the impact of the number of raters and the type of decision (relative versus absolute) on the reliability of writing scores. Results from 251 middle school students and 20 intermediate grade students show that reliability coefficients decline as the number of raters declines and when absolute decisions are made. (SLD)

Descriptors: Estimation (Mathematics), Generalizability Theory, Holistic Evaluation, Intermediate Grades, Middle Schools, Reliability, Scores, Scoring, Writing Tests

Publication Type: Journal Articles; Reports - Research

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A