ERIC Number: EJ1246329
Record Type: Journal
Publication Date: 2019
Pages: 9
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2148-7456
EISSN: N/A
An Empirical Study for the Statistical Adjustment of Rater Bias
International Journal of Assessment Tools in Education, v6 n2 p193-201 2019
This study investigated the effectiveness of statistical adjustments applied to rater bias in many-facet Rasch analysis. Some changes were first made in the dataset that did not include "rater × examinee" bias to cause to have "rater × examinee" bias. Later, bias adjustment was applied to rater bias included in the data file, and the effectiveness of the statistical adjustment was further examined. The outcomes pertaining to the datasets with and without bias, and to which the bias adjustment was applied, were compared. It was concluded that diversities created by "rater × examinee" bias in examinees' ability estimation, item difficulty indices and measures of rater severity and leniency were, to a large extent, eliminated by bias adjustment. This result indicates that the bias adjustment using many-facet Rasch analysis is a viable way to control rater bias.
Descriptors: Statistical Analysis, Item Response Theory, Evaluators, Bias, Computation, Difficulty Level, Test Items, Grade 8, Mathematics Teachers, Achievement Tests, Mathematics Tests
International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 8; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A