ERIC Number: EJ1046017
Record Type: Journal
Publication Date: 2014
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0211-2159
EISSN: N/A
Analysis of Rater Severity on Written Expression Exam Using Many Faceted Rasch Measurement
Prieto, Gerardo; Nieto, Eloísa
Psicologica: International Journal of Methodology and Experimental Psychology, v35 n2 p385-397 2014
This paper describes how a Many Faceted Rasch Measurement (MFRM) approach can be applied to performance assessment focusing on rater analysis. The article provides an introduction to MFRM, a description of MFRM analysis procedures, and an example to illustrate how to examine the effects of various sources of variability on test takers' performance on a writing test by means of a MFRM analysis. Results highlight the usefulness of the MFRM to detect raters that have extreme values on the severity continuum. MRFM provides a common metric for the facet scores (test takers, tasks, raters). This is advantageous because it facilitates understanding of the assessment process as well as providing objective measurement of facet elements.
Descriptors: Item Response Theory, Interrater Reliability, Rating Scales, Error of Measurement, Statistics, Statistical Analysis, Scoring Rubrics, Spanish, Second Language Learning, Language Tests, Writing Tests
University of Valencia. Dept. Metodologia, Facultad de Psicologia, Avda. Blasco Ibanez 21, 46010 Valencia, Spain. Tel: +34-96-386-4100; Web site: http://www.uv.es/revispsi/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A