ERIC Number: EJ1098651
Record Type: Journal
Publication Date: 2008
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0973-2217
EISSN: N/A
Better Quality in Assessments: Consideration of Contextual Effects on Item Bias and Differential Item Functioning
Vaughn, Brandon K.
Journal on School Educational Technology, v4 n2 p29-39 Sep-Nov 2008
This study considers the importance of contextual effects on the quality of assessments on item bias and differential item functioning (DIF) in measurement. Often, in educational studies, students are clustered in teachers or schools, and the clusters could impact psychometric issues yet are largely ignored by traditional item analyses. A statistical model for incorporating these cluster effects will be presented. By considering DIF from this perspective, it is possible for DIF to be consistent or vary across clusters (e.g., teachers or schools). By using this model, researchers can be shown much more detail into the nature and source of DIF and provide greater quality in the analysis and use of their assessments. This can be of benefit in determining whether the nature of DIF is exclusively due to student attributes, or a particular combination of student and school attributes. In addition to this, DIF may exist only among clusters, but not for students. This is an extra detection not possible with traditional DIF analysis. For example, in some educational situations, DIF may not exist among the subjects of interest, but in certain type of schools. The use of this procedure will be demonstrated using real assessment data.
Descriptors: Test Bias, Educational Assessment, Educational Quality, Context Effect, Item Analysis, Social Environment, Hierarchical Linear Modeling, Regression (Statistics), Item Response Theory, Probability, Bayesian Statistics, Scores, Grade 12
i-manager Publications. 3-343 Hill View, Town Railway Nagar, Nagercoil 629001, Tamil Nadu, India. Tel: +91-4652-276675; e-mail: info@imanagerpublications.com; Web site: http://www.imanagerpublications.com
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 12; Secondary Education; High Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A