ERIC Number: EJ1449021
Record Type: Journal
Publication Date: 2024-Sep
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: EISSN-1745-3984
A Nonparametric Composite Group DIF Index for Focal Groups Stemming from Multicategorical Variables
Corinne Huggins-Manley; Anthony W. Raborn; Peggy K. Jones; Ted Myers
Journal of Educational Measurement, v61 n3 p432-457 2024
The purpose of this study is to develop a nonparametric DIF method that (a) compares focal groups directly to the composite group that will be used to develop the reported test score scale, and (b) allows practitioners to explore for DIF related to focal groups stemming from multicategorical variables that constitute a small proportion of the overall testing population. We propose the nonparametric root expected proportion squared difference (REPSD) index that evaluates the statistical significance of composite group DIF for relatively small focal groups stemming from multicategorical focal variables, with decisions of statistical significance based on quasi-exact p values obtained from Monte Carlo permutations of the DIF statistic under the null distribution. We conduct a simulation to evaluate conditions under which the index produces acceptable Type I error and power rates, as well as an application to a school district assessment. Practitioners can calculate the "REPSD" index in a freely available package we created in the R environment.
Descriptors: Nonparametric Statistics, Test Bias, Scores, Statistical Significance, Research Design, Predictor Variables, School Districts, Evaluation Methods, Monte Carlo Methods
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A