ERIC Number: EJ1389495
Record Type: Journal
Publication Date: 2023
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0973
EISSN: EISSN-1940-0683
You Can't Compare if You Don't Prepare: Differential Item Functioning in Measures of Grit, STEM Self-Regulation, and Motivation
Gladstone, Jessica R.; Morell, Monica; Yang, Ji Seung; Ponnock, Annette; Turci Faust, Lara; Wigfield, Allan
Journal of Experimental Education, v91 n3 p557-575 2023
Researchers developing questionnaire measures of personality, motivation, and self-regulation constructs related to students' achievement and persistence in STEM or other fields rarely have examined whether the items on the measures used are functioning differently across groups, which is necessary for accurate group comparison. The present study assessed differential item functioning (DIF) in two frequently-used measures of such constructs, the Grit-S, the Motivated Strategies for Learning Questionnaire (MSLQ), and a new measure of long-term grit, using a sample of 1,146 ninth and tenth-grade students in the U.S.A. We also assessed gender and racial differences in the patterns of the relationships among the latent constructs, something rarely reported in the literature. Differences in such patterns indicate that the concurrent validity of the construct scores could vary across different groups. Results indicated that numerous items exhibited gender DIF on the Grit-S but not on the MSLQ or long-term grit measure. There were fewer DIF items across racial groups. Patterns of relations among the variables, in general, were weaker for females than males. There were fewer racial groups differences in the patterns of correlations. We discuss the implications of the DIF findings for future research on group comparisons.
Descriptors: Test Bias, STEM Education, Test Items, Student Characteristics, Grade 9, Grade 10, High School Students, Gender Differences, Racial Differences, Ethnicity, Questionnaires, Academic Achievement, Self Management, Student Motivation, Beliefs, Persistence, Self Efficacy, Student Attitudes
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 9; High Schools; Junior High Schools; Middle Schools; Secondary Education; Grade 10
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Motivated Strategies for Learning Questionnaire
Grant or Contract Numbers: 1534846