ERIC Number: EJ1395732
Record Type: Journal
Publication Date: 2023
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0973
EISSN: EISSN-1940-0683
Integrating Bifactor Models into a Generalizability Theory Based Structural Equation Modeling Framework
Journal of Experimental Education, v91 n4 p718-738 2023
Although generalizability theory (GT) designs have traditionally been analyzed within an ANOVA framework, identical results can be obtained with structural equation models (SEMs) but extended to represent multiple sources of both systematic and measurement error variance, include estimation methods less likely to produce negative variance components, and correct for score coarseness. In research reported here, we integrated principles of bifactor modeling into a GT-SEM framework to partition systematic variance for subscale and composite scores into general and group factor effects and measurement error into multiple components. GT-bifactor modeling allowed for partitioning of variance at different levels of aggregation, clearer definitions of constructs within sampled domains, extended indices of score consistency, insights into composite and subscale score viability, and markers for best enhancing score consistency. Results for domain and facet scores from the recently updated form of the Big Five Inventory highlighted the importance of taking all sources of measurement error into account and the diagnostic benefits of GT-bifactor designs over conventional univariate and multivariate GT designs. Findings further revealed that corrections for scale coarseness noticeably enhanced overall score consistency by reducing specific-factor and random-response measurement error. We provide code in R for applying all illustrated designs in a detailed online supplement.
Descriptors: Generalizability Theory, Structural Equation Models, Programming Languages, Scores, Error of Measurement, Personality Measures, Reliability, Factor Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Big Five Inventory
Grant or Contract Numbers: N/A