ERIC Number: EJ1401158
Record Type: Journal
Publication Date: 2023
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0734-2829
EISSN: EISSN-1557-5144
Evaluating the Language- and Culture-Related Construct-Irrelevant Variance and Reliability of the Sense of School Belonging Scale: Suggestions for Revision
Huang, Jinyan; Dong, Yaxin; Han, Chunwei; Wang, Xiaojun
Journal of Psychoeducational Assessment, v41 n8 p852-871 2023
Using expert reviews and item response theory (IRT), this study evaluated the language- and culture-related construct-irrelevant variance and reliability of the 2019 TIMSS sense of school belonging scale (SSBS) for grades 4 and 8. The five items of the SSBS, which were identical for both grades, were reviewed for the language- and culture-related construct-irrelevant variance evidence by 10 assessment experts who have expertise in Chinese and English languages and cultures. Further, the existing TIMSS 2019 SSBS data associated with the countries of China (Hong Kong), Singapore, Australia, and America were analyzed within the framework of IRT for estimating the item and scale information function values (i.e., reliability) of the SSBS. The experts did find language- and culture-related evidence in each of the five items that might lead to the construct variance of the SSBS across these four countries. The IRT results further indicated that the SSBS item and scale information function values varied considerably across these four countries. Suggestions for revising the SSBS are proposed for TIMSS program developers.
Descriptors: Construct Validity, Test Reliability, Achievement Tests, Foreign Countries, International Assessment, Elementary Secondary Education, Measures (Individuals), Grade 4, Grade 8, Item Response Theory, Cultural Differences, Student School Relationship, English, Chinese
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://bibliotheek.ehb.be:2993
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education; Elementary Education; Grade 4; Intermediate Grades; Grade 8; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Hong Kong; Singapore; Australia; United States
Identifiers - Assessments and Surveys: Trends in International Mathematics and Science Study
Grant or Contract Numbers: N/A