ERIC Number: EJ1436179
Record Type: Journal
Publication Date: 2024-Sep
Pages: 48
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-4308
EISSN: EISSN-1098-2736
Development of "VAScoR": A Rubric to Qualify and Score Responses to the Views of Nature of Science ("VNOS") Questionnaire
Journal of Research in Science Teaching, v61 n7 p1641-1688 2024
We report on the development of a rubric to reliably qualify and score responses to the "Views of Nature of Science Questionnaire" (VNOS): The "VNOS Analysis and Scoring Rubric" (VAScoR). The "VAScoR" is designed to (a) provide systematic guidance for the qualitative analysis, and score assignment to nuanced categories, of "VNOS" responses, (b) explicitly scaffold qualitative inferencing and standardize score assignment to substantially lessen the burden of, and variance in, analyzing and scoring the "VNOS," and (c) improve the viability and meaningfulness of cross-study comparisons drawing on "VNOS" data. The rubric adopted the "VNOS's" consensus NOS framework and further delineated core and related elements across 10 target NOS aspects. The "VAScoR's" reliability was examined in two studies that drew on "VNOS" questionnaires completed by 185 preservice secondary science teachers (58% female; 126 undergraduate and 59 graduate students) enrolled over several years in a combined undergraduate and graduate licensure program in a large U.S. Midwestern university. In Study I, "VAScoR" analyses of 86 "VNOS" questionnaires undertaken by a single author were used to examine the rubric's intra-rater reliability, which resulted in a robust Cronbach's alpha value of 0.81. In Study II, analyses by four authors of a randomly generated, overlapping set of 18 questionnaires were used to examine inter-rater reliability, which was supported with substantial consensus among raters as indicated by a Cohen's kappa of 0.71. Further evidence for the "VAScoR's" inter-rater reliability was indicated by moderate to strong consistency among four raters with an overall Pearson's correlation coefficient of 0.82, and coefficient values ranging from 0.77 to 0.89 for six possible rater pairings.
Descriptors: Measures (Individuals), Questionnaires, Scientific Principles, Scoring Rubrics, Reliability, Preservice Teachers, Secondary School Teachers, Science Teachers, Undergraduate Students, Graduate Students, Teacher Education Programs, Universities, Development, Scores
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A