ERIC Number: EJ1315941
Record Type: Journal
Publication Date: 2021-Dec
Pages: 38
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-4308
EISSN: N/A
Development and Validation of an Observation-Based Protocol to Measure the Eight Scientific Practices of the Next Generation Science Standards in K-12 Science Classrooms
Chen, Ying-Chih; Terada, Takeshi
Journal of Research in Science Teaching, v58 n10 p1489-1526 Dec 2021
The eight scientific practices in the Next Generation Science Standards (NGSS) are significant theoretical constructs that reflect the nature of science; they are intended to guide science teaching and learning. Yet, operationalization of these practices in terms of student learning remains limited, and a measurement tool for the eight practices is needed. Using an "Interactive-Constructive-Active-Passive" (ICAP) theoretical framework, this study develops such a protocol, entitled ICAP to Measure by Observation NGSS Science Practice Implementation in the Classroom (IONIC). This protocol can be applied in K-12 science classrooms to determine the level of student engagement with the eight practices. Data were collected from 152 video-recorded lessons obtained after a 3-year professional development (PD) program designed to engage teachers to better understand and use the NGSS practices. We examined validity ("content, face, translation, and construct") and reliability ("internal and interrater") of IONIC. Confirmatory factor analysis was conducted to verify three competing theoretical models: Parsimonious (three phases of knowledge development: "Investigation, Sensemaking, and Evaluating and Communicating," merged with the eight NGSS practices), NGSS (the eight practices), and "Comprehensive." The latter consists of an upper-level ("Parsimonious") and a lower-level (NGSS). The results suggest the Comprehensive Model is the preferred model among the three. In the upper-level, the score for "Phase 3, Evaluating and communicating," is significantly lower than the other two. In the lower-level, classroom scores for "Practice 5, Using mathematics and computational thinking," "Practice 7, Engaging in argument from evidence," and "Practice 8, Obtaining, evaluating, and communicating information," are significantly lower than most of the others. Results of regression analyses suggest that the number of years the teacher participated in PD can predict student IONIC scores. The findings suggest that IONIC is a valid and reliable observation-based protocol, facilitating an understanding of how students can effectively engage in scientific practices in the classroom.
Descriptors: Test Construction, Test Validity, Observation, Science Education, Academic Standards, Elementary Secondary Education, Scientific Concepts, Learner Engagement, Test Reliability, Factor Analysis, Teacher Evaluation
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A