It has become a critical question what the reliability level would be when open-ended questions are used in large-scale selection tests. One of the aims of the present study is to determine what the reliability would be in the event that the answers given by test-takers are scored by experts when open-ended short answer questions are used in…

The Social Emotional Health Survey-Secondary-2020 (SEHS-S-2020) is a well-studied option for assessing social emotional health to support students within a multitiered system of school support. While a growing body of literature supports the SEHS-S-2020 measure for assessing student covitality, there is less validation evidence specifically for…

Science process skills are an important part of scientific inquiry that need to be monitored so that pupils can improve their skills to do science. Although there are several science process skills tests mentioned in the literature, we decided to develop an online one in order to improve the usefulness of the test and enable autoscoring to reduce…

This study aims to develop a valid and reliable achievement test to measure the achievement of eighth-grade students in the "Seasons and Climate" unit of the science course. The research was carried out using a survey model. The study group consists of 298 eighth-grade students studying in various cities in Turkey in the 2020-2021…

This study contributes to the call for influencing practice by increasing attention to how learning environments can be designed to support learning in statistical inference. We report on a design experiment in secondary school (students 14-16 years old), that resulted in a set of lessons with the learning goal of teaching students how to apply…

This study aims to develop a knowledge test to assess secondary school students' awareness of scientists. After determining the topics that the questions in the test would measure, 50 multiple-choice questions were prepared and presented to six experts in the field. Following the experts' feedback, the number of questions in the test was reduced…

With the development of the Internet as a main source of information, teenagers are increasingly faced with multiple documents which may contain contradictory statements, and whose reliability must be assessed. One way to assess information reliability is to evaluate the source of the information (e.g., author expertise, intention). However,…

This study aimed to develop a STEM module for eighth-grade middle school learners through the engineering design process. The module was developed based on the ADDIE model, primarily concentrating on the stages of analysis, design and development. The study consisted of two main phases: module development and module evaluation. During the…

Understanding motivational beliefs such as expectancy and value that shape students' persistence and decision to pursue a STEM career, obtaining valid and reliable measures for these dimensions, and developing strategies using this data are critically important to ensure students' persistence in the STEM pipeline. Therefore, this study aims to…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

Compared to other content areas, there is a dearth of research examining curriculum-based measurement of writing (CBM-W). This study conducted a conceptual replication examining the reliability, stability, and sensitivity to growth of slopes produced from CBM-W. Eighty-nine (N = 89) eighth-grade students responded to one CBM-W probe weekly for 11…

This study sought to develop a valid and reliable measurement tool that measures the perceptions of behavioral dispositions in determining the high school preferences of 8th grade students. The study population consisted of 26,906 eight graders in public and private secondary schools located in the city centres of Aydin and Denizli, Turkey. The…

Students' science identity has been identified as an important construct that positively influences their learning engagement, persistence, and career intentions in science. This paper reported the process of developing and validating an instrument that can be used to assess high school students' science identity. The development of this…

Writing assessments often consist of students responding to multiple prompts, which are judged by more than one rater. To establish the reliability of these assessments, there exist different methods to disentangle variation due to prompts and raters, including classical test theory, Many Facet Rasch Measurement (MFRM), and Generalizability Theory…

A prior study developed the Computational Thinking Scale (CTS) for assessing individuals' computational thinking dispositions in five dimensions: decomposition, abstraction, algorithmic thinking, evaluation, and generalization. This study proposed the Developmental Model of Computational Thinking through validating the structural relationships…