Open-ended verbal creativity assessments are commonly administered in psychological research and in educational practice to elementary-aged children. Children's responses are then typically rated by teams of judges who are trained to identify original ideas, hopefully with a degree of inter-rater agreement. Even in cases where the judges are…

Three preregistered studies examined whether 5-year-old children cheat consistently or remain honest across multiple math tests. We observed high consistency in both honesty and cheating. All children who cheated on the first test continued cheating on subsequent tests, with shorter cheating latencies over time. In contrast, 77% of initially…

Running Records provide a standardized method for recording and assessing students' oral reading behaviors and are excellent formative assessment tools to guide instructional decision-making. This study expands on prior Running Record reliability work by evaluating the extent to which external raters and teachers consistently assessed students'…

In this study, various statistical indexes of agreement were calculated using empirical data from a group of evaluators (n = 45) of early childhood teachers. The group of evaluators rated ten fictitious teacher profiles using the North Carolina Teacher Evaluation Process (NCTEP) rubric. The exact and adjacent agreement percentages were calculated…

This study details the construction of parameters for generating subskill mastery math measures to be used for screening, intervention planning, progress monitoring, and proximal program evaluation. Parameters for generating assessment measures were built and tested to verify initial equivalence of generated measures using potential digits correct…

Empirical research on number sense to date has been conducted with preschoolers and elementary school students. Despite their contributions to the literature, these studies have used variable-centered analytic approaches that may prevent distinct number sense profiles for preschoolers and first graders from being identified. This study aimed to…

Engaging in design thinking activities has been increasingly viewed as important for the craft of teaching for early childhood practitioners. However, reliable and valid measurements for this are lacking. As such, this research aims to develop and validate a design thinking engagement scale (DTES) to assess teachers' engagement in design thinking.…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

Vocabulary skills are important for overall reading competence, but vocabulary assessment approaches that inform instructional decision-making and are sensitive to improvement are limited. This article describes a process for developing vocabulary measures designed to facilitate data-driven decision-making for kindergarten and first-grade students…

Instructional coaching, informed by observation tools that measure teachers' practices, has been effective in improving teaching quality in early learning programs. However, existing measurement tools limit teachers' abilities to implement this type of instructional coaching at scale. To address this challenge, a team at SRI Education, along with…

This paper reports on a design oriented study conducted in close collaboration between two researchers and three preschool teachers. Within this study, a play-based interview script was designed in accordance with theoretically driven principles. Based on this script, the preschool teachers conducted interviews with children from three preschools…

The aim of the study is to develop a Likert-type scale to determine the play preferences of children attending pre-school education. The research was designed and carried out according to the survey research model. Data collected from 3 different study groups were used in the scale development process. The study groups consist of parents of…

Average age of autism diagnosis exceeds four years (Maenner et al., 2020), delaying access to services and limiting early developmental research (Zwaigenbaum et al., 2015; Fletcher-Watson et al., 2017). Autism screening in early childhood settings may be a tool for enabling earlier, equitable diagnosis. This systematic review investigated the…

A major challenge to promoting effective early science and engineering education is the lack of reliable and validated assessments that align with current educational guidelines for science and engineering. Existing early science and engineering assessments either cover a narrow range of concepts and practices and/or are not designed in a way to…

Several school districts in Georgia use two teacher-administered diagnostic assessments of student knowledge of mathematics as part of their multi-tiered system of support in grades K-8: the Global Strategy Stage (GloSS; New Zealand Ministry of Education, 2012) and the Individual Knowledge Assessment of Number (IKAN; New Zealand Ministry of…