Open-ended verbal creativity assessments are commonly administered in psychological research and in educational practice to elementary-aged children. Children's responses are then typically rated by teams of judges who are trained to identify original ideas, hopefully with a degree of inter-rater agreement. Even in cases where the judges are…

Three preregistered studies examined whether 5-year-old children cheat consistently or remain honest across multiple math tests. We observed high consistency in both honesty and cheating. All children who cheated on the first test continued cheating on subsequent tests, with shorter cheating latencies over time. In contrast, 77% of initially…

The main aim of this study was to evaluate the Early Grade Writing Assessment for Kindergarten (EGWA-K), which is grounded in foundational literacy skills, for its validity and diagnostic accuracy in identifying children at risk of developing early learning disabilities in writing (LDW). To the best of our knowledge, no such tool exists for…

Running Records provide a standardized method for recording and assessing students' oral reading behaviors and are excellent formative assessment tools to guide instructional decision-making. This study expands on prior Running Record reliability work by evaluating the extent to which external raters and teachers consistently assessed students'…

In this study, various statistical indexes of agreement were calculated using empirical data from a group of evaluators (n = 45) of early childhood teachers. The group of evaluators rated ten fictitious teacher profiles using the North Carolina Teacher Evaluation Process (NCTEP) rubric. The exact and adjacent agreement percentages were calculated…

This study details the construction of parameters for generating subskill mastery math measures to be used for screening, intervention planning, progress monitoring, and proximal program evaluation. Parameters for generating assessment measures were built and tested to verify initial equivalence of generated measures using potential digits correct…

Empirical research on number sense to date has been conducted with preschoolers and elementary school students. Despite their contributions to the literature, these studies have used variable-centered analytic approaches that may prevent distinct number sense profiles for preschoolers and first graders from being identified. This study aimed to…

Engaging in design thinking activities has been increasingly viewed as important for the craft of teaching for early childhood practitioners. However, reliable and valid measurements for this are lacking. As such, this research aims to develop and validate a design thinking engagement scale (DTES) to assess teachers' engagement in design thinking.…

A short form of the 60-item computer-based orthographic processing assessment (long-form COPA or COPA-LF) was developed. The COPA-LF consists of five skills, including rapid perception, access, differentiation, correction, and arrangement. Thirty items from the COPA-LF were selected for the short-form COPA (COPA-SF) based on cognitive diagnostic…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

Vocabulary skills are important for overall reading competence, but vocabulary assessment approaches that inform instructional decision-making and are sensitive to improvement are limited. This article describes a process for developing vocabulary measures designed to facilitate data-driven decision-making for kindergarten and first-grade students…

Digital competencies are very significant in terms of integrating digital resources into educational processes. This study presents the validity and reliability of an instrument created by Carrera et al. (2011), in order to evaluate the basic digital competence of the three main educational agents of the educational community (teachers, students,…

Instructional coaching, informed by observation tools that measure teachers' practices, has been effective in improving teaching quality in early learning programs. However, existing measurement tools limit teachers' abilities to implement this type of instructional coaching at scale. To address this challenge, a team at SRI Education, along with…

This paper reports on a design oriented study conducted in close collaboration between two researchers and three preschool teachers. Within this study, a play-based interview script was designed in accordance with theoretically driven principles. Based on this script, the preschool teachers conducted interviews with children from three preschools…

The aim of the study is to develop a Likert-type scale to determine the play preferences of children attending pre-school education. The research was designed and carried out according to the survey research model. Data collected from 3 different study groups were used in the scale development process. The study groups consist of parents of…