Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Background/Purpose: The study aimed to develop a rubric to measure students' critical-thinking skills within a multicultural education scope. Materials/Methods: The study's participants were faculty members, teachers, and students, determined according to convenience sampling based on predetermined criterion. Initially, a story-based test and…

This study aims to develop an instrument that measures democratic attitudes levels in primary school students in third and fourth grades. This study involved 591 students (302 for exploratory factor analysis, 289 for confirmatory factor analysis) enrolled in the 3rd and 4th grades. A literature review was conducted to prepare the scale items, and…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

Few assessment tools have been designed to assess motor creativity, and the existing tools have limitations. To bridge this gap, the current study aimed at designing a new movement creativity assessment tool that considers the unique features underlying the expression of creativity through movement. A modified Delphi technique was used to collect…

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

Reading motivation is an important contributor to reading achievement. Students with higher levels of motivation tend to outperform those with lower levels. Reading motivation is a dynamic, situational, context-dependent trait that can vary in children over time and across tasks. Teachers have a valuable opportunity to support students' reading…

Student growth percentiles (SGPs) are currently used by several states and school districts to provide information about individual students as well as to evaluate teachers, schools, and school districts. For SGPs to be defensible for these purposes, they should be reliable. In this study, we examine the amount of systematic and random error in…

Children's attitudes are shaped by the information to which they are exposed. To foster improved peer relationships in inclusive settings, there is a need for typically developing children to exhibit positive attitudes toward peers with disabilities. The aim of this study was to examine the relationship between children's attitudes toward their…

The purpose of this research is to determine the self-regulation behaviors demonstrated by the 4th grade students in the writing process within the scope of peer-assisted writing activities. The aims of this research include developing a measurement tool to identify the self-regulation behaviors exhibited by primary school students during the…

This in-brief technical report documents the results from two different analytic approaches for examining the reliability of the slope for easyCBM® math measures in Grades K-8. Results varied by grade, assessment measure, and the analytic approach. Results patterns are discussed.

Computerized game-based assessment (GBA) system for screening reading difficulties may provide substantial time and cost benefits over traditional paper-and-pencil assessment while providing means also to individually adapt learning content in educational games. To study the reliability and validity of a GBA system to identify struggling readers…

This study assessed the effectiveness of an online-merge-offline Jamboard application as an innovation in teaching word problems to Grade 4 learners was evaluated in this study. The research evaluates a learner's level of mathematical word problem skills in terms of understanding, devising a plan, solving a problem, and interpreting, as well as…