Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Background/Purpose: The study aimed to develop a rubric to measure students' critical-thinking skills within a multicultural education scope. Materials/Methods: The study's participants were faculty members, teachers, and students, determined according to convenience sampling based on predetermined criterion. Initially, a story-based test and…

This study aims to develop an instrument that measures democratic attitudes levels in primary school students in third and fourth grades. This study involved 591 students (302 for exploratory factor analysis, 289 for confirmatory factor analysis) enrolled in the 3rd and 4th grades. A literature review was conducted to prepare the scale items, and…

This study aims to develop a knowledge test to assess secondary school students' awareness of scientists. After determining the topics that the questions in the test would measure, 50 multiple-choice questions were prepared and presented to six experts in the field. Following the experts' feedback, the number of questions in the test was reduced…

This best-evidence synthesis appraises the design and outcome characteristics of vocabulary intervention studies conducted with preschool through 6th grade emergent bilingual (EB) children and spotlights rigorously designed studies for which effects could be better attributed to instructional features. Twenty-nine selected studies were analysed…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

This study aimed to develop a valid and reliable multiple-choice achievement test for the subject area of ecology. The study was conducted within the framework of exploratory sequential design based on mixed research methods, and the study group consisted of a total of 250 middle school students studying at the sixth and seventh grade level. In…

Few assessment tools have been designed to assess motor creativity, and the existing tools have limitations. To bridge this gap, the current study aimed at designing a new movement creativity assessment tool that considers the unique features underlying the expression of creativity through movement. A modified Delphi technique was used to collect…

This paper presents the development and psychometric properties of an interpersonal problem-solving inventory for Vietnamese elementary school students (IPSI). The IPSI consists of five subscales: Positive problem-solving behavior; Negative problem-solving behavior; Rational problem-solving behavior; Impulsive behavior; and Avoidance behavior. The…

This study was conducted to develop a valid and reliable measurement tool that can identify middle school students' self-regulation skills. Firstly, the literature was utilized in the development of the measurement tool. The form was finalized with the support of the opinions of different experts and a trial application. Then, the form was…

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

The purpose of this study was to develop and explore the factor structure of the Student Engagement in Social-Emotional Learning Skills (SE-SELS) survey, a newly designed assessment that assesses students' knowledge and use of five social-emotional learning skills (self-awareness, self-management, social awareness, relationship skills and…

In this study, a valid and reliable scale was developed to measure parents' perceptions of their children's social development in physical education classes. In the first part of the research, the relevant literature reviewed and student-parent interviews were held. As a result of the data obtained from the interviews, a 30-item draft scale was…