Composite reliability, or coefficient omega, can be estimated using structural equation modeling. Composite reliability is usually estimated under the basic independent clusters model of confirmatory factor analysis (ICM-CFA). However, due to the existence of cross-loadings, the model fit of the exploratory structural equation model (ESEM) is…

In many performance assessments, one or two raters from the complete rater pool scores each performance, resulting in a sparse rating design, where there are limited observations of each rater relative to the complete sample of students. Although sparse rating designs can be constructed to facilitate estimation of student achievement, the…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

The validity of the Single-Item Self-Esteem Scale (SISE) in adolescents was not well established, and how self-esteem manifested in newly incarcerated juvenile delinquents was poorly described. Using a retrospective study with archival records, the SISE was compared to other measures of self-esteem, grit, mental health, and academic self-concept…

The research in the field of positive psychology is alive for children and adolescents, and especially the effects of intervention studies are promising. While a large number of instruments exist for adults, there is a need for greater attention to basic measurement work of constructs for children. The Satisfaction With Life Scale is one of the…

This study aimed at identifying patterns of the followership styles and their relation to the leadership styles of academic leaders as perceived by faculty members in public and private universities in northern Jordan. The researchers used the descriptive correlation approach. The Kelley's scale was adopted for the followership styles, and…

Fuzzy-set qualitative comparative analysis (fsQCA) has become one of the most prominent methods in the social sciences for capturing causal complexity, especially for scholars with small- and medium-"N" data sets. This research note explores two key assumptions in fsQCA's methodology for testing for necessary and sufficient…

Distractor analyses are routinely conducted in educational assessments with multiple-choice items. In this research report, we focus on three item response models for distractors: (a) the traditional nominal response (NR) model, (b) a combination of a two-parameter logistic model for item scores and a NR model for selections of incorrect…

The Ocean Literacy movement began in the U.S. in the early 2000s, and has recently become an international effort. The focus on marine environmental issues and marine education is increasing, and yet it has been difficult to show progress of the ocean literacy movement, in part, because no widely adopted measurement tool exists. The International…

As an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation.…

The purpose of this study was to develop an abbreviated version of the Perceived Motivational Climate in Exercise Questionnaire (PMCEQ-A) to provide a more practical instrument for use in applied exercise settings. In the calibration step, two shortened versions' measurement and latent model values were compared to each other and the original…

Research Findings: Despite it being a widely accepted measure of social, emotional, and behavioral problems among children and young people, the factor structure underlying the Strengths and Difficulties Questionnaire (SDQ) is contested. Recent research has suggested a need to consider methodological bias in the SDQ, associated with the positive…

This paper presents a method for equating writing assessments using pairwise comparisons which does not depend upon conventional common-person or common-item equating designs. Pairwise comparisons have been successfully applied in the assessment of open-ended tasks in English and other areas such as visual art and philosophy. In this paper,…

The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

The purpose of the present study is to compare the psychometric qualities of canonical single-response multiple-choice items with their double-response counterparts. Thirty, two-response fouroption grammar items for undergraduate students of English were constructed. A second version of the test was constructed by replacing one of the correct…