To address the computational constraints of parameter estimation in the polytomous Cognitive Diagnosis Model (pCDM) in large-scale high data volume situations, this study proposes two two-stage polytomous attribute estimation methods: P_max and P_linear. The effects of the two-stage methods were studied via a Monte Carlo simulation study, and the…

Deciding whether two different face photographs or voice samples are from the same person represent fundamental challenges within applied settings. To date, most research has focussed on average performance in these tests, failing to consider individual differences and within-person consistency in responses. Here, participants completed the same…

Purpose: This study aims to describe how the Army and the Army Medical Department matured as a learning organization (LO) during the period after the 2014 Military Health System Review through the incorporation of changes aimed at improving patient safety, data transparency and becoming a high-reliability organization (HRO). This study explores…

Behavior rating scales are frequently used to assess social-emotional behaviors of children. While broadband behavior rating scales often measure similarly named constructs, it is unclear how consistently different instruments measure those constructs. Head Start teachers completed the preschool versions of the Behavior Assessment System for…

In two experiments, the multimedia contradiction paradigm was used to investigate whether learners map information conveyed through the audio and the picture track of a video. In Experiment 1 (N = 85), the information conveyed through the audio track and the picture track was always consistent (control group) or was made inconsistent by changing…

This study examined the factor structure of the Detroit Tests of Learning Abilities, Fifth Edition (DTLA-5) using principal axis factoring, multiple factor extraction criteria, and the Schmid-Leiman orthogonalization procedures not utilized by test publishers. Results suggest that the publisher's six-factor structure model was over factored.…

The tradition of qualitative research drives much of chemistry education research activity. When performing qualitative studies, researchers must demonstrate the trustworthiness of their analysis so researchers and practitioners consuming their work can understand if and how the presented research claims and conclusions might be transferable to…

A methodologically sound systematic review is characterized by transparency, replicability, and a clear inclusion criterion. However, little attention has been paid to reporting the details of interrater reliability (IRR) when multiple coders are used to make decisions at various points in the screening and data extraction stages of a study. Prior…

This investigation provides internal consistency reliabilities for the Wechsler Memory Scale--Fourth Edition (WMS-IV) subtest and index discrepancy scores using the standardization samples of the Adult and Older Adult batteries. Subtest reliabilities ranged from 0.00 to 0.93 for Adults and 0.25 to 0.94 for Older Adults. Three of 91 Adult…

For some students, standardized tests serve as a conduit to disclose sensitive issues of harm or distress that may otherwise go unreported. By detecting this writing, known as "crisis papers," testing programs have a unique opportunity to assist in mitigating the risk of harm to these students. The use of machine learning to…

This article proposes a Boolean approach to representing and analyzing interobserver agreement in dichotomous coding. Building on the notion that observations are samples of a universe of observations, it submits that coding can be viewed as a process in which observers sample pieces of evidence on constructs. It distinguishes between formal and…

Purpose: The reliability of auditory-perceptual judgments between listeners is a long-standing problem in the assessment of voice disorders. The purpose of this study was to determine whether a relatively novel experimental scaling method, called visual sort and rate (VSR), yielded stronger reliability than the more frequently used method of…

The paper proposes new measures of difficulty and discriminating values of binary items and test consisting of such items and find their relationships including estimation of test error variance and thereby the test reliability, as per definition using cosine similarities. The measures use entire data. Difficulty value of test and item is defined…

The aim of this study is to develop a valid and reliable measurement tool that can be used to measure the level of school principals' micromanagement behavior. After a comprehensive literature review, a candidate item pool with 52 items was created. While writing the items, micro-manager behaviors defined in the literature were adapted to school…

Purpose: Given that the current sustainability assessment in higher education institutions primarily relies on qualitative methods with relatively limited quantitative tools, the purpose of this study is to design a tool that could be used to comprehensively assess the overall state of higher education institutions' sustainability.…