Mokken Scale Analysis (MSA) is a nonparametric approach that offers exploratory tools for understanding the nature of item responses while emphasizing invariance requirements. MSA is often discussed as it relates to Rasch measurement theory, which also emphasizes invariance, but uses parametric models. Researchers who have compared and combined…

This study aimed to assess the methods and outcomes of The Measurement Tool to Assess systematic Reviews (AMSTAR) 2 appraisals in overviews of reviews (overviews) of interventions in the cardiovascular field and identify factors that are associated with these outcomes. MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews were searched…

This paper is motivated by a desire to advance assessment in the health professions through encouraging the judicious and productive use of metaphors. Through five specific examples (pixels, driving lesson/test, jury deliberations, signal processing, and assessment as a toolbox), we interrogate how metaphors are being used in assessment to…

The measurement of resistance training (RT) is often based on adaptations of aerobic physical activity measures which may not contain the elements necessary to assess RT. The purpose of this systematic review was to examine what measures are used to assess RT and appraise their composition. Specifically, the inclusion of frequency, duration,…

Researchers who use measurement models for evaluation purposes often select models with stringent requirements, such as Rasch models, which are parametric. Mokken Scale Analysis (MSA) offers a theory-driven nonparametric modeling approach that may be more appropriate for some measurement applications. Researchers have discussed using MSA as a…

Measurement invariance (MI) is an essential part of validity evidence concerned with ensuring that tests function similarly across groups, contexts, and time. Most evaluations of MI involve multigroup confirmatory factor analyses (MGCFA) that assume simple structure. However, recent research has shown that constraining non-target indicators to…

Using a bibliographic approach that employs a systematic literature review, this paper analyzes the state of the field for assessing transformative learning (TL). Assessing TL has always been challenging. Using the field of international education (IE) as a case study, this article leverages findings from the assessment of TL in IE to illustrate…

We investigated three different approaches for quantifying individual change and reporting it back to persons: (a) the common change score, which is obtained by first computing scale scores from two consecutive measurements and then subtract these scores from one another, (b) the ad-hoc approach, which is similar to the former approach but uses…

Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to…

Although most evaluators are familiar with participatory evaluation (PE), the ability to measure stakeholder participation in an evaluation remains challenging. Based on Cousins and Whitmore's (1998) PE theoretical model, Daigneault and Jacob (2009, 2012, 2014) developed an instrument for measuring the degree to which an evaluation can be…

Simulation studies are needed to investigate how many score categories are sufficient to treat ordered categorical data as continuous, particularly for bifactor models. The current simulation study aims to address such needs by investigating the performance of estimation methods in the bifactor models with ordered categorical data. Results support…

Dynamic structural equation models (DSEM) are designed for time series analysis of latent structures. Inherent to the application of DSEM is model parameter estimation, which has to be addressed in many applications by a single time series. In this context, however, the methods currently available either lack estimation quality or are…

Through a lens for engaged scholarship (Boyer in "Journal of Public Service and Outreach," 1(1), 11-20, 1996) this multiple case study (Merriam, 1996) explores the potential of scholarly podcasts for public knowledge dissemination, highlighting the misalignment of university impact metrics with this medium. Our team collected qualitative…

The sociologies of quantification, university rankings, and infrastructure are a loosely connected set of scholarly endeavors. Research in these areas typically examines production of certain types of quantification, their effects, and institutionalization. Despite these commonalities, scholars have noted a lack of conceptual coherence, debates on…

Objective: The objective of this study was threefold: (a) to create a rubric for response complexity (RC), defined as an admixture of response length, grammatical diversity, categorisation, and sophistication; (b) to measure behavioural and cognitive engagement through students' written responses on a school-based written activity, and (c) to…