We propose a new framework for conceptualizing measures of instructed second language (L2) pronunciation performance according to three sets of parameters: (a) the constructs (focused on global vs. specific aspects of pronunciation), (b) the scoring method (human raters vs. acoustic analyses), and (c) the type of knowledge elicited (controlled vs.…

Classroom observations have been increasingly used for teacher evaluations, and it is important to examine the measurement quality and the use of observation ratings. When a teacher is observed in multiple classrooms, his or her observation ratings may vary across classrooms. In that case, using ratings from one classroom per teacher may not be…

Developmental science demonstrates that younger children (ages 4 to 8) are capable of making meaning of their contexts and the self. Yet, younger children's meaning making is largely absent from intervention and implementation research on early childhood policies. This absence is notable given the rise in investment in early childhood policies and…

Creativity is a 21st-century skill that is receiving increasing attention in schools. One of the key issues that needs to be solved to facilitate the education of creativity is its' measurement. There is however ongoing controversy on the measurement of creativity. This is an issue of debate concerning both children, adolescents' and adults'…

This is a response to a focus article by Briggs and Peck (2015) in issue 13(2). It should have been published in issue 13(3-4) alongside a rejoinder by Briggs and Peck that did appear. Due to an oversight, it was not published there and appears here. See issue 13(3-4) for a rejoinder to this response. Briggs and Peck (2015) propose what amounts to…

Although much research has compared the functioning between analytic and holistic rating scales, little research has compared the functioning of binary rating scales with other types of rating scales. This quantitative study set out to preliminarily and comparatively validate binary and analytic rating scales intended for use in formative…

This article outlines a procedure for examining the degree to which a common factor may be dominating additional factors in a multicomponent measuring instrument consisting of binary items. The procedure rests on an application of the latent variable modeling methodology and accounts for the discrete nature of the manifest indicators. The method…

More and more domains such as industry, sport, medicine, Human Computer Interaction (HCI) and education analyze user motions to observe human behavior, follow and predict its action, intention and emotion, to interact with computer systems and enhance user experience in Virtual (VR) and Augmented Reality (AR). In the context of human learning of…

The concept of treatment integrity is an essential component to databased decision making within a response-to-intervention model. Although treatment integrity is a topic receiving increased attention in the school-based intervention literature, relatively few studies have been conducted regarding the technical adequacy of treatment integrity…

It is challenging to document the behavior changes that result from Extension programming. This article describes an evaluation method we call the "action items method." Unlike other approaches for measuring behavior change, this method requires program participants to define their own action plans as part of a program and then asks them…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

Altmetrics are tools for measuring the impact of research beyond scientific communities. In general, they measure online mentions of scholarly outputs, such as on online social networks, blogs, and news sites. Some stakeholders in higher education have championed altmetrics as a new way to understand research impact and as an alternative or…

This article reviews contemporary research on multimedia learning that uses cognitive load theory as the major theoretical framework. In particular, we address the extent to which working memory has been conceptualized and measured in this research, what kind of subjective measures of cognitive load have been used and whether such measures are…

Background: Service learning is an educational pedagogy that provides students with an opportunity to apply classroom knowledge to real-life situations. There are three components of service learning: course outcomes, service, and reflection. One barrier to incorporating service learning into nursing curriculum is the lack of a standardized…

Basic Course Directors (BCDs) are typically expected to assess course learning outcomes, but few formal guidelines and resources exist for new BCDs. As one part of a larger, multi-methodological assessment tool development project, this manuscript maps existing quantitative measures onto the six essential competencies and associated learning…