This paper reports a feasibility study on developing computer model-based assessments of chemical reasoning at the high school level. Computer models are flash and NetLogo environments to make simultaneously available three domains in chemistry: macroscopic, submicroscopic, and symbolic. Students interact with computer models to answer assessment…

We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

This investigation conducts measurement and evaluation of a multidimensional model of workplace motivation and engagement from a construct validation perspective. Two studies were conducted, one using the multi-item multidimensional Motivation and Engagement Scale-Work (N = 637 school personnel) and one using a parallel short form (N = 574 school…

The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation…

Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate…

The study explored the factors that relate to the likelihood of institutional researchers (IRs) to plan to leave their jobs. Learning more about the effects on IR job turnover can serve to improve the employment experience of IR practitioners, the profession of IR, and, indirectly, higher education. 1,264 IRs responded to a national survey…

Community engagement professionals and partners serve as, work with, study, and build the capacity of boundary spanners. To augment knowledge about these functions, the Weerts-Sandmann Boundary Spanning Conceptual Framework (2010) has been operationalized through a survey instrument to examine community engagement boundary-spanning behaviors by…

The reactions by Ridley and Shaw-Ridley (EJ832451) and Lichtenberg (EJ832452) to the authors' meta-analysis on the effects of experience on judgment accuracy add positively to what is hoped will become an ever more focused discourse on this most basic question: How can mental health clinical decision making be improved? In this rejoinder, the…

Within the field of educational technology, Technological Pedagogical Content Knowledge (TPACK) has been theorized as a seven-factor construct to describe teacher's integration of information and communication technology (ICT) in their teaching. However, this framework has yet to be successfully validated through survey instruments. This paper…

In 2001, Elliot and McGregor proposed a 2 x 2 (mastery-performance x approach- avoidance) achievement goal frameworks and developed a questionnaire to measure four goals (mastery-approach, mastery-avoidance, performance-approach, and performance-avoidance goals). This study examines the dual meanings of items in 2 x 2 achievement goal…

The objective of this study was to develop a model for building professional learning communities (PLCs) in schools. Samples were public primary schools that consisted of 1,826 teachers from 185 schools in Thailand. They randomized by using two-stage random sampling. The questionnaire was used to survey the level or magnitude of teacher…

The purpose of this study was to determine which of three competing models will provide, reliable, interpretable, and responsive measures of elementary students' understanding of the nature of science (NOS). The Nature of Science Instrument-Elementary (NOSI-E), a 28-item Rasch-based instrument, was used to assess students' NOS…

The present studies aimed to reexamine college students' achievement goal orientations by situating their motivation in a cooperative learning context. The authors proposed and validated a scale of 3 levels of trichotomous achievement goal orientations. In Study 1, confirmatory factor analyses supported that, in laboratory cooperative learning…

The Medical Specialty Preference Inventory (MSPI; Zimny, G.H. (1979). Manual for the Medical Specialty Preference Inventory. St. Louis, MO: St. Louis University School of Medicine), a measure of medical students' interests, was substantively and empirically examined to identify an underlying factor structure. A factor model for the original MSPI…