Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate…

Fierce competition, globalization, and technology innovation have forced software companies to search for new ways to improve competitive advantage. Web-based learning is increasingly being used by software companies as an emergent approach for enhancing the skills of knowledge workers. However, the current practice of Web-based learning is…

Although there is an increasing number of online tests in the world, little research is currently known in Spain today. Assessment has become an integral part of education and the implications of the various uses of language testing go beyond the educational settings (Douglas, 2010; Fulcher, 2010). This study describes the PAULEX project. This…

Videoconferencing offers new opportunities for language testers to assess speaking ability in low-stakes diagnostic tests. To be considered a trusted testing tool in language testing, a test should be examined employing appropriate validation processes [Chapelle, C.A., Jamieson, J., & Hegelheimer, V. (2003). "Validation of a web-based ESL…

Harvey and Evans (2003) have proposed that teachers' emotional skills, as required in the classroom, can be organized into a five-dimensional model. Further research is necessary to validate this model and evaluate the importance of each dimension of teacher emotion competence for educational practice. Using a statistical method for mapping…

This study tests the temporal stability and the concurrent and predictive validity of the Emotional and Personality-related Career decision-making Difficulties (EPCD) model and questionnaire. Five hundred forty-three participants filled out the EPCD twice, 3 years apart. The Anxiety cluster was the most stable of the three, followed by the…

The measurement of treatment integrity is critical to evaluate the efficacy and effectiveness of evidence-based programs (EBPs) designed to improve the developmental outcomes of young children at risk of emotional/behavioral disorders. Unfortunately, the science of treatment integrity measurement lags behind the development and evaluation of EBP…

This research is conducted to examine what is currently evaluated with respect to teaching in Nigerian public universities and to produce instruments that would be useful for examining the course and teaching effectiveness of course lecturers. Telephone interview of ten (10) professors in ten public Nigerian Universities is used to elicit…

A sample of 276 students enrolled in campus leadership programs completed the Emotional Competence Inventory-University Edition (ECI-U) and the Socially Responsible Leadership Scale (SRLS) as a means to determine the relatedness in college students of emotional intelligence (EI) to the practice of post-industrial leadership skills. Confirmatory…

Previous research on the effectiveness of clickers has found their use to be positively associated with exam scores but not without methodological issues that hinder the conclusions that can be drawn. To address these limitations, the current studies isolated the effects of clickers from the effects of questions presented with clickers. Study 1…

In this paper, we report on a study to quantify the impact on student learning and on student assessment literacy of a brief assessment literacy intervention. We first define "assessment literacy" then report on the development and validation of an assessment literacy measurement instrument. Using a pseudo-experimental design, we…

Each year a great many evaluations are conducted of international development efforts around the world. These development evaluations study projects, programs, country-wide portfolios, policy reform efforts, and other topics of interest to funders, governments, program managers, and other involved stakeholders. Although some of these evaluations…

Following Messick's definition of validity as a multi-faceted construct that includes contextual, substantive, structural, generalizable, external, and consequential dimensions, this study examined an established directed self-placement (DSP) system that had been functioning for ten years at a large university. The goal was to determine the extent…

To monitor and evaluate program success and to provide teachers with a tool that could support their transformation in teaching practice, we needed an effective and valid protocol to measure the quantity and quality of inquiry-based instruction being led. Existing protocols, though helpful, were either too generic or too program specific.…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…