In 2012, this author published a paper describing a method for using the raw data from Web of Science to examine the journals cited by any given group of researchers and then compare that list to lists of 'top journals' of similar disciplines. It was not a straightforward method to use and required a great deal of effort and spreadsheet work by a…

Emotions are a core semantic component of human communication. Since counsellors are humans we assume that their own state of emotions could affect their intuitional effort when taking decisions concerning their clients. Therefore, the accuracy of detected emotions by counsellors could be doubtful. And this highlights the need for complementing…

Effect sizes are powerful tools for evaluating the practical importance of study findings that should be considered in the context of study characteristics such as participants, dependent variables, and comparison condition. In this article, we discuss how group-difference effect sizes are used to gauge the practical importance of group…

Evaluation is defined by its central task of valuing--the process and product of judging the merit, worth, or significance of a policy or program. However, there are no clear-cut ways to consider values and render value judgments in evaluation practice. There remains contention in the evaluation field about whether and how to make value judgments.…

I argue that teaching evaluation tools (TETs) may function as ethical codes (ECs), and answer certain demands that ECs cannot sufficiently fulfill. In order to be viable, an EC related to the teaching profession must assume a different form, and such a form is already present in several of the contemporary TETs. The TET matrix form allows for…

Evaluators frequently confront situations in which local programs struggle to meet the expectations and requirements specified by the external program funder. How can evaluators meaningfully evaluate programs (for both the funder and grantee) in situations in which the external program logic clashes with local complexities? This paper discusses…

Various subscore estimation methods that use auxiliary information to improve subscore accuracy and stability have been developed. This report provides a review of various subscore estimation methods described in the literature. The methodology of each method is described, then research studies on these subscore estimation methods are summarized.…

The aim of the present research study was to compare the findings from the nonparametric MSA, DIMTEST and DETECT and the parametric dimensionality determining methods in various simulation conditions by utilizing exploratory and confirmatory methods. For this purpose, various simulation conditions were established based on number of dimensions,…

This chapter will value of including diverse voices of researchers. An innovative, cost-effective model for assessment will be described, capturing the process implemented at a university in its efforts to center social justice within assessment and evaluation research practices.

There has been some research in the use of propensity scores in the context of measurement error in the confounding variables; one recommended method is to generate estimates of the mis-measured covariate using a latent variable model, and to use those estimates (i.e., factor scores) in place of the covariate. I describe a simulation study…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…

Purpose: In the current education context, quality management has increasingly become a key element and more educational organizations are deciding to implement a Quality Management System. Because there are so few studies on the impact that implementation has on educational institutions, the main objective of this paper is to profile educational…

The proposed session sought to engage participants in a discussion about building assessment practices with students, as opposed to for students. Critical pedagogy may provide one way to redefine this previously uni-directional practice (Keesing-Styles, 2003). This approach concentrates student experience at the center of assessment, causing a…

Network meta-analysis (NMA) uses both direct and indirect evidence to compare the efficacy and harm between several treatments. Structural equation modeling (SEM) is a statistical method that investigates relations among observed and latent variables. Previous studies have shown that the contrast-based Lu-Ades model for NMA can be implemented in…

Group work, where students work on projects to overcome challenges together, has numerous advantages, including learning of important transferable skills, better learning experience and increased motivation. However, in many academic systems the advantages of group projects clash with the need to assign individualised marks to students. A number…