Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

In a recent contribution to "Sociological Methods & Research," Baumgartner and Epple (B&E) employ Coincidence Analysis (CNA) to explain the outcome of the vote on the Swiss minaret initiative of 2009. Although the authors also present a substantive argument, their principal objective is to prove the superiority of CNA over…

This study records findings of a study carried out in a group of 100 students at a South African university. This study examines the group's assignments as a way of gathering evidence about pre-service teachers' achievements in the process of education and training. The empirical study was based on comparative analysis of scores obtained by…

In the present study, two types of curriculum-based measurement (CBM) tools in science, Vocabulary Matching (VM) and Statement Verification for Science (SV-S), a modified Sentence Verification Technique, were compared. Specifically, this study aimed to determine whether the format of information presented (i.e., SV-S vs. VM) produces differences…

In this paper the authors analyse the competency of a sample of economics and business students in orally presenting academic content, as well as the changes that occurred after receiving feedback. The students' presentations were videotaped, and a total of 96 were analysed at three stages: pre-test, post-test and follow-up. The participants were…

Although some assessment modes have proved successful, many learning problems encountered by low achieving learners need to be fixed by a more procedurally adequate remedial classroom assessment. Many EFL instructors adopt conventional and static modes of assessment rather than flexible and humanistic assessment modes. Hence, the study aims at…

Personalized learning has become an important and powerful paradigm catering for various needs, styles, preferences, and modes of learning. Several methods including task recommendations and path planning have recently emerged to effectively implement personalized learning using e-learning systems. The literature shows that the use of task…

Since the establishment and development of translation and interpreting discipline in universities around the world, interpreting contests are held to (1) raise wild interests in interpreting activities; (2) promote interpreting training programs and interpreting pedagogy research; and (3) enhance individual's language proficiency and interpreting…

Research evidence suggests children experiencing adversity are at risk of language disparities in early childhood. This puts these children at risk of poor language outcomes, perpetuating disadvantage in later development and academic life. This study aimed to investigate associations between Early Childhood Education and Care (ECEC) attendance,…

The utility of teacher evaluation depends on meaningful teacher engagement with evaluation processes. However, critics of traditional tenure policies suggest that tenure nullifies teacher engagement with practices to improve performance. This study investigates whether tenured teachers exhibit perceptions that reflect disengagement with evaluation…

The use of controlled comparisons pervades comparative historical analysis. Heated debates have surrounded the methodological purchase of such comparisons. However, the quality and validity of the conceptual building blocks on which the comparisons are based have largely been ignored. This article discusses a particular problem pertaining to these…

Purpose: The purpose of this paper is to analyze the comprehensiveness of competing higher education sustainability assessments. Higher education institutions (HEIs) have been increasingly communicating their sustainability commitments to the public. To assist the public in evaluating these claims, a broad range of actors have assessed the…

The purpose of this study was to investigate the impact of a cheating prevention strategy employed for a professional credentialing exam that involved releasing over 7,000 active and retired exam items. This study evaluated: 1) If any significant differences existed between examinee performance on released versus non-released items; 2) If item…

This study outlines the development of the Design Log Instrument (DLI), which is intended for use in identifying moments of abstraction as evidence of STEM content knowledge transfer. The DLI prompts participants to be reflective during technological/engineering design challenges. During the development of this instrument, a three-phase,…

Research on the evaluation of large-scale public-sector reforms is rare. This article sets out to fill that gap in the evaluation literature and argues that it is of vital importance since the impact of such reforms is considerable and they change the context in which evaluations of other and more delimited policy areas take place. In our…