In this article, I report on examiners' views and experiences of using Pairwise Comparative Judgement (PCJ) and Rank Ordering (RO) as alternatives to traditional analytical marking for GCSE English Language essays. Fifteen GCSE English Language examiners took part in the study. After each had judged 100 pairs of essays using PCJ and eight packs of…

The present study investigated the impact of COVID-19 on middle level females enrolled in algebra in face-to-face instruction or virtual instruction during the 2020-2021 school year. The study analyzed the data from the required summative assessment for algebra students mandated by South Carolina Department of Education. Districts had flexibility…

University rankings have a growing impact on how people view the academic excellence of higher education. The complicated relationship between rankings and academic excellence is explored in this essay along with how it may affect higher education policy and practice. The importance of rankings and their influence on institutional decision-making…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

Comparative studies on paper and pencil--and computer-based tests principally focus on statistical analysis of students' performances. In educational assessment, comparing students' performance (in terms of right or wrong results) does not imply a comparison of problem-solving processes followed by students. In this paper, we present a theoretical…

In this study, an explanatory sequential design was utilized to examine the impact of strategy-based instruction (SBI) on the writing performance and motivation of English as a Foreign Language (EFL) learners in a writing course. A total of 50 Chinese EFL students were selected from two intact classes and were randomly assigned to either the…

Adaptive Comparative Judgment (ACJ), an approach to the assessment of open-ended problems which utilizes a series of comparisons to produce a standardized score, rank order, and a variety of other statistical measures, has demonstrated high levels of reliability and validity and the potential for application in a wide variety of areas. Further,…

Clinicians report primarily using functional behavioral assessment (FBA) methods that do not include functional analyses. However, studies examining the correspondence between functional analyses and other types of FBAs have produced inconsistent results. In addition, although functional analyses are considered the gold standard, their…

We present a bias-adjusted three-step estimation approach for multilevel latent class models (LC) with covariates. The proposed approach involves (1) fitting a single-level measurement model while ignoring the multilevel structure, (2) assigning units to latent classes, and (3) fitting the multilevel model with the covariates while controlling for…

The construct of "learning potential" has been proposed to capture differences between learner independent performance and performance during Dynamic Assessment (DA). This paper introduces a new LPS formula implemented in a DA study involving Pakistani learners of L2 Chinese. Learners were randomly assigned to a control or experimental…

Although much research has compared the functioning between analytic and holistic rating scales, little research has compared the functioning of binary rating scales with other types of rating scales. This quantitative study set out to preliminarily and comparatively validate binary and analytic rating scales intended for use in formative…

This study proposed a three-step writing conference in which foreign/second language (L2) students, under the guidance of their writing instructor, first fastened their attentional focus on a form-related error, analysed a collection of standard L2 samples to deduce the underlying knowledge, and then planned for their error correction as well as…

Using data from a large full-time social work program, we examine variation within and across three measures of MSW student competency: field instructor ratings, classroom instructor ratings, and student self-assessments through foundation and advanced years. The use of multiple student-level measures with identical wording and parallel response…

In Automated Essay Scoring (AES) systems, many previous works have studied group fairness using the demographic features of essay writers. However, individual fairness also plays an important role in fair evaluation and has not been yet explored. Initialized by Dwork et al., the fundamental concept of individual fairness is "similar people…

Adult learning involves the analysis and synthesis of knowledge to become competent, which cannot be assessed only by traditional assessment tool and didactic learning methods. Stimulation of higher domains of cognitive learning needs to be inculcated to reach a better understanding of the subject rather than traditional assessment tools that…