This study investigated the effect of different assessment types on overall success in an online geoscience course covering energy's impact on the environment. Two groups took either the slower 1-credit or the faster 3-credit version of the course, which utilized the same content. Self-assessment questions developed using H5P, quizzes, summative…

This paper aims to identify and compare key factors influencing US States' or an OECD country's decision to employ student test scores or test score value-added (VAM) in evaluating teacher effectiveness. Analysis using multiple linear probability model and logistic regression frameworks indicates that the use of VAM/student test scores was…

Peer assessment systems are emerging in many settings, such as peer grading in large (online) classes, peer review in conferences, peer art evaluation, etc. However, peer assessments might not be as accurate as expert evaluations, thus rendering these systems unreliable. The reliability of peer assessment systems is influenced by various factors…

Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

Intentional synthesis of research findings is necessary to inform practice, particularly within the research on evaluation (RoE) literature. This study expands upon the work of Coryn et al. (2017) to synthesize the RoE studies pertaining to the domain of evaluation context. Findings from this study demonstrate that organization and program's size,…

Assessment is an essential activity in learning and teaching. It is classified into two categories based on its function: summative and formative assessments. During the pandemic, school learning activities, such as assessment, have been altered into online learning, which is quite challenging to carry out. This study investigated the kinds of…

COVID-19 is disrupting assessment practices and accelerating changes. With special focus on K-12 and credentialing exams, this article describes the series of changes observed during the pandemic, the solutions assessment providers have implemented, and the long-term impact on future practices. Additionally, this article highlights the importance…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

The teaching quality evaluation of college teachers is an important indicator of school evaluation, performance assessment and teacher promotion. However, the existing evaluation methods are only limited to the formal evaluation of teaching behavior, and have not achieved objective, reasonable and scientific evaluation results. The purpose of this…

Planning is an essential part of the preparation and implementation of the teaching process. Designing and planning education is an important part of the complex professional competencies of teachers, which were the subject of several years of research carried out at the University of Constantine the Philosopher in Nitra. Scientific research of…

This article intends to investigate the consistency between a few popular generative AI robots in the evaluation of massive open online course (MOOC) platforms. The four robots experimented with in the study were Claude+, GPT-4, Sage, and Dragonfly, which were tasked with awarding rating scores to the eight major dimensions, namely (1)…

The purpose of this paper is to investigate the affordances of the e-assessment system Numbas from an Activity Theory perspective. The study follows a qualitative research design combined with semi-structured interviews with six students and two teachers. The findings reveal that the students were able to perceive and actualise several affordances…

Automated Writing Evaluation systems have been developed to help students improve their writing skills through the automated delivery of both summative and formative feedback. These systems have demonstrated strong potential in a variety of educational contexts; however, they remain limited in their personalization and scope. The purpose of the…

Assessment is a topic of concern to all stakeholders in our educational system. Pattern Based Questions are an assessment tool which is an alternative to the standardized assessment tool, and they are based on generative learning pedagogy, which shows promise in engaging all learners and usefulness in teaching and learning but validity has not yet…

Learning needs to be well planned so that it can take place in accordance with the objectives to be achieved. This planning can be poured into the learning implementation plan (RPP) prepared by the teacher. Therefore, this study aims to describe the competence of prospective chemistry teacher students to prepare lesson plans using a scientific…