Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

In the context of formative assessment in classrooms, the incorporation of automated evaluation (AE) systems and teachers' interactions with them hold significant importance. This study aimed to investigate the cognitive processes of pre-service teachers as they engaged with an AE system. We developed an unsupervised learning-based AE system, the…

A partially-automated method of assessment is proposed, in which automated question setting is used to generate individualized versions of a coursework assignment, which is completed by students and marked by hand. This is designed to be (a) comparable to a traditional written coursework assignment in validity, in that complex and open-ended tasks…

The development of artificial intelligence (AI) technology has enhanced the use of automated speech evaluation systems for language learners to practice speaking skills. This study investigated whether various automatic feedback offered by AI speech evaluation programs can help English as a foreign language (EFL) learners develop speaking skills.…

Peer assessment has been widely applied across diverse academic fields over the last few decades, and has demonstrated its effectiveness. However, the advantages of peer assessment can only be achieved with high-quality peer reviews. Previous studies have found that high-quality review comments usually comprise several features (e.g., contain…

Cheating has been a long-standing issue in university assessments. However, the release of ChatGPT and other free-to-use generative AI tools has provided a new and distinct method for cheating. Students can run many assessment questions through the tool and generate a superficially compelling answer, which may or may not be accurate. We ran a…

Greer and Mark's (2016) paper suggested and reviewed different methods for evaluating the effectiveness of intelligent tutoring systems such as Propensity score matching. The current study aimed at assessing the effectiveness of automated personalized feedback intervention implemented via the Student Advice Recommender Agent (SARA) in a first-year…

In light of the ever-increasing capability of computer technology and advancement in speech and natural language processing techniques, automated speech scoring of constructed responses is gaining popularity in many high-stakes assessment and low-stakes educational settings. Automated scoring is a highly interdisciplinary and complex subject, and…

Purpose: With a growing need to assess multiple aspects of healthcare education, the goal of this study was to develop an innovative web-based application to streamline assessment processes and meet the increasingly complex role of the educational manager. Design/methodology/approach: AARDVARC (Automated Approach to Reviewing and Developing…

Peer assessment brings new affordances to the implementation of meaningful assessment on online courses (e.g. MOOCs) by using technological solutions to automate the assessment process. For this reason, teachers need digital pedagogic skills for planning, implementing and developing effective peer assessment models. In this paper we apply the…

Colleges throughout the United States are evaluating the effectiveness of the strategies used to decide whether to place students into college-level or developmental education courses. Developmental, or remedial, courses are designed to develop the reading, writing, or math skills of students deemed underprepared for college-level courses, a…

Writing essays and receiving feedback can be useful for fostering students' learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching…

The virtual reality is being more and more used in the education, enabling the student to find out, to explore and to build his own knowledge. This paper presents an Educational Software for presence or distance education, for subjects of Formal Language, where the student can manipulate virtually the target that must be explored, analyzed and…

Automation toward efficiency is the aim of most intelligent systems in an educational context in which results calculation automation that allows experts to spend most of their time on important tasks, not on retrieving, ordering, and interpreting information. In this paper, the authors provide a tool that easily evaluates Learning Objects quality…

Existing e-assessment tools may not be a panacea to address all assessment situations, as students might find the traditional pen-and-paper approach to provide their answers more convenient than typing them online. For example, constructed response or essay-based assessments will require the active participation of students and lecturers to…