As online courses become increasingly common at the college level, an ongoing concern is how to ensure academic integrity in the online environment. One area that has received particular attention is that of preventing cheating during unproctored online exams. In this study, we examine students' behavior during unproctored exams taken in an online…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Unlike the traditional multiple-choice (MC) format, the discrete-option multiple-choice (DOMC) format does not necessarily reveal all answer options to an examinee. The purpose of this study was to determine whether the reduced exposure of item content affects test security. We conducted an experiment in which participants were allowed to view…

A decision of whether to move from paper-and-pencil to computer-based tests is based largely on a careful weighing of the potential benefits of a change against its costs, disadvantages, and challenges. This paper briefly discusses the trade-offs involved in making such a transition, and then focuses on a relatively unexplored benefit of…

One of the biggest challenges for online learning is upholding academic integrity in online assessments. In particular, institutions and faculties attach importance to exam security and academic dishonesty in the online learning process. The aim of this study was to compare the test-taking behaviors and academic achievements of students in…

Traditional and online university courses share expectations for quality content and rigor. Student and faculty concerns about compromised academic integrity and actual instances of academic dishonesty in assessments, especially with online testing, are increasingly troublesome. Recent research suggests that in the absence of proctoring, the time…

To slow the spread of COVID-19, many universities have had to move to online teaching, which entails changing exams from in-person to online. Online exams can facilitate cheating when there is no direct proctoring. To provide some form of control in unproctored exams, Cluskey et al. (2011) suggested having substantial time pressure; yet there are…

Online teaching is growing in popularity. This paper presents a case study for an online business course investigating student exam scores obtained from non-randomized and randomized exams. We find that the non-randomized exam scores of the students are suspicious because there are statistically significant disparities from the randomized exam…

Online education continues to grow, bringing opportunities and challenges for students and instructors. One challenge is the perception that academic integrity associated with online tests is compromised due to undetected cheating that yields artificially higher grades. To address these concerns, proctoring software has been developed to address…

This research explores differences in multiple choice test (MCT) scores in a cohort of post-graduate students enrolled in a management and leadership course. A total of 250 students completed the MCT in either a supervised in-class paper and pencil test or an unsupervised online test. The only statistically significant difference between the nine…

The Duolingo English Test (DET) is a computer adaptive test of English proficiency that is increasingly used for English-medium university admissions purposes. During the COVID-19 pandemic of 2020, test centers were shut down in many countries, and major tests including the TOEFL iBT and IELTS could not be administered. The DET is an "at…

Item positions in educational assessments are often randomized across students to prevent cheating. However, if altering item positions results in any significant impact on students' performance, it may threaten the validity of test scores. Two widely used approaches for detecting position effects -- logistic regression and hierarchical…

There has been a remarkable growth in distance learning courses in higher education. Despite indications that distance learning courses are more vulnerable to cheating behavior than traditional courses, there has been little research studying whether online exams facilitate a relatively greater level of cheating. This article examines this issue…

The authors studied the testing pattern grades in four e-campus courses at Troy University with 76 graduate students. In their research, the authors found significant differences in average test grade scores between tests taken electronically without a proctor as compared to those administered using a live or a remote proctor overall. To control…

To better understand the dynamics of online student test taking, including the likelihood of cheating by large numbers of students, we examined test-taking patterns and outcomes of weekly online quizzes in two large undergraduate biology lecture courses. Students taking a quiz late in a 1-3-day quiz access period performed 10-15% worse on quizzes…