ERIC Number: EJ1342175
Record Type: Journal
Publication Date: 2022
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2375-5636
EISSN: N/A
Identifying Statistically Actionable Collusion in Remote Proctored Exams
Becker, Kirk; Meng, Huijuan
Journal of Applied Testing Technology, v23 spec iss p54-61 2022
The rise of online proctoring potentially provides more opportunities for item harvesting and consequent brain dumping and shared "study guides" based on stolen content. This has increased the need for rapid approaches for evaluating and acting on suspicious test responses in every delivery modality. Both hiring proxy test takers and studying unauthorized test content (e.g., "study guides" or brain dumps) result in characteristic patterns of responses, many of which are detectable through collusion analysis. The ability to identify and rapidly revoke test results are one component of stopping test takers from engaging in these behaviors, both in online proctored and test center testing. Existing collusion analyses have typically taken the approach of evaluating all response pairs sequentially, potentially requiring several days to evaluate a set of test results. This paper demonstrates matrix-based methods for quickly calculating exact overlap counts for large data sets, as well as approaches for determining criteria for flagging suspicious results or invalidating results. We discuss and compare the results for simulations and probability calculations and discuss the operational implications of these decisions.
Descriptors: Identification, Cheating, Computer Assisted Testing, Observation, Pattern Recognition, Statistical Analysis
Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: wgh.atp@att.net; Web site: http://jattjournal.net/
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A