ERIC Number: ED616491
Record Type: Non-Journal
Publication Date: 2021-Jul
Pages: 27
Abstractor: ERIC
ISBN: N/A
ISSN: N/A
EISSN: N/A
Establishing Standards of Best Practice in Automated Scoring. ACT Research. Technical Brief
Wood, Scott; Yao, Erin; Haisfield, Lisa; Lottridge, Susan
ACT, Inc.
For assessment professionals who are also automated scoring (AS) professionals, there is no single set of standards of best practice. This paper reviews the assessment and AS literature to identify key standards of best practice and ethical behavior for AS professionals and codifies those standards in a single resource. Having a unified set of AS standards is important for several reasons. First, given that AS is an emerging technology in educational assessment, it is important to establish guidelines of good practice for professionals and stakeholders learning to use this new technology. Second, due to the wide variety of professionals involved in AS technology development (e.g., psychometricians, linguists, data scientists, and computer programmers), a unified set of standards would guide these diverse professionals toward common objectives. Third, and most importantly, having standards for which stakeholders can hold AS professionals accountable can provide stakeholders with greater confidence in the use of AS. This report describes the methods used to identify, review, and summarize the standards and recommendations in the AS literature. This is followed by a summary of 10 important, high-level standards for AS professionals. Each standard is supported by exemplar citations from the AS literature. A summary and references list appear at the end of the report.
Descriptors: Standards, Best Practices, Computer Assisted Testing, Scoring, Automation, Ethics, Technology Uses in Education, Student Evaluation, Accountability, Accuracy, Evaluation Criteria, Test Bias
ACT, Inc. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Publication Type: Information Analyses
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: ACT, Inc.
Grant or Contract Numbers: N/A