ERIC Number: ED659656
Record Type: Non-Journal
Publication Date: 2023-Sep-29
Pages: N/A
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
What Does It Mean to Assess Understanding of Statistical Ethics? Design Challenges and Differential Item Functioning
Julie Neisler; Daniel Parker; Barbara Means
Society for Research on Educational Effectiveness
Nearly one million undergraduates take Introductory Statistics each year, and both the importance of statistics and viewpoints about how it should be taught have changed markedly over the last several decades (Guidelines for Assessment and Instruction in Statistics Education College Report, ASA Revision Committee, 2016). Modern introductory statistics courses seek to teach statistics in the context of real-world investigations, and there is growing consensus that understanding statistics ethics is a key learning outcome for the course. Yet, course instructors have few resources to help them teach or assess ethics. Our review of over 150 items used in five popular statistics concept inventories identified only a single item dealing with ethics. Digital Promise is leading the development of the Benchmark Assessment for Statistics Introductory Concepts (BASIC), a test designed to measure a student's ability to apply the key concepts taught in a modern, postsecondary introductory statistics course. Because the assessment will be used as the common learning outcome measure in a large-scale study, all BASIC items have a multiple-choice format. Development of pilot items on ethics has been particularly challenging in the absence of previously developed items for this learning outcome or even a consensus around what behaviors would indicate competency in understanding statistical ethics. Items can easily become no different from those used to assess understanding of other learning outcomes, such as sampling or hypothesis testing, or become as bland as "don't be evil." Creating an item context around a relevant social issue can easily bring preconceptions associated with different identities into play. This poster will summarize the assessment item development process, review the initial ethics items developed for the BASIC, and share the results of a differential item function analysis on key demographic variables, including Race/Ethnicity, Gender, and Age. Data is currently being collected in Spring 2023, and this In-The-Pipeline poster will be the initial results of the pilot test of this assessment.
Descriptors: Undergraduate Students, Statistics Education, Statistical Bias, Ethics, Ethical Instruction, Curriculum Development, Curriculum Evaluation, Instructional Innovation, Social Problems, Context Effect, Social Bias
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; e-mail: contact@sree.org; Web site: https://www.sree.org/
Publication Type: Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)
Grant or Contract Numbers: N/A
Author Affiliations: N/A