ERIC Number: EJ1451259
Record Type: Journal
Publication Date: 2023
Pages: 40
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1936-4660
Focused on Pedagogy: QR Grading Rubrics for Written Arguments
Ruby A. Daniels; Kathryn Appenzeller Knowles; Emily Naasz; Amanda Lindner
Numeracy, v16 n1 Article 4 2023
Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to assess QR in written arguments, the current mixed method study tested the reliability of two QR analytic grading rubrics for written arguments and explored students' reactions to the grading tools. Undergraduate students enrolled in a business course (N = 59) participated. A total of 415 QR artifacts from 40 students were assessed; an additional 19 students provided feedback about the grading tools. A new QR writing rubric included three main criteria (numerical evidence, conclusions, and writing), while a second rubric added a fourth criterion for assignments with data visualization. After two coders rated students' QR assignments, data analysis found both new QR rubrics had good reliability. Cohen's kappa found the study's raters had substantial agreement on all rubric criteria ([kappa] = 0.69 to 0.80). Both the QR writing ([alpha] = 0.861) and data visualization ([alpha] = 0.859) grading rubrics also had good internal consistency. When asked to provide feedback about the new grading tools, 89% of students shared positive comments, reporting the rubrics clarified assignment expectations, improved their performance, and facilitated the writing process. This paper proposes slight modifications to the phrasing of the new rubrics' writing criterion, discusses best practices for use of rubrics in QR classrooms, and recommends future research.
Descriptors: Scoring Rubrics, Grading, Numeracy, Multiple Literacies, Reliability, Writing (Composition), Student Attitudes, Undergraduate Students, Undergraduate Study, Business Administration Education, Feedback (Response), Visual Aids, Hispanic American Students, Minority Serving Institutions, Blended Learning, Persuasive Discourse
National Numeracy Network. 906 West 2nd Avenue, Suite 100, Spokane, WA 99201. Tel: 507-222-5239; Web site: https://digitalcommons.usf.edu/numeracy/
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Texas
Grant or Contract Numbers: N/A