ERIC Number: ED653227
Record Type: Non-Journal
Publication Date: 2024
Pages: 181
Abstractor: As Provided
ISBN: 979-8-3827-4880-1
ISSN: N/A
EISSN: N/A
Exploring Pupil-Perceptions of Computer-Mediated Standardized Assessments
Cleon M. McLean
ProQuest LLC, Ph.D. Dissertation, The Claremont Graduate University
This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other states, at four different settings in one local unified high school district. The study was then paused for two years to allow for fuller implementation of SBAC. Then, in 2017, the study resumed at the original research settings plus one more with the goal of capturing any significant qualitative data insights into a new group of participants' SBAC experiences. The study was then paused for a second time to allow for some preliminary data analyses and reflection. Finally, in 2022, the study resumed after adopting and then practicing COVID protocols with a third group of participants at three of the previous five research settings. These punctuated data-collection periods afforded comparative analyses of students' computer-mediated test-taking experiences, which were phenomena not documented in the known literature about the initial year of SBAC. As such, the singular research question of this study, i.e., what were high school juniors' experiences while taking Smarter Balanced Summative Assessments? spurred phenomenological explorations via focus group and individual interviews of a total of 90 participants in-person and via Zoom platform. Subsequently, using MAXQDA Analytics Pro 2024 software, analyses of the three years of data resulted in four critical findings: (1.) Poor incentive structures and unclear reasons why students needed to take SBAC contributed to participants' lackluster motivation to perform to the best of their abilities on SBAC; (2.) Problematic SBAC content language contributed to students' frustrations and extraneous cognitive load; (3.) Limited formal computer literacy skills stunted students' abilities to understand and manipulate SBAC's logics of semantic and visual discourse designs; and (4.) Time-sensitive affordances of some SBAC tools and design features restricted test-takers from keeping virtual records of their participations within sections and between sections of the same test. These findings signaled five limitations of this study and yielded five recommendations for practice, especially concerning optimal instructional designs tailored for standardized testing preparatory content to be delivered via instructional technology, and the advantages of doing so for student motivation and performance. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml.]
Descriptors: Student Attitudes, Computer Assisted Testing, Standardized Tests, Student Evaluation, High School Students, Grade 11, Language Arts, Mathematics Tests, Student Experience, Computer Uses in Education, COVID-19, Pandemics
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: High Schools; Secondary Education; Grade 11
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: California
Grant or Contract Numbers: N/A