ERIC Number: ED652009
Record Type: Non-Journal
Publication Date: 2024
Pages: 132
Abstractor: As Provided
ISBN: 979-8-3822-6191-1
ISSN: N/A
EISSN: N/A
Analyzing the Cognitive Complexity of the Questions on the Advanced Placement Computer Science Principles Exam
Lauren Zirpoli
ProQuest LLC, Ed.D. Dissertation, Seton Hall University
This convergent parallel mixed methods study with qualitative and quantitative content analysis was conducted to analyze and describe the cognitive complexity of the publicly released Advanced Placement Computer Science Principles Exam questions compared to the language of higher-order thinking found in research literature. Hess' Cognitive Rigor Matrix was used to determine the frequency and percentage of questions categorized as higher-order thinking within each cell of the matrix. The qualitative method consisted of content analysis of the language of each question analyzed, followed by deductive coding, and culminated with categorizing the depth and type of thinking required on Hess' Cognitive Rigor Matrix. The quantitative method consisted of using descriptive statistics to determine the frequency and percentage of each question categorized as higher-order thinking within each cell of Hess' Cognitive Rigor Matrix. To ensure reliability, each coder was trained using Web Alignment Tool training handbook. Coders read each question independently and classified the question using Web Alignment Tool and Hess' Cognitive Rigor Matrix. Coder then compared their categorization for inter-rater reliability and if there was a discrepancy, the double-read behind consensus model adopted from the Step Model for Deductive Category Application (Mayring, 2000) was used to increase inter-rater reliability. The overreaching conclusions of this study found that a substantial majority (95%) of the practice Advanced Placement Computer Science Principles questions required procedural knowledge, residing in lower-level thinking. The results suggest transitioning to an open-response format is likely to enhance the likelihood of incorporating higher-order thinking skills in the assessment. Open-response questions give students the opportunity to demonstrate their factual knowledge and ability to analyze, synthesize, and apply concepts. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml.]
Descriptors: Advanced Placement, Tests, Questioning Techniques, Difficulty Level, Cognitive Processes, Computer Science Education, Thinking Skills, Content Analysis
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A