ERIC Number: ED571800
Record Type: Non-Journal
Publication Date: 2016-Jul
Pages: 72
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Benchmarks for Deeper Learning on Next Generation Tests: A Study of PISA. CRESST Report 855
Herman, Joan L.; La Torre, Deborah; Epstein, Scott; Wang, Jia
National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
This report presents the results of expert panels' item-by-item analysis of the 2015 PISA Reading Literacy and Mathematics Literacy assessments and compares study findings on PISA's representation of deeper learning with that of other related studies. Results indicate that about 11% to 14% of PISA's total raw score value for reading and mathematics literacy respectively are devoted to deeper learning, defined as items addressing depth of knowledge (DOK) Levels 3 or 4, based on Norman Webb's framework (Webb, Alt, Ely, & Vesperman, 2005). These levels are compared to those in the Common Core State Standards (CCSS) and in recent tests of the CCSS. Study results suggest the complexity of establishing deeper learning benchmarks. Five appendices are included: (1) Panelist Recruitment; (2) Panelist Biographies; (3) Review Panel Training and Data Collection; (4) Reading Literacy Analyses; and (5) Mathematics Literacy Analyses.
Descriptors: Achievement Tests, International Assessment, Foreign Countries, Secondary School Students, Reading Skills, Mathematics Skills, Scores, Common Core State Standards, Benchmarking, Transformative Learning, Learner Engagement, College Readiness, Career Readiness, Expertise, Statistical Analysis, Evaluation Research, Test Items, Knowledge Level
National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: William and Flora Hewlett Foundation
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A