ERIC Number: ED520403
Record Type: Non-Journal
Publication Date: 2010
Pages: 158
Abstractor: As Provided
ISBN: ISBN-978-1-1242-2334-6
ISSN: N/A
EISSN: N/A
Performance Assessment for California Teachers (PACT): An Evaluation of Inter-Rater Reliability
Porter, Jennifer Marie
ProQuest LLC, Ph.D. Dissertation, University of California, Davis
This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics. Thus, inter-rater reliability was examined by categorizing Teaching Events into passing and failing categories, in addition to comparing rater consistency by PACT tasks. One study evaluated teacher candidates' perspectives on their preparedness for assessing student learning, and measured their assessment competence using PACT scores and Collaborative Teacher ratings. Results from the comparison of candidate scores introduced a new set of questions regarding the levels of agreement among PACT raters. So a second study analyzed the inter-rater reliability of PACT. Overall, results suggest the need for further exploration of the consequential validity of PACT, in addition to using multiple methods to estimate its inter-rater reliability so that teaching effectiveness can be fairly identified. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml.]
Descriptors: Interrater Reliability, Program Effectiveness, Scoring Rubrics, Item Analysis, Job Performance, Teacher Evaluation, Convergent Thinking, Teacher Effectiveness, Evaluation Methods, Program Validation, Replication (Evaluation), Evaluation Research, Student Teacher Attitudes, Teacher Competencies, Teacher Competency Testing
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://bibliotheek.ehb.be:2222/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: California; United States
Grant or Contract Numbers: N/A