ERIC Number: ED598476
Record Type: Non-Journal
Publication Date: 2018-Feb
Pages: 28
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
Sources of Variance in Special Educator Observation Rubrics
Crawford, Angela R.; Johnson, Evelyn S.; Moylan, Laura A.; Zheng, Yuzhu
Grantee Submission
This study describes the development and initial psychometric evaluation of a Recognizing Effective Special Education Teachers (RESET) teacher observation instrument. Specifically, the study uses generalizability theory to compare two versions of a rubric, one with general descriptors of performance levels and one with item-specific descriptors of performance levels, to evaluate special education teacher implementation of explicit instruction. Eight raters participated in viewing and scoring videos of special education instruction. Data collected from raters were analyzed in a three facet, crossed, mixed-model design to estimate the variance components and reliability indices. Results show lower unwanted sources of variance and higher indices of reliability with the rubric with item-specific descriptors of performance levels. Contributions to the field of teacher evaluation are discussed. [This paper will be published in "Assessment for Effective Intervention" under the title "Variance and Reliability in Special Educator Observation Rubrics."]
Descriptors: Special Education Teachers, Direct Instruction, Observation, Teaching Methods, Scoring Rubrics, Teacher Evaluation, Psychometrics, Test Validity, Test Reliability, Generalizability Theory, Feedback (Response), Item Response Theory, Interrater Reliability, Special Education, Elementary School Teachers, Middle School Teachers, Students with Disabilities
Publication Type: Reports - Research
Education Level: Elementary Education; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R324A150152