Teacher education programs are under considerable pressure to evaluate their effectiveness in training new teachers. Over the last several decades there have been repeated calls for more systematic research on preservice teacher preparation programs. One institution has heeded this call, using the Video Assessment of Interactions and Learning (VAIL: Jamil, Sabol, Hamre, & Pianta, 2015) to annually assess teacher noticing of teacher-student interactions in preservice teachers. While there was no significant difference in first-test and last-test VAIL scores, VAIL scores were shown to be related to final college GPA. Additionally, there was a difference in student effort on the VAIL assessment, as participants provided fewer responses at the end of their program than at the beginning. These data show that assessments can be overused with regard to preservice teacher education programs. Future VAIL implementation should consider assessment fatigue when designing preservice teacher evaluation.