Despite widespread use of the Student Course Engagement Questionnaire (SCEQ; Handelsman, Briggs, Sullivan, & Towler, 2005) for the purposes of measuring college student engagement in scholarship of teaching and learning (SoTL) contexts, few studies have been published regarding its psychometric validity. The current study examined the structural and criterion validity of models proposed in the original study and in a subsequent validation study. The results indicated that neither model provided adequate fit to the current data. Concerns regarding structural, criterion, and content validity are discussed, and recommendations regarding the use of the SCEQ are provided in the context of current psychometric evidence and relevant theories of student engagement.