While many tools exist to assess student content knowledge, there are few that assess whether students display the critical listening skills necessary to interpret the quality of a speaker's message at the college level. The following research provides preliminary evidence for the internal consistency and factor structure of a tool, the Ferrari-Lynch-Vogel Listening Test (FLVLT), designed to assess critical listening by community college students. FLVLT data was collected from 915 students over three academic years at an urban community college. The findings of this research provide some initial evidence for the FLVLT's effectiveness at measuring critical listening by community college students. Future research should seek to expand the analysis of FLVLT's reliability and provide some initial evidence of validity.