Various examinations are administered at universities across the US as a means of assessing bilingual/multilingual international teaching assistants' (ITAs') proficiency in spoken English before they are permitted to teach. While such exams are taken by students in a range of academic disciplines, recent research suggests that communicative success in academic disciplines such as STEM is more accurately understood through a materialist, as opposed to structuralist, orientation to competence. According to this orientation, communication is not contingent on autonomous competence in standardized English but instead on transcultural dispositions along with the strategic use of semiotic resources and spatial repertoires. In this paper, we provide a focused analysis of one university's Test of Oral English Proficiency (TOEP), which was recently redesigned in alignment with a materialist orientation to competence (e.g. through greater consideration for materiality, embodiment, and performativity). Through an analysis of audio and video recordings from the TOEP, this article demonstrates that a materialist orientation to competence can be actualized through a paradigm of assessment that accounts for the mutual negotiation of proficiency between speaking and listening subjects, or what we refer to as materializing assessment.