Purpose: Vocabulary intervention should be guided by information from outcome measures that demonstrate whether the student has grown in depth or breadth of understanding of the taught words. However, there is a paucity of tools, to measure depth of vocabulary knowledge, that are available for clinical use. Method: The challenges of vocabulary…

Educators, especially test creators, are concerned with the construct validity of their tests. Blame has generally been attached to test-wiseness strategies as one source of error in measurement. There is little evidence of any relation between test-taking strategies in general and test validity; thus, it is not known how strategies can affect…

The aim of this research is to determine teachers' attitude levels towards assessment and evaluation who teach Turkish as a foreign language and to examine them in terms of various variables. Survey method, one of the quantitative research methods, was used in the research. Teachers (n=233) who teach Turkish in various institutions participated in…

Many English language proficiency (ELP) tests used for university admissions and placement now include integrated writing tasks that require examinees to use external sources when writing. Integrated writing tasks improve test authenticity and impact, but they raise several validity questions, such as what academic language skills they engage and…

Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online.…

Research Findings: The aim of this study was to construct and validate "English Picture Vocabulary Test (EPVT)" that aimed to assess the very young learners' (VYLs) receptive and expressive vocabulary knowledge for specific content areas in English as a foreign language (EFL). In this context, EPVT was created in several stages. One of…

Developing effective aptitude test batteries for conference interpreting is highly relevant for China given its large and fast-growing interpreting trainee population. This paper reports on the aptitude tests implemented to 23 first-year students at a CIUTI member and UN MOU university in China. We compared the validity of recall, a test commonly…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

Artificial Intelligence (AI) is growing -- as can be clearly observed not only from the rising recognition of assistance tools such as Siri (Apple) but also from the newly introduced Google Voiced Translator. Yet, some crucial benchmarks still have to be supplied before it can act as a proxy for a real instructor: imagination, creativity, and…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

An in-depth investigation of vocabulary depth knowledge by lexical researchers plays a prominent role in language learning and teaching. The objectives of the present study were to investigate the extent of relationship and prediction of the three constitutes of vocabulary depth knowledge (i.e., analytic relations, morphological knowledge, and…

This study investigated U.S. undergraduates' perceptions of non-native speakers' (NNS) speech which had received 100% proficiency scores on the TOEFL iBT test. Fifty-five U.S. undergraduates rated 20 speech samples for comprehensibility, accentedness, and acceptability. The speech samples were also analyzed for acoustic fluency. Descriptively,…

Language testing and assessment have grown in popularity and gained significance in the last few decades, and there is a rising need for assessment literate stakeholders in the field of language education. As teachers play a major role in assessing students, there is a need to make sure they have the right level of assessment knowledge and skills…

Cognitive diagnostic models (CDMs) have received much interest within the field of language testing over the last decade due to their great potential to provide diagnostic feedback to all stakeholders and ultimately improve language teaching and learning. A large number of studies have demonstrated the application of CDMs on advanced large-scale…

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a…