Objective structured clinical examination (OSCE) is widely used to assess medical students' clinical skills. Virtual OSCEs were used in place of in-person OSCEs during the COVID-19 pandemic; however, their reliability is yet to be robustly analyzed. By applying generalizability (G) theory, this study aimed to evaluate the reliability of a hybrid…

Objectives: Educators in both Western and non-Western contexts are increasingly acknowledging the necessity of screening for students' psychological dispositions to identify and effectively support at-risk students. The Social-Emotional Health Survey--Higher Education (SEHS-HE) has the potential to offer a practical yet comprehensive measure of…

The Career Adapt-Abilities Scale (CAAS) has been validated in several East Asian countries, but the measurement equivalence of its four dimensions and construct validity has not yet been evaluated in Japan. Results from Japanese (n = 298) and South Korean (n = 301) college students indicated good to excellent internal consistency estimates, and…

Self-efficacy has emerged as a popular construct in second language research, especially in the frontline and practitioner-researcher spaces. A troubling trend in the relevant literature is that self-efficacy is often measured in a general or global manner. Such research ignores the fact that self-efficacy is a smaller context-driven construct…

Raters vary from each other in their severity and leniency in rating performance. This study examined the factors affecting rater severity in peer assessments of oral presentations in English as a Foreign Language (EFL), focusing on peer raters' self-construal and presentation abilities. Japanese university students enrolled in EFL classes…

This study developed a Self-Regulated Second Language Self-Study Questionnaire that addresses the self-regulated learning (SRL) skills of learners of English as a foreign language in a self-study setting. Much attention has been paid to SRL in second language acquisition; however, contexts outside school have hardly been explored. To address this…

The substantive component of construct validity requires a confrontation between empirical test results and content relevance. The Vocabulary Size Test (VST) has been extensively validated in terms of empirical results. Less is known, however, about expert judgments of content relevance. The VST was constructed and validated according to the…

As a result of the Japanese Ministry of Education's recent edict that students' written and spoken English should be assessed in university entrance exams, there is an urgent need for tools to help teachers and students prepare for these exams. Although some commercial tools already exist, they are generally expensive and inflexible. To address…

The New General Service List Test (NGSLT) (Stoeckel & Bennett, 2015) was designed as a diagnostic test to measure students' written receptive vocabulary knowledge. This test battery was developed based upon the New General Service List (NGSL) (Browne, 2013), which makes it appealing to teachers in Japan, and especially those who see vocabulary…

This study measures the perceptions of English language teachers at Japanese universities. It combines the results of online questionnaires on assessment practices and another one on teacher autonomy. Results suggest that according to teachers' self-reports of assessment practices, certain measures of assessment quality are being affected by the…

Vocableveltest.org is a testing platform on which users can create on- line self-marking meaning-recall (reading or listening) and form-recall (typing) tests that address a number of limitations of the existing vocabulary level tests and vocabulary size tests. A major limitation of many existing vocabulary tests is the written receptive…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

Placement testing is a crucial issue in Japanese universities. In the majority of language programs, classes are streamed by proficiency levels based on students' placement test score for efficient instruction because university students' proficiency levels vary greatly even in the same program. The Visualizing English Language Competency Test®…

Knowledge of English affixes plays a significant role in increasing knowledge of words. However, few attempts have been made to create a valid and reliable measure of affix knowledge. The Word Part Levels Test (WPLT) was developed to measure three aspects of affix knowledge: form (recognition of written affix forms), meaning (knowledge of affix…