This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

The problem of not having a language exam by the end of the university years affects thousands of students in Hungary. The literature reveals that this area is less researched, but there are a number of factors that I found important to examine. I did my research in the East Hungarian region. The reason for this is that many studies in this area…

A key concern of washback research in language testing is with the value of test preparation for facilitating learning and improving test performance. Although test takers may draw on a wide range of preparation activities, the majority of research studies examining test preparation have taken place in classroom settings, leaving self-access…

The literature on using scoring rubrics in writing assessment denotes the significance of rubrics as practical and useful means to assess the quality of writing tasks. This study tries to investigate the agreement among rubrics endorsed and used for assessing the essay writing tasks by the internationally recognized tests of English language…

This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

Since its introduction in 2017, National Foundation for Educational Research (NFER) has been contracted by Ofqual to develop, deliver and analyse the results of the National Reference Test (NRT) in English and maths. The NRT is administered annually and shows if student performance in English and maths at GCSE level has changed from year-to-year.…

Purpose: The purposes of this tutorial are (a) to describe a method of language sample analysis (LSA) referred to as SUGAR (Sampling Utterances and Grammatical Analysis Revised) and (b) to offer step-by-step instructions detailing how to collect, transcribe, analyze, and interpret the results of a SUGAR language sample. Method: The tutorial begins…

Standardizing accessible test design and development to meet students' individual access needs is a complex task. The following study provides one approach to accessible test design and development using participatory design methods with school community members. Participatory research provides opportunities to empower collaborators by co-creating…

This study investigated whether teacher expectations had significant effects on ethnic minority students' second language and foreign language learning in senior high schools. The participants of this study were 52 teachers and 836 ethnic minority students from 10 senior high schools in southwest China. Data of teacher expectations for students'…

The academic section of the Vocabulary Levels Test (VLT-Ac) and the Academic Vocabulary Test (AVT) both assess meaning-recognition knowledge of written receptive academic vocabulary, deemed central for engagement in academic activities. Depending on the purpose and context of the testing, either of the tests can be appropriate, but for research…

This study investigated instruction in vocabulary consolidation strategies over eight months and vocabulary learning among a group of secondary students in Hong Kong. Two vocabulary tests and one vocabulary learning strategies (VLSs) questionnaire survey were administered near the end of the school year. The data were analysed using t-tests and…

Although there is abundant evidence for the use of first-language (L1) knowledge by bilinguals when using a second language (L2), investigation into the impact of L1 knowledge in large-scale L2 language assessments and discussion of how such impact may be controlled has received little attention in the language assessment literature. This study…

Background noise challenges auditory recognition of speech and may reveal the underlying deficits in auditory word recognition skills. Previous studies have reported an association between children's auditory skills and various linguistic skills, including phonology, although in some languages only. However, language-specific features influence…

The aim of this research is to explore the effect of implementing the Communicative Language Teaching (CLT) Approach on the speaking ability of students-. The sample size for this study comprises 46 students representing the introvert class and the extrovert class, selected based on the results obtained from the distribution of questionnaires. To…

Language testing is witnessing increasing interest in the potential for AI to support test development and validation. To date, published research involving AI in language testing has typically been conducted in the context of high-stakes proficiency tests and the potential for this technology to support local language testing is under-researched.…