Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

Purpose: The algorithm of the Language ENvironment Analysis (LENA) system for calculating language environment measures was trained on American English; thus, its validity with other languages cannot be assumed. This article evaluates the accuracy of the LENA system applied to Korean. Method: We sampled sixty 5-min recording clips involving 38 key…

As the United States becomes more culturally diverse, the inclusion of musics from various cultural traditions in music education programs has become increasingly significant in recent decades. As music teachers have come to rely on Internet resources to teach world musics, a need has arisen to monitor the quality of world music websites. To…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

Identifying formal attributes of creative interior design and any differences in such perceptions according to one's culture and expertise can reveal underlying patterns in visual perception. This article reports a cross-cultural study of creativity, preference, and formal attributes of interior design evaluated by 158 participants from different…

Approximately a third of the Programme for International Student Assessment (PISA) items in the core domains (math, reading, and science) are constructed-response items and require human coding (scoring). This process is time-consuming, expensive, and prone to error as often (a) humans code inconsistently, and (b) coding reliability in…

Triangulation -- a combined use of different assessment methods or sources to evaluate psychological constructs -- is still a rarely used assessment approach in spite of its potential in overcoming inherent constraints of individual assessment methods. This paper uses field test data from a new OECD Study on Social and Emotional Skills to examine…

Recently, many countries have considered various assessment methods in order to measure multiple ways of students' thinking skills and problem solving ability. Recently, the Ministry of Education, Science and Technology [MOEST] (2009) in Korea revised the mathematics curriculum, which now more focuses on enabling students to explain mathematically…

Based on a concept of professionalism, this study analyzed and compared current public relations curricula of higher education among the United States, the United Kingdom, and South Korea. In terms of three educational orientations, results indicated that public relations education in the United States is the most balanced among theoretical,…

While there has been a remarkable worldwide convergence in the emphases of primary science curricula over the last four decades, the cognitive and knowledge demands that they make on learners have not been well-researched. Without knowing what these intellectual or epistemic requirements are when learning science in school, issues concerning…

The purpose of this study was to investigate rater effects on the TGMD-2 when it applied to children with intellectual disability. A total of 22 children with intellectual disabilities participated in this study. Children's performances in each of 12 subtests of the TGMD-2 were recorded via video and scored by three adapted physical activity…

This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was…

This study examined the reliability and validity of a Korean-translated version of the Gifted Rating Scales--School Form (GRS-S) and explored the effect of gender, rater, and grade. Data were collected from elementary schools in a metropolitan area and a midsize town in South Korea. In all, 49 elementary school teachers and 272 parents…

In many countries, an athlete's performance at sporting competitions is often used as part of the selection criteria for entry into college. These criteria could be biased depending upon the procedures utilized by the authorities in a particular country. The purpose of this study was to calibrate, by using the Rasch rating scale model, the…

Using a recruitment test for Korean teachers, the use of the Rasch measurement model to control the effects of judge variable on the grading of essay-type items is examined. Ways of minimizing the variation of grading due to judge severity and reducing the number of judges without threatening objectivity of ability measurements are presented.…