If the concepts used in curriculum, textbooks, classroom teaching, and assessment are not consistent, students may have difficulty in understanding the concepts of science correctly and this may lead to the formation of misconceptions. The purpose of this study is to measure the alignment of science concepts by analyzing the semantic networks of…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

This study aimed to assess the effectiveness of metacognitive methods in college general English classes to improve students' communication skills and metacognitive awareness. The approach involved structuring learning activities where students adapted movie dialogues, practiced roles, collaborated with peers, and received feedback on…

The halo effect is raters' undesirable tendency to assign more similar ratings across rating criteria than they should. The impacts of the halo effect on ratings have been studied in rater-mediated L2 writing assessment. Little is known, however, about the extent to which rating criteria order in analytic rating scales is associated with the…

Here, we describe the development and validation of an automatic assessment system that examines students' hand-drawn visual representations in free-response items. The data were collected from 1,028 students in the second through 11th grades in South Korea using two items from the Test About Particles in a Gas questionnaire (Novick &…

Video technology has the potential to improve opportunities for students to benefit from feedback that is essential for learning. However, previous studies have all dealt with videos of tutors, rather than videos of students' performances. This study explores whether video technology contributes to the quality of feedback on students' oral…

This paper aims to survey the current landscape of education policy evaluation across OECD countries and economies by examining recent trends and contextual factors that can promote more robust education policy evaluation, as well as identifying key challenges. It takes a view of policy evaluation as an activity that takes place throughout the…

The use of learner modelling approaches is critical for providing adaptive support in educational computer games, with predictive learner modelling being among the key approaches. While adaptive supports have been shown to improve the effectiveness of educational games, improperly customized support can have negative effects on learning outcomes.…

Educational assessment is used throughout the world for a range of different formative and summative purposes. Wherever an assessment is developed, whether by a teacher creating a quiz for their class, or by a testing company creating a high stakes assessment, it is necessary to decide how long the test should be. Specifically, how many questions…

Student evaluation of teaching (SET) is important for assessing university instructors' performance. However, this system seems biased as students' grade expectations result in rewards or penalties in SET. As a fair evaluation of grades became difficult during the COVID-19 pandemic, universities implemented a relaxed grade policy that expanded the…

This study investigates the asymmetric effects of quality attributes on student satisfaction in Korean higher education. Using Penalty-Reward-Contrast and Asymmetric Impact-Performance Analysis, it classifies attributes into basic (major and liberal arts curriculum, non-curricular courses, educational environment), one-dimensional (administrative…

Purpose: Given the context of accountability-driven policy environments, research has shown that school leaders perceive bureaucratic rules and protocols in negative ways, but they also utilize organizational structures and routines to lead changes. To better understand both enabling and hindering mechanisms of bureaucracy in schools, this study…

This study compared Korean adult learners' English speech in dialogic and monologic tasks, measuring 57 college students' oral proficiency in terms of holistic and analytic grades. The statistical analyses were focused on two questions: (1) how much do the holistic grades of oral proficiency and analytic grades of the four linguistic features…

We have maintained the customer grade system that is being implemented to customers with excellent performance through customer segmentation for years. Currently, financial institutions that operate the customer grade system provide similar services based on the score calculation criteria, but the score calculation criteria vary from the financial…

Currently, museums seek to improve education and inclusion through the use of technology, and it is essential to value the didactic and technological advances through the use of new tools (ICT), at an intercultural and intergenerational level, adapting the exhibition messages to the diversity of the public, with a special interest in disability.…