This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

Purpose: Improving and assuring the quality of higher education has become a key element of policy agendas worldwide. To this end, a complete accountability system has been developed through various evaluation procedures. Specifically, this study analyzes the perceptions of university teaching staff on the impact of performance appraisal systems…

Purpose: This research aims to construct an Evaluation Scale for Vocational Education Internships (ESVEI) tailored to assess the vocational educational internship experiences from the perspectives of vocational students. It also seeks to investigate the influence of certain factors -- such as gender, family background, educational attainment,…

Faculty members are entrusted with great power to decide who deserves space within the academic profession. Given that the profession's central mission is knowledge production, such decisions inevitably concern epistemic matters, and specifically, what constitutes legitimate knowledge. From this perspective, faculty hiring is not only a matter of…

This experimental study explores how source use features impact raters' judgment of argumentation in a second language (L2) integrated writing test. One hundred four experienced and novice raters were recruited to complete a rating task that simulated the scoring assignment of a local English Placement Test (EPT). Sixty written responses were…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Small sample sizes pose a severe threat to convergence and accuracy of between-group level parameter estimates in multilevel structural equation modeling (SEM). However, in certain situations, such as pilot studies or when populations are inherently small, increasing samples sizes is not feasible. As a remedy, we propose a two-stage regularized…

This study employs the Delphi method to ascertain intercultural scholars' current consensus on a definition, specific components, and key evaluation criteria of intercultural competence. Sixty-eight leading intercultural scholars from Euro-American and East-Asian countries participated in this study. The results are largely congruent with the…

Holistic assessment is an evaluative approach in which assessors work backwards from an overall appraisal of work to determine the criteria relevant to individual student responses. One of the strongest proponents of this approach in higher education is Royce Sadler, whose theoretical contributions over recent decades provide a strong conceptual…

Different sources of assessment evidence are reviewed during International Baccalaureate (IB) grade awarding to convert marks into grades and ensure fair results for students. Qualitative and quantitative evidence are analysed to determine grade boundaries, with statistical evidence weighed against examiner judgement and teachers' feedback on…

International large-scale assessments (ILSA) are an important source of information for education policymakers across the globe. Despite sponsors' warnings, when results are published, media attention focuses on country rankings and changes in scores. Score changes are evaluated using a two-sided z-statistic, with statistical significance declared…

Unethical research practices are prevalent in China, but little research has focused on the causes of these practices. Drawing on the criminology literature on organisational deviance, as well as the concept of "cengceng jiama," which illustrates the increase of pressure in the process of policy implementation within a top-down…

Background Study: Assessing learners' inquiry-based skills is challenging as social, political, and technological dimensions must be considered. The advanced development of artificial intelligence (AI) makes it possible to address these challenges and shape the next generation of science education. Objectives: The present study evaluated the SSI…