The large scale expansion of online courses has led to the crisis of course quality issues. In this study, we first established an evaluation index system for online courses using factor analysis, encompassing three key constructs: course resource construction, course implementation, and teaching effectiveness. Subsequently, we employed factor…

In the existing literature, scholars have proposed various indices to measure the lexical richness (LR) of English as a foreign language (EFL) writing. However, there are currently issues of redundant indices and inconsistent usage. Attempting to address the research question of which indices are the most sensitive and effective ones to…

Purpose: To evaluate pluralistic Extension and Advisory Services (EAS) systems performance and outcomes, and share the experiences made with applying a participatory semi-quantitative approach allowing for cross-country comparability. Design/methodology/approach: The Food and Agriculture Organization of the United Nations (FAO) developed the…

Research indicates that teacher performance is a critical focus for school districts, administrators, and teachers. Pre-service teacher preparation, teacher retention, job satisfaction, mentoring, continuous feedback, and onboarding support for new teachers are all factors that influence teacher performance (Carver-Thomas & Darling-Hammond,…

The present study explores two rating methods for peer assessment (analytical rating using criteria and comparative judgement) in light of concurrent validity, reliability and insufficient diagnosticity (i.e. the degree to which substandard work is recognised by the peer raters). During a second-year undergraduate course, students wrote a one-page…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Does the choice of observation instrument make a difference in the feedback and ratings that teachers receive? This study explores how lessons are rated differentially across various observation instruments. To investigate this question, ten randomly selected mathematics lessons were rated using six different observation instruments. Overall…

Student Evaluations of Teaching (SETs) gather crucial feedback on student experiences of teaching and learning and have been used for decades to evaluate the quality of teaching and student experience of instruction. In this paper, we make the case for an important improvement to the analysis of SET data that can further refine its interpretation.…

In this study, we estimated the relationship between two popular measures of teacher effectiveness--teachers' value-added model (VAM) estimates, represented in this study via median growth percentiles (MGPs), and teachers' observational scores, derived from the TAP System for Teacher and Student Advancement. We examined the relationship between…

In-class group work activities are found to promote the interpersonal skills of learners. To support the teachers in facilitating such activities, we designed a learning analytics-enhanced technology framework, Group Learning Orchestration Based on Evidence (GLOBE) using data-driven approaches. In this study, we implemented the algorithmic group…

School systems are increasingly incorporating student perceptions of teaching effectiveness into educator accountability systems. Using Tripod's 7Cs™ Framework of Teaching Effectiveness, this study examines key issues in validating student perception data for use in this manner. Analyses examine the internal structure of 7Cs scores and the extent…

Purpose: The purpose of this article is to compare graduates' score rates in two multiple mini-interview (MMI) stations designed to assess graduates from several academic areas: confidant vs stress interview and synchronous vs asynchronous. This relates to three transversal competences (TCs) (learning to learn [LL], positive professional attitude…

This study was conducted to examine the effectiveness of peer-review in college English as Second Language writing classes to improve ESL students' writing scores. It also investigated a statistically significant difference in college ESL students' writing scores between those who use the self-check list and peer review worksheet and those who…

Teacher preparation programs are increasingly expected to use data on pre-service teacher (PST) skills to drive program improvement and provide targeted supports. Observational ratings are especially vital, but also prone to measurement issues. Scores may be influenced by factors unrelated to PSTs' instructional skills, including rater standards…

Maximising the accuracy and learning of self and peer assessment activities in higher education requires instructors to make several design decisions, including whether the assessment process should be individual or collaborative, and, if collaborative, determining the number of members of each peer assessment team. In order to support this…