Peer review is integral to the evaluation of grant proposals. Reviewer perceptions and characteristics have received limited study, especially their associations with reviewers' evaluations. This mixed methods study analyzed the unstructured comments of 270 experienced peer reviewers after they scored proposals based on mock overall evaluations…

The large scale expansion of online courses has led to the crisis of course quality issues. In this study, we first established an evaluation index system for online courses using factor analysis, encompassing three key constructs: course resource construction, course implementation, and teaching effectiveness. Subsequently, we employed factor…

In the existing literature, scholars have proposed various indices to measure the lexical richness (LR) of English as a foreign language (EFL) writing. However, there are currently issues of redundant indices and inconsistent usage. Attempting to address the research question of which indices are the most sensitive and effective ones to…

Purpose: To evaluate pluralistic Extension and Advisory Services (EAS) systems performance and outcomes, and share the experiences made with applying a participatory semi-quantitative approach allowing for cross-country comparability. Design/methodology/approach: The Food and Agriculture Organization of the United Nations (FAO) developed the…

Assessment of learners in the anatomical sciences is a complex task as it not only tests students' fact knowledge, but also the analysis of visual information. Sometimes, novice histology learners must acquire image recognition skills of microscopic structures in a short time frame. This paper describes a strategy of offering first year dental…

Research indicates that teacher performance is a critical focus for school districts, administrators, and teachers. Pre-service teacher preparation, teacher retention, job satisfaction, mentoring, continuous feedback, and onboarding support for new teachers are all factors that influence teacher performance (Carver-Thomas & Darling-Hammond,…

The present study explores two rating methods for peer assessment (analytical rating using criteria and comparative judgement) in light of concurrent validity, reliability and insufficient diagnosticity (i.e. the degree to which substandard work is recognised by the peer raters). During a second-year undergraduate course, students wrote a one-page…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Does the choice of observation instrument make a difference in the feedback and ratings that teachers receive? This study explores how lessons are rated differentially across various observation instruments. To investigate this question, ten randomly selected mathematics lessons were rated using six different observation instruments. Overall…

The purpose of this quantitative, experimental study was to examine if incorporating an instructional technique called formative assessment had an impact on overall performance of students attending the Air Force Nuclear College's Nuclear Fundamentals Course at Kirtland Air Force Base in New Mexico. Within the study, 49 student participants…

The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how…

This paper first analyzed the shortcomings of the summative final exam methods which focuses only on final exams. Then, we showed the specific implementation of the quantitative formative assessment which includes objective results and subjective scores. Objective results include the traditional written chapter test score, online mid-term and…

Student Evaluations of Teaching (SETs) gather crucial feedback on student experiences of teaching and learning and have been used for decades to evaluate the quality of teaching and student experience of instruction. In this paper, we make the case for an important improvement to the analysis of SET data that can further refine its interpretation.…

In this study, we estimated the relationship between two popular measures of teacher effectiveness--teachers' value-added model (VAM) estimates, represented in this study via median growth percentiles (MGPs), and teachers' observational scores, derived from the TAP System for Teacher and Student Advancement. We examined the relationship between…

Purpose: The OSCE is regarded as the gold standard of competence assessment in many healthcare programs, however, there are numerous internal and external sources of variation contributing to checklist marks. There is concern amongst organisers that candidates may be unfairly disadvantaged if they follow an "excellent" preceding…