Initiatives to build research universities to have world-class universities, the creator and the disseminator of scientific knowledge in knowledge-based economies, are among the most important policy reactions in higher education systems. With an increase in demands on greater accountability, transparency, and efficiency, studies investigating the…

University rankings envision a level playing field between competing universities, particularly in higher education (HE) systems regulated along market lines. Drawing on social stratification theory, we argue that rankings exacerbate, rather than alleviate, resource inequalities between universities with historically consolidated reputations…

Arbitrary placing cut-offs in data, i.e. binning, is recognised as poor statistical practice. We explore the consequences of using arbitrary cut-offs in two large datasets, the National Student Survey (2019 and 2022). These are nationwide surveys aimed at capturing student satisfaction amongst UK undergraduates. For these survey data, it is common…

This paper examines interactions between the presence of top-ranked universities and other conditions that encourage regional competitiveness. Fuzzy-set qualitative comparative analysis (fsQCA) was conducted to assess the combined effect of the conditions. The analysis yields several noteworthy conclusions. First, no single condition is necessary…

This paper explores the effect of methodological choice on global Higher Education Institutions' (HEI) rankings, and the effect of choices regarding League Table and Ranking Systems (LTRSs) upon decision-making and policy. LTRSs are identified as heuristics to aid decision-making about HEIs. The paper examines the methodological choices commonly…

We examined the influence of accountability on the consistency of peer ratings and quality of peer feedback by comparing three conditions: only rating accountability, only feedback accountability, or both rating and feedback accountability. From a large undergraduate course, 287 students' peer ratings and peer feedback were coded for rating…

This paper examines how universities reconcile the need to project themselves as successful global competitors with the need to respond to national policy expectations, particularly around equality. It does so through a comparative analysis of the language used in the publicly available documents of universities in England and New Zealand. While a…

University league tables give the image that there is a single dimension along which institutions can be placed. Most derive rankings from an aggregate score of multiple items, which often include opinion responses which has the potential to introduce sampling bias. This paper explores what happens when the two issues of dimensionality and…

National and international rankings of universities are now an accepted part of the higher education landscape. Rankings aggregate different performance measures into a single scale and therefore depend on the methods and weights used to aggregate. The most common method is to scale each variable relative to the highest performing entity prior to…

International university rankings are a widely used measure of higher education excellence. Since publication rates are an important element in most ranking systems, pushing faculty to increase their publication in top-tier international journals is viewed by many government and university officials as an important strategy for improving ratings…

With increasing competition for postgraduate research scholarships, awarding processes demand attention and scrutiny. We examine inter-rater reliability for two prestigious New Zealand scholarships, the Shirtcliffe Fellowship and the Gordon Watson Scholarship. For each scholarship, five assessors (three academic; two non-academic) independently…

There has long been the suspicion amongst staff in Art & Design that the ratings given to their subject disciplines in the UK's National Student Survey are adversely affected by a combination of circumstances--a "perfect storm". The "perfect storm" proposition is tested by comparing ratings for Art & Design with those…

Much grading of student work is based, overtly or tacitly, on assumptions derived from scientific measurement. However, the practice of grading and the cumulation of grades into an overall index of achievement are socially constructed activities that fall a long way short of what is expected of scientific measurement. If scientific measurement is…