The research literature emphasises the emergence -- in the English context particularly -- of performative accountabilities associated with metrics-based evaluation. Recent studies observe uneven effects of such evaluations at organisational level. This UK-based study examines academics' perceptions of the fairness of organisational accountabilities, drawing on organisational studies literature to identify dimensions of organisational justice. A cluster analysis identified four groups varying in their perceptions of procedural justice (fairness of organisational processes associated with metrics) and distributive justice (performance consequences of metrics). Exploring the responses further, interview respondents emphasised greater concerns with procedural justice and greater variability in accountability practices relating to research metrics than with teaching. In groups where procedural justice was evaluated more positively, academics saw metrics being applied in ways aligned with valued research and teaching enhancement practices. The study draws attention to institutional practices that contribute to academic perceptions of fairness and increased alignment between organisational and individual goals.