In this paper, we explore the role of mathematical proof summaries as a tool for capturing students' reading comprehension of a given proof. We present an interview study based on mathematicians' pairwise evaluations of student-produced summaries of a proof demonstrating the uncountability of the open unit interval. We present a thematic analysis, exploring features of mathematicians' pairwise decision-making and their priorities in evaluating summaries. We argue that the students' proof summaries shared several properties with traditional modes of proof-writing and were frequently evaluated against similar conventions. We consider the consequences for research and practice with proof comprehension and conclude that proof summaries have the potential to form the basis of a new approach to assessment in this area.