In order for individualized review in college admissions to be fair, issues of consistency and reliability must be considered. There are a number of ways to assess interrater reliability, including calculating the composite reliability of readers, computing the proportion of times that readers make consistent ratings, and evaluating reader severity.