This study examined ratings of fourth graders' oral reading expression. Randomly assigned participants (n = 36) practiced repeated readings using narrative or informational passages for 7 weeks. After this period raters used the "Multidimensional Fluency Scale" (MFS) on two separate occasions to rate students' expressive reading of four equivalent passages. Results of this generalizability study showed that a minimum of two and preferably three equivalent passages, two raters, and one rating occasion are recommended to obtain reliable ratings. This research substantiates the reliability of the MFS and demonstrates the importance of raters collaborating and finding texts at students' independent reading levels.