This technical report describes the development and piloting of reading comprehension measures developed for use by fifth-grade students as part of an online progress monitoring assessment system, http://easycbm.com. Each comprehension measure is comprised of an original work of narrative fiction approximately 1500 words in length followed by 20 selected response questions that sample literal, inferential, and evaluative comprehension. All measures were piloted with fifth-grade students attending public schools in the Pacific Northwest, and results were analyzed using Item Response Theory (IRT). Complete results of the pilot testing are presented and discussed. Appended are: (1) Item Specifications for MC Comprehension; (2) Suggested Guidelines for Ordering Items for Test Pull and Test Form Development; and (3) Item Ordering Tables for Fifth Grade, Story 1 and 2. (Contains 42 tables.)