The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 25 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Scott-Foresman End-of-Book 9 Criterion-referenced Test (CRT), and once on the Word Reading Test. Traditional psychometric correlational analyses as well as strategies specifically designed for examining the adequacy of criterion-referenced tests were applied to the data to investigate the following dimensions of the technical adequacy of the CRT: consistency of student performance across two administrations of the CRT, criterion-related validity of the CRT scores with respect to two other measures of reading proficiency, and criterion-related validity of the CRT mastery/nonmastery decisions with respect to pre/post instructional status. Results indicated that the reliability and validity was acceptable for the total test and the scale scores, with the exception of the Literacy Understanding/Appreciation scale and, in some cases, the Word Identification scale. Implications for the development and use of criterion-referenced tests are discussed. (Author)