Presented at the Annual National Council on Measurement in Education (NCME) in San Diego in April 2009. This presentation explores how the College Board strives to ensure the relevance and utility of score reporting practices and methods for the PSAT/NMSQT and SAT scores. The new reporting methods allow for greater interaction and intervention at…

Three item-construction principles for multiple-choice tests were studied to determine how they affected test results for high school students: (1) use of incomplete sentence stem; (2) location of blank in the stem; and (3) presence of noncueing material. Differences in item construction had a slight effect on test results. (Authors/CJ)

Restricted factor analysis shows that the multiple-choice and free-response sections of the Computer Science and Chemistry Advanced Placement examinations (College Board) measure the same proficiencies for the most part. There is a small degree of multidimensionality because of local dependence among free-response items. (SLD)

The aim of this study was to appraise whether different forms of the Scholastic Aptitude Test (SAT) used since the mid 1970s varied in their correlations with academic performance criteria in the same cohort of examinees. A 1975 form and a 1985 form were administered to equivalent samples of high school juniors, and self-reported grade-point…

This study introduces procedures for constructing a proficiency scale for a large-scale test by applying Tatsuoka's Rule Space Model. The SAT Mathematics (SAT M) Section 2 is used for illustrating the process and the results. A task analysis is summarized in a mapping sentence, and then 14 processes and content attributes are identified for…

The consequences in terms of misclassifications of students that would occur by replacing the constructed-response portion of the Advanced Placement (AP) examinations in economics with more multiple-choice items were studied. The 1991 AP examinations in micro- and macroeconomics were used. Computer simulation found that a small but statistically…

This study investigated the effects of verbal factors on item performance in mathematics tests. Experimental tryout units were constructed that varied the verbal load of each of 21 mathematics test items. Each tryout unit was randomly assembled to include A, B and C versions of items so that no examinee took a unit of only one item format. Each…

In an attempt to initiate a new approach to the teaching of Pascal, a study was conducted to ascertain the difficulties students encountered when they attempt to learn this computer language. Screening tests were given to 68 students in grades 11 and 12 who had just completed a semester course in Pascal. The purpose of the test was to detect…

Eighth grade teachers in three local school districts helped customize two standardized norm-referenced tests for ninth graders to investigate effects of deleting some items and adding locally constructed items. Results indicate that percentile ranks for the customized tests could be very different from those for the complete test. (SLD)

The notion of phenomenal causality of C. Kraft (1991) was applied in the formulation of a self-report instrument to measure student perceptions of the dimensions of academic success. Instrument items were inspired by the students themselves in several hours of dialogue. Subjects were 55 male and 49 female black high school students at a summer…

Average performance on subtests of the Iowa Tests of Educational Development was compared for 177 high school students taking the test under silent reading (standardized) conditions and time limits and students listening to audiotapes of test material as they read the test. Poor readers were helped by the tapes. (SLD)

The cost of including hands-on tasks in the National Assessment of Educational Progress (NAEP) science assessment was analyzed. In recognition of growing interest in performance assessment in science, the framework for the NAEP science assessment called for the inclusion of hands-on tasks with hands-on activities and questions about the…

This press release reports selected information about the nation's 1994 high school graduates who took the ACT Assessment as part of their preparation for college. States, districts, and schools receive similar information and control the release of that information. The American College Testing program (ACT) reports only on national data. The…

Steps involved in the item analysis and scaling of the 1990 edition of Forms A and B of the Nevada High School Proficiency Examinations (NHSPEs) are described. Pilot tests of Forms A and B of the 47-item reading and 45-item mathematics tests were each administered to random samples of more than 600 eleventh-grade students. A computer program was…

This handbook contains information for high school educators--teachers, curriculum coordinators, counselors, and principals--as they prepare students to take the Prairie State Achievement Examination (PSAE). The first section explains the purpose of the PSAE, gives timelines and test-day schedules, and shows how the PSAE is constructed. The rest…