Discusses the issues related to the testing of listening comprehension in the context of the 1986 American Council Teaching Foreign Language Proficiency Guidelines. Four issues are singled out: the meaning of context in testing listening; the concept of criterion-referenced tests; the notion of specific purposes in testing; and the use of…

In 1998 and again in 2002, samples of eighth grade students in California were tested in reading as part of the state-level component of the National Assessment of Educational Progress (NAEP). In each of these years, all eighth graders in the state were also required to participate in the state's accountability testing, which included the reading…

End-of-course examinations are only as good as the assumptions used in designing them. What is a course's "essential" content? And what does it mean to master it? The end-of-course examinations developed by ACT are derived from assumptions that offer unique and challenging answers to these questions. This brief explains the process used to develop…

Test specifications dictate the kind of content that should be included on each form of an examination, and the relative weight that each content domain should contribute to the determination of examinees' test scores by specifying the proportion of items to be included in each content area. This paper addresses a step in the development of…

The effects of anchor test characteristics in the accuracy and precision of test equating in the "common items, nonequivalent groups design" were studied. The study also considered the effects of nonparallel based and new forms on the equating solution, and it investigated the effects of differential weighting on the success of equating…

The Reading Framework for the 1992 National Assessment of Educational Progress (NAEP) contains the rationale for the aspects of reading assessed in 1992 and criteria for development of the assessment. Developed through a national consensus process as a part of an effort to move assessment forward, the framework presented in the booklet is more…

The multistage alpha-stratified computerized adaptive testing (CAT) design advocated a new philosophy of pool management and item selection using low discriminating items first. It has been demonstrated through simulation studies to be effective both in reducing item overlap rate and enhancing pool utilization with certain pool types. Based on…

This study investigated whether equating accuracy improves with an anchor test that is more representative of its corresponding total test and whether such content effect depends on the particular equating method used. Scoring outcomes of a professional examination for a medical specialty were used. A total of 1,092 examinees took one form, and…

Contends that different ethical issues arise according to how the construct of writing is defined for assessment purposes. Explains that most formal assessments assume a pragmatic, functional definition of second-language writing in which an examinee's text production is judged normatively in respect to conventions. Discusses efforts to develop…

Reviews the Ennis-Weir Critical Thinking Essay Test. Notes that the test may be used as an informal diagnostic instrument, an evaluation tool for instructional effectiveness, or as material for teaching critical thinking. (RS)

This simulation investigated two procedures that reduce differences between paper-and-pencil testing and computerized adaptive testing (CAT) by making CAT content sensitive. Results indicate that the price in terms of additional test items of using constrained CAT for content balancing is much smaller than that of using testlets. (SLD)

Discusses the advantages of using multiple choice questions, highlighting the flexibility of using different variations of questions. Item writing guidelines include information on content, sensitivity, difficulty, irrelevant sources of difficulty, order, misleads, avoidance of clues, and exercises in the application of guidelines. (JKP)

Academically sound methods for preparing students for standardized tests include establishing tests' importance, forming preparation teams, gathering information, aligning curricular and test objectives, teaching test-wiseness skills, informing stakeholders, involving students in preparation plans, infusing curriculum with test content, and…

Provides helpful guidelines for creating exams and grading. Three main questions are addressed: (1) If it is known what content is important, then why not tell the students?; (2) Should students compete against each other or compete against course content?; and (3) What is the best way to handle cheating? (SAH)

Some say the new SAT is an improved version of the old one. It adds more math, especially advanced algebra, an essay section and testing on grammar, according to some reports. Supposedly, it will rely less on rote reasoning and more on critical thinking. Will it give college admissions officers better information? Because no matter what the SAT…