The first step of the data analysis with respect to the eventual application of the various new methods in latent trait theory is here initiated. The data are a set of approximately 500 item responses of each of 7,439 examinees to the Iowa Tests of Basic Skills, Form 6, on one of three difficulty levels, which correspond to the ages of 11, 12 and…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

Examines the question of whether cultural and ethnic groups differ in their extreme response style. Studies questionnaire responses of Hispanic and non-Hispanic male Navy recruits and suggests that differences in extreme response style may be attributable to differences in judgment style across the two cultural groups. (MW)

The disparities between the scholastic achievements of girls and boys have been attributed to biological and sociological factors. The present study investigated the validity of these explanations in a multi-variable situation similar to field conditions. Achievement scores of 3446 pupils in the 5th through 11th grades, half girls and half boys,…

The Myers Longitudinal Medical Study is a five-stage investigation of the application of C.G. Jung's theory of psychological types to the understanding of medical student selection, achievement, and choices of specialty, professional employment and location of practice. Part I of this report describes the design and variables of the study, the…

This document reports on a study done at Gavilan College regarding counseling intervention for students that are subject to academic dismissal. The students that were studied were required to visit a dedicated follow up counselor prior to enrolling in classes in order to assist them in designing an achievable academic plan. The data gathered came…

In this technical report, the authors describe the development alternate forms of three types of early literacy measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fourth grade. They begin with a brief overview of the two conceptual frameworks underlying…

This report reviews 75 high schools in the "High Schools that Work" (HSTW) network that made statistically significant gains in at least two of three areas reading, mathematics and science--between 2002 and 2004 on the "HSTW" Assessments. In these schools, all groups of students improved achievement--regardless of race, ethnicity or socioeconomic…

This study developed a hybrid of item response theory (IRT) models and latent class models, which combined the strengths of each type of model. The primary motivation for developing the new model is to describe characteristics of examinees' knowledge at the time of the examination. Hence, the application of the model lies mainly in so-called…

Person fit in the Rasch one parameter model is investigated. The first set of data deals with grade 3 students responding to the mathematics computation and reading vocabulary subscales of the Comprehensive Test of Basic Skills Forms (CTBS/S). The second set of data deals with grade 3 students responding to the Basic Skills Assessment Program…

Multidimensionality is known to affect the accuracy of item parameter and ability estimations, which subsequently influences the computation of item characteristic curves (ICCs) and true scores. By judiciously combining sections of a Law School Admission Test (LSAT), 11 sections of varying degrees of uni- and multidimensional structures are used…

This study investigated whether differences in the dimensional structure of the form of the Law School Admission Test (LSAT) across selected ethnic subgroups of test takers had any impact on equating results using an item response theory (IRT) true-score procedure. Whether there were any differences in the underlying latent trait composite across…

This document reviews several theoretical frameworks of problem-solving, provides a definition of the construct, suggests ways of measuring the construct, focuses on issues for assessment, and provides specifications for the computer-based assessment of problem solving. As defined in the model of the Center for Research on Evaluation, Standards,…

Palmore's Facts on Aging Quiz (FAQ) (E. Palmore, 1977) is an instrument that is used to educate, to measure learning, to test knowledge, to measure attitudes toward aging, and in research. A comparative analysis was performed between the FAQ I and its multiple choice version and the FAQ II and its multiple choice version in terms of their item…

An item analysis study was conducted for two multiple-choice tests of introductory psychology created from a publisher's test bank. A 47-item multiple-choice test was administered to 247 students, and 433 students took a different 42-item multiple-choice test. Participants were from a large northeastern suburban community college. The difficulty…