This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

Assessing Opportunities to Learn (OTL) implies the measurement of different aspects of the curricular implementation in the classrooms, such as the contents that the teacher selects for the course and the time of exposure and the frequency of the tasks proposed. Based on recent studies that demonstrate the influence of this curricular dimension on…

Research has suggested that important research questions can be addressed with meaningful interpretations using hierarchical linear modeling (HLM). The proper interpretation of results, however, is invariably linked to the choice of centering for the Level-1 predictor variables that produce the outcome measure for the Level-2 regression analysis.…

Though item bias statistics are widely recommended for use in test development and analysis, problems arise in their interpretation. This research evaluates logistic test models and computer simulation methods for providing a frame of reference for interpreting item bias statistics. Specifically, the intent was to produce simulated sampling…

Four item bias methods were studied. The methods compared include the Mantel-Haenszel statistic, the plot method, the route mean squared difference method, and the total area method; the latter two methods are based on item response theory. The test consisted of item responses of 451 male and 486 female ninth graders to 75 test items on the 1985…

The administration of the High School Proficiency Test (HSPT) in the Trenton (New Jersey) School District and the impact of a voluntary summer tutorial program on HSPT scores were examined. New Jersey requires that all ninth graders take the HSPT, and that all school districts achieve a 75 percent passing rate to become state-certified. The same…

Six item bias detection techniques (distractor analysis, the Mantel-Haenszel procedure, Angoff's delta plot, Angoff's modified delta plot, Stricker's partial correlation index, and direct comparison of item difficulties) were compared for their ability to identify biased items at three stages of test development. The techniques were applied to…

To answer several questions about the Ohio statewide high school proficiency testing program, correlations of student performance on the ninth-grade proficiency test with other measures of reading and mathematics were studied for approximately 4,600 students in the Cleveland (Ohio) City School District. The performance of students from higher…