Two forms of a teacher rating questionnaire, Student Reaction to Instruction, were administered to college students. The regular format used category scaling; the 631 responding students selected a number between one and five. Experimental "ratio production (multiply-divide)" evaluations were also completed by 26 subjects along with the…

A method for establishing minimal acceptable performance levels for criterion referenced multiple choice examinations is described and two procedures for evaluating its validity are discussed. The method involves assigning a priori item difficulties based on the similarity between the distractor and the correct response. In estimating the validity…

Although the "Don't Know" (DK) option has received telling criticism in maximum performance summative tests, its potential use in formative evaluation was considered and judged to be more promising. The pretest of an instructional module was administered with DK options. Examinees were then required to answer each question to which they had…

The contention is made that group performance data are useful in the construction and interpretation of criterion-referenced tests. The Mastery Learning Test Model, which was developed for analyzing criterion-referenced test data, is described. An estimate of the proportion of students in an instructional group having achieved the referent…

Stability of performance on a criterion referenced reading test was examined for 413 students in grades one through six. The test, which measures 367 behavioral reading objectives, was administered twice to each student, with an interval of at least three weeks between the first and second administrations. Three statistical indices of permanence…

A study investigated the hypothesis that poor comprehension or recall of task demands, rather than a putative lack of goal directedness, is a possible source of learning-disabled children's poor performance of experimental tasks. Clear instructions substantially facilitated performance by both normally achieving and learning disabled children of…

A basic structure approach is proposed for obtaining multidimensional scale values for attitude, achievement, or personality items from response data. The technique permits the unconfounding of scale values due to response bias and content and partitions item indices of popularity or difficulty among a number of relevant dimensions. (Author/BH)

In a replication of an earlier study, a questionnaire with items lacking content and merely containing answer possibilities was administered to a sample of Dutch freshmen psychology students. Subjects showed a preference for positive options over negative options. (Author/JKS)

The goal of this study was to assess the relative merit of various ranges and types of response scales in terms of respondent satisfaction and comfort and the nature of the elicited information in a population of seventh grade students. Three versions of an attitudinal questionnaire, each containing the same items but employing a different…

The purpose of this study was to determine whether item difficulty is significantly affected by language difficulty and response set convergence. Language difficulty was varied by increasing sentence (stem) length, increasing syntactic complexity, and substituting uncommon words for more familiar terms in the item stem. Item wording ranged from…

The first of several planned volumes of Free Response Test Items contains geology questions developed by the Assessment and Evaluation Unit of the New South Wales Department of Education. Two additional geology volumes and biology and chemistry volumes are in preparation. The questions in this volume were written and reviewed by practicing…

One of the major assumptions of latent trait theory is that the items in a test measure a single dimension. This report describes an investigation of procedures for forming a set of items that meet this assumption. Factor analysis, nonmetric multidimensional scaling, cluster analysis and latent trait analysis were applied to simulated and real…

This paper explores the effects of item choice on ability estimation when using a tailored testing procedure based on the Rasch simple logistic model. Most studies of the simple logistic model imply that ability estimates are totally independent of the items used, regardless of the testing procedure. This paper shows that the ability estimate is…

An application of the two-paramenter logistic (Rasch) model to tailored testing is presented. The model is discussed along with the maximum likelihood estimation of the ability parameters given the response pattern and easiness parameter estimates for the items. The technique has been programmed for use with an interactive computer terminal. Use…

The rationale and development of a new measure of five methods of handling interpersonal conflict (competing, collaborating, compromising, avoiding, and accomodating), which attempts to control for the social desirability response bias is described. The instrument--the Management of Differences Exercise, or the MODE instrument--is briefly compared…