The Lognormal Response Time (LNRT) model measures the speed of test-takers relative to the normative time demands of items on a test. The resulting speed parameters and model residuals are often analyzed for evidence of anomalous test-taking behavior associated with fast and poorly fitting response time patterns. Extending this model, we…

In data collected from virtual learning environments (VLEs), item response theory (IRT) models can be used to guide the ongoing measurement of student ability. However, such applications of IRT rely on unbiased item parameter estimates associated with test items in the VLE. Without formal piloting of the items, one can expect a large amount of…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

The linear logistic test model (LLTM) breaks down the item parameter of the Rasch model as a linear combination of some hypothesized elementary parameters. Although the original purpose of applying the LLTM was primarily to generate test items with specified item difficulty, there are still many other potential applications, which may be of use…

A literature review and bibliography on questionnaire construction are presented. The broad definition of questionnaire includes scales, structured interview forms, survey forms, and similar paper and pencil instruments used to elicit responses and collect information. A comprehensive literature search of journal articles, books, and reports in…

Providing examinees with advanced knowledge of the difficulty of an item led to an increase in test performance with no loss of reliability. This finding was consistent across several test formats. ( Author/JKS)

This article outlines the advantages and disadvantages of various question types in tests for library classes, including selected-response, constructed-response and alternative-response test items. It examines a test case in which students in a for-credit library course were given a take home quiz with search story problems. Sample "search story"…

Literature on the development of classroom achievement tests for high school and college level hearing impaired students is reviewed, with emphasis on achievement tests designed to ascertain whether a particular unit of instruction has been understood as it was presented. The paper reviews: the syntactical structure and vocabulary of test items;…

The study investigated the effect of response mode variation (the use or non-use of separate answer sheets) on subject responses (N = 1017) to affective instruments treating both instrument and subject characteristics. Instrument characteristics examined included attitudinal versus personality scale composition, scale items written in first versus…

Over the past decade, developers of the National Assessment of Educational Progress (NAEP) have changed substantially the mix of item types on the NAEP assessments by decreasing the numbers of multiple-choice questions and increasing the numbers of questions requiring short- or extended-constructed responses. These changes have been motivated…

To discover factors which contribute to a high response rate for questionnaire surveys, the preferences of 150 college teachers and teaching assistants were studied. Four different questionnaire formats using 34 common items were sent to the subjects: open-ended; Likert-type (five points, from "strong influence to return," to…

The effects of humorous test questions on test performance of high and low-anxious college students was investigated. It was hypothesized that humor should reduce the anxiety level of high-anxious subjects, and thus improve their performance, while having little effect on low-anxious subjects. Students were assigned to a low or high-anxious group…