The quality of data in surveys is affected by response burden and questionnaire length. With an increasing number of questions, respondents can become bored, tired, and annoyed and may take shortcuts to reduce the effort needed to complete the survey. In this article, direct evidence is presented on how the position of items within a web…

Response styles introduce construct-irrelevant variance as a result of respondents systematically responding to Likert-type items regardless of content. Methods to account for response styles through data analysis as well as approaches to mitigating the effects of response styles during data collection have been well-documented. Recent approaches…

Response style, one common aberrancy in non-cognitive assessments in psychological fields, is problematic in terms of inaccurate estimation of item and person parameters, which leads to serious reliability, validity, and fairness issues (Baumgartner & Steenkamp, 2001; Bolt & Johnson, 2009; Bolt & Newton, 2011). Response style refers to…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

Pragmatic competence is among the explicitly acknowledged sub-competences that make the communicative competence in any language (Bachman & Palmer, 1996; Council of Europe, 2001). Within the notion of pragmatic competence itself, "implicature (implied meanings)" comes to the fore as one of the five main areas there (Levinson, 1983).…

Inconsistent item-pair Variable Response Inconsistency (VRIN) and True Response Inconsistency (TRIN) scales were developed for the Jesness Inventory using 500 male and female delinquents to detect random and acquiescent sets. Specificities above 0.90 showed sensitivities up to 0.89 for VRIN and 0.85 and 0.62 for TRIN. Predictive power and overall…

Two forms of an undergraduate examination were constructed. Tests varied with respect to item truth value (true, false) and method of phrasing (positive, negative). Negatively stated items were more difficult but not more discriminating than positively stated items. False items were not more difficult but were more discriminating than true items.…

Explored utility of disguise in structured self-report assessment of psychopathology, using university students. Data indicated that under normal test-taking circumstances, use of disguised test items was not advantageous. This relationship was moderated by several dimensional parameters. Results supported rational strategy of test construction,…

The major purpose of the three studies reported here was to investigate possible differences in agreement/disagreement with attitude statements as a function of their type (with regard to positivity/negativity) and personalism. In the first study, 90 students completed scales on energy conservation and on having good study habits. Agreement varied…

A literature review and bibliography on questionnaire construction are presented. The broad definition of questionnaire includes scales, structured interview forms, survey forms, and similar paper and pencil instruments used to elicit responses and collect information. A comprehensive literature search of journal articles, books, and reports in…

The problem of response set is important for questionnaire designers and interpreters, but the public is affected as well if policy is determined on the basis of unsupported conclusions. This study focused on one of the most researched response sets, extreme responding (ER), or extreme checking styles, and its relationship to one dimension of…

A method for measuring recognition memory (free of distractors) and false recognition was based on the assumption that the subject was "honest." A distractor-free test of word recognition (a single-item test trial in which the 36 targets were presented prior to the 36 distractors) was compared with a traditional target-distractor…

Responses to various fixed test-response formats were examined for "reliability" due to systematic error; Cronbach's alphas up to .67 were obtained. Of formats tested, four-point Likert Scales were least affected while forms of lines and faces were most problematic. Possible modification in alpha to account for systematic bias is…

Content-parallel questionnaire items in which response schemes varied in one of two ways--scale alternatives were all defined or only endpoints were defined, and alternatives were numbered or lettered--were investigated on a large sample of college freshmen. (Author/JKS)

When response set is present, instead of responding to the intent of the question, the subject appears to be responding to a variable emanating from some personal characteristic. This threat to measurement reliability and validity warrants investigation of the source of response set so that questionnaire designers can minimize its occurrence. This…