When respondents answer paper-and-pencil (PP) questionnaires, they sometimes modify their responses to correspond to previously answered items. As a result, this response bias might artificially inflate the reliability of PP questionnaires. We compared the internal consistency of PP questionnaires to computerized questionnaires that presented a…

Structural equation modelling is used to measure the existence of a response style (in particular, acquiescence) behind three balanced Likert scales measuring different concepts in a questionnaire for student evaluation of teaching in higher education. Exploration with one sample (n = 1125) and confirmation in a second sample (n = 710) from a…

Questionnaire instruments are frequently administered in digital formats, largely web-based, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263…

Modeling capabilities for longitudinal data have progressed considerably, but questions remain on the extent to which method bias may negatively affect the validity of longitudinal survey data. The current study addresses the stability of individual response styles. We set up a longitudinal data collection in which the same respondents filled out…

The severity of bias in respondents' self-reports due to acquiescence response style (ARS) and extreme response style (ERS) depends strongly on how consistent these response styles are over the course of a questionnaire. In the literature, different alternative hypotheses on response style (in)consistency circulate. Therefore, nine alternative…

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…

Few studies have explored the subjective mental health of adolescents with intellectual disabilities, while proxy ratings indicate an overrepresentation of mental health problems. The present study reports on the design and an initial empirical evaluation of the Well-being in Special Education Questionnaire (WellSEQ). Questions, response scales,…

There has long been the suspicion amongst staff in Art & Design that the ratings given to their subject disciplines in the UK's National Student Survey are adversely affected by a combination of circumstances--a "perfect storm". The "perfect storm" proposition is tested by comparing ratings for Art & Design with those…

Previous studies of "the Chinese learner" have confounded the effects of culture and context or have used heterogeneous samples of students. In this study, 134 British students and 207 students from mainland China following 1-year postgraduate programmes at six British business schools completed the Course Experience Questionnaire (CEQ)…

Questionnaire instruments are routinely translated to digital administration systems; however, few studies have compared the differential effects of these administrative methods, and fewer yet in authentic contexts-of-use. In this study, 326 university students were randomly assigned to one of two administration conditions, paper-based (PBA) or…

Semantic differential instruments are often used to assess fluent speakers' attitudes toward people who stutter (PWS). Such instruments are prone to response bias and often lack the power to explain respondents' general impressions of PWS. To address these concerns 149 fluent university students completed an open-ended questionnaire in which they…

With the proliferation of computer networks and the increased use of Internet-based applications, many forms of social interactions now take place in an on-line context through "Computer-Mediated Communication" (CMC). Many universities are now reaping the benefits of using CMC applications to collect data on student evaluations of…

Historically, responses to the Course Experience Questionnaire (CEQ) were required to be collected by self-administered paper or online questionnaire to be eligible for official analysis. CEQ responses collected by telephone were excluded from the final analysis file to minimise the potential for bias due to mode effects: systematic variation in…

This article proposes procedures for simultaneously assessing and controlling acquiescence and social desirability in questionnaire items. The procedures are based on a semi-restricted factor-analytic tridimensional model, and can be used with binary, graded-response, or more continuous items. We discuss procedures for fitting the model (item…

In a recent article, A. Maydeu-Olivares and D. L. Coffman (2006, see EJ751121) presented a random intercept factor approach for modeling idiosyncratic response styles in questionnaire data and compared this approach with competing confirmatory factor analysis models. Among the competing models was the CT-C(M-1) model (M. Eid, 2000). In an…