The impact of response styles such as extreme response style (ERS) on trait estimation has long been a matter of concern to researchers and practitioners. This simulation study investigated three methods that have been proposed for the correction of trait estimates for ERS effects: (a) mixed Rasch models, (b) multidimensional item response models,…

The statistical analysis of answer changes (ACs) has uncovered multiple testing irregularities on large-scale assessments and is now routinely performed at testing organizations. However, AC data has an uncertainty caused by technological or human factors. Therefore, existing statistics (e.g., number of wrong-to-right ACs) used to detect examinees…

Large-scale surveys typically exhibit data structures characterized by rich mutual dependencies between surveyed variables and individual-specific skip patterns. Despite high efforts in fieldwork and questionnaire design, missing values inevitably occur. One approach for handling missing values is to provide multiply imputed data sets, thus…

We examine the effects of interviewer-respondent familiarity on both response patterns and rates of item nonresponse when self-administered questions (SAQs) are used. We use SAQ data from a survey in which the researchers experimentally ensured that there would be varying degrees of familiarity between interviewers and respondents. Our results…

Formative feedback currently receives attention as an effective means of increasing student learning. However, how to frame feedback to achieve the best effect is an ongoing debate. In this study we analyse a written data-set of 174 segments of teacher feedback and student response, coded using 10 emergent feedback and 14 response categories. As…

Problem Statement: The use of self-report questionnaires may lead to biases such as careless responses that distort the research outcomes. Early detection of careless responses in self-report questionnaires may reduce error, but little guidance exists in the literature regarding techniques for detecting such careless or random responses in…

Measuring values in sociological research sometimes involves the use of ranking data. A disadvantage of a ranking assignment is that the order in which the items are presented might influence the choice preferences of respondents regardless of the content being measured. The standard procedure to rule out such effects is to randomize the order of…

Inattentiveness and social desirability might be particularly problematic for self-report scales in creativity and arts research. Respondents who are inattentive or who present themselves favorably will score highly on scales that yield positively skewed distributions and that assess socially valued constructs, such as scales measuring creativity…

The purpose of the present study was to assess whether intraverbal behavior, in the form of answers to questions, emerges as a result of listener training for five children diagnosed with autism. Listener responses were targeted and taught using prompting and differential reinforcement. Following successful acquisition of listener responses, the…

To measure the response style of acquiescence, researchers recommend the use of at least 15 items with heterogeneous content. Such an approach is consistent with its theoretical definition and is a substantial improvement over traditional methods. Nevertheless, measurement of acquiescence can be enhanced by two additional considerations: first, to…

The purpose of this study is to evaluate the extent to which item response theory (IRT) proficiency estimation methods are robust to the presence of aberrant responses under the "GRE"® General Test multistage adaptive testing (MST) design. To that end, a wide range of atypical response behaviors affecting as much as 10% of the test items…

Acquiescence response bias is the tendency to agree to questionnaires irrespective of item content or direction, and is problematic for both researchers and clinicians. Further research is warranted to clarify factors relating to the confounding influence of acquiescence. Building on previous research that investigated the interaction between…

This study investigated the role of socially desirable responding (SDR) in responses to survey questions about financial behavior among college students. Data was collected via an online survey from 1,159 students enrolled at a Midwestern university. Participants reported on credit card and savings behaviors and attitudes by answering direct…

When grading students' quizzes and exams, I find that students are seemingly always changing their answers from the right answer to the wrong answer. In fact, I have cautioned students against changing their answer. Colleagues have made similar observations and some books on test-taking strategies advise against answer-changing. In an effort to…

The Student Background survey administered along with achievement tests in studies of the International Association for the Evaluation of Educational Achievement includes scales of student motivation, competence, and attitudes toward mathematics and science. The scales consist of positively- and negatively keyed items. The current research…