This research examines the effects of nonattending response pattern contamination and select response style patterns on measures of model fit (CFI) and internal reliability (Cronbach's [alpha]). A simulation study examines the effects resulting from percentage of contamination, number of manifest items measured and sample size. Initial results…

This paper presents a framework for choosing between 4-and 6-point response options for use with online surveys. Using data that have both 4- and 6-point Likert-type items, we compare correlations, fit of factor analytic models, and several different reliability estimates as a way of identifying if there is empirical support for choosing a…

This article investigates the motivations and strategies employed by respondents to a Likert-style course evaluation at a UK university. These attitude surveys, generating large amounts of quantitative data, are commonly used in quality assurance procedures across UK higher education institutions. Similar student survey results are now scrutinised…

The Partnership for Assessment of Readiness for College and Careers (PARCC) field tests during the spring of 2014 provided an opportunity to investigate the quality of the items, tasks, and associated stimuli. HumRRO conducted several research studies summarized in this report. Quality of test items is integral to the "Theory of Action"…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

Extreme response set, the tendency to prefer the lowest or highest response option when confronted with a Likert-type response scale, can lead to misfit of item response models such as the generalized partial credit model. Recently, a series of intrinsically multidimensional item response models have been hypothesized, wherein tendency toward…

Existing literature indicates that physical attractiveness positively affects variables such as income, perceived employee quality and performance evaluations. Similarly, in the academic arena, studies indicate instructors who are better looking receive better teaching evaluations from their students. Previous analysis of the website…

Introduction: The Multiple Mini-Interview (MMI) format appears to mitigate individual rater biases. However, the format itself may introduce structural systematic bias, favoring extroverted personality types. This study aimed to gain a better understanding of these biases from the perspective of the interviewer. Methods: A sample of MMI…

Few studies have explored the subjective mental health of adolescents with intellectual disabilities, while proxy ratings indicate an overrepresentation of mental health problems. The present study reports on the design and an initial empirical evaluation of the Well-being in Special Education Questionnaire (WellSEQ). Questions, response scales,…

Asking college students how much they have learned or grown is a common assessment practice in student affairs and elsewhere. Unfortunately, recent research suggests that these self-reported gains do a very poor job of measuring actual student learning and growth. This paper provides an overview of the psychological process of how students likely…

We investigated the psychometric validity and reliability of the Suicide Status Form-II (SSF-II) developed by Jobes, Jacoby, Cimbolic, and Hustead (1997). Participants were 149 psychiatric inpatients (108 suicidal; 41 nonsuicidal) at the Mayo Clinic. Each participant completed assessment measures within 24 hours of admission and 48-72 hours later.…

Historically, responses to the Course Experience Questionnaire (CEQ) were required to be collected by self-administered paper or online questionnaire to be eligible for official analysis. CEQ responses collected by telephone were excluded from the final analysis file to minimise the potential for bias due to mode effects: systematic variation in…

Forensic clinicians have the option of employing well-validated structured interviews when conducting competency to stand trial (CST) evaluations to ensure adequate coverage of the three prongs delineated in "Dusky v. United States". This study evaluates the effects of feigning on the Evaluation of Competency to Stand Trial-Revised…

This study examined for the first time the test-retest reliability of theory-of-mind tasks when administered to children with Autism Spectrum Disorders (ASD). A total of 16 questions within 9 tasks targeting a range of content and complexity were administered at 2 times to 17 children with ASD. In all, 13 questions demonstrated adequate…

Compared Edwards Personality Inventory (EPI) reliability under the Edwards' instructions (subject responds to the items as he believes those who know him best would answer if asked to describe him) versus the more conventional instructions (to describe yourself directly as you see yourself). (Author/RC)