The authors examined student responses to faculty traits. Earlier findings revealing a preference for male instructors were obtained before female faculty and students were prevalent on college campuses and may have reflected a male demographic similarity effect. It was hypothesized that students would more favorably evaluate faculty who were…

The number of students taking at least 1 online course has surpassed 7.1 million and represents 33% (21.3 million) of all higher education students (Allen & Seaman, 2013). With the growing number of online courses, credibility may be questioned. Are there effective evaluation processes in place? This article will describe the results of a…

Research on examinees' response changes on multiple-choice tests over the past 80 years has yielded some consistent findings, including that most examinees make score gains by changing answers. This study expands the research on response changes by focusing on a high-stakes admissions test--the Verbal Reasoning and Quantitative Reasoning measures…

Questionnaire surveys have found a strong relationship between students' perceptions of their courses and their approaches to studying, but this might result from the operation of response biases. Responses to the Course Experience Questionnaire and the Revised Approaches to Studying Inventory from 2137 students taking seven courses by distance…

Today's Millennials, the first generation to reach their majority in this millennium, often compartmentalize their faith lives from their social and work lives. MidAmerica Nazarene University (MNU) offers a course in Spiritual Formation once each spring. The enrollment for this elective course ranges from twelve to eighteen students per class.…

When respondents answer paper-and-pencil (PP) questionnaires, they sometimes modify their responses to correspond to previously answered items. As a result, this response bias might artificially inflate the reliability of PP questionnaires. We compared the internal consistency of PP questionnaires to computerized questionnaires that presented a…

Existing literature indicates that physical attractiveness positively affects variables such as income, perceived employee quality and performance evaluations. Similarly, in the academic arena, studies indicate instructors who are better looking receive better teaching evaluations from their students. Previous analysis of the website…

Stereotypes, expectations, and emotions influence an observer's ability to detect and categorize objects as guns. In light of recent work in action-perception interactions, however, there is another unexplored factor that may be critical: The action choices available to the perceiver. In five experiments, participants determined whether another…

Structural equation modelling is used to measure the existence of a response style (in particular, acquiescence) behind three balanced Likert scales measuring different concepts in a questionnaire for student evaluation of teaching in higher education. Exploration with one sample (n = 1125) and confirmation in a second sample (n = 710) from a…

Questionnaire instruments are frequently administered in digital formats, largely web-based, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263…

Response-shift bias occurs when participants' initial constructs, such as self-efficacy in teaching science, are incomplete because they do not fully conceptualize something they have yet to experience. This study examines whether elementary pre-service teachers can consistently evaluate constructs such as self-efficacy and attitudes toward…

Introduction: The Multiple Mini-Interview (MMI) format appears to mitigate individual rater biases. However, the format itself may introduce structural systematic bias, favoring extroverted personality types. This study aimed to gain a better understanding of these biases from the perspective of the interviewer. Methods: A sample of MMI…

In their comment, M. L. Rohling et al. (2011) accused us of offering a "misleading" review of response bias. In fact, the additional findings they provided on this topic are relevant only to bias assessment in 1 of the domains we discussed, neuropsychological assessment. Furthermore, we contend that, even in that 1 domain, the additional findings…

Examinee effort can impact the validity of scores on higher education assessments. Many studies of examinee effort have briefly noted gender differences, but gender differences in test-taking effort have not been a primary focus of research. This review of the literature brings together gender-related findings regarding three measures of examinee…

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that…