Student evaluation surveys provide instructors with feedback regarding development opportunities and they form the basis of promotion and tenure decisions. Student evaluations have been extensively studied, but one dimension hitherto neglected is the actual measurement aspect: which questions to ask, how to ask them, and what answer options to…

Background: The attainment of White students at UK institutions of higher education tends to be higher than that of students from other ethnic groups, but the causes of this are unclear. Aims: This study compared White students and students from other ethnic groups in their conceptions of learning, their approaches to studying, and their academic…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

Training programmes frequently recruit students from undergraduate classes to serve as clients for counselors-in-training. Some of these clients receive external incentives for this participation, such as extra-credit or expectation of fulfilling a course requirement. It is unknown however whether or not this external incentive influences the…

"Don't know" (DK) responses to interview questions are conceptually heterogeneous, and may represent uncertainty or clear statements about the contents of memory. A study examined the subjective intent of DK responses in relation to the objective status of information queried, in the context of memory distorting procedures. Participants…

In the current investigation, the authors examined the validity of the L-r and K-r scales on the recently developed Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Y. S. Ben-Porath & A. Tellegen, in press) in measuring underreported response bias. Three archival samples previously collected for examining MMPI-2…

Purpose: The purpose of this paper is to investigate a possible favourable response pattern on scaled forms used as a means of evaluating training courses. Design/methodology/approach: In part one of the study evaluation forms were examined referring to courses were completed by 879 students attending 15 university level courses and 531 students…

Although social justice advocacy has increasingly been acknowledged as important in the field of psychology (e.g., Goodman et al., 2004; Toporek et al., 2006a, Vera & Speight, 2003), there is a dearth of empirical research examining social justice advocacy across graduate psychology students. This mixed-methods study examined demographic and…

Traditionally the measures used to evaluate the impact of an educational programme on student outcomes and the extent to which students change is a comparison of the student's pre-test scores with his/her post-test scores. However, this method of evaluating change may be problematic due to the confounding factor of response shift bias when student…

A series of 8 tests was administered to university students over 4 weeks for program assessment purposes. The stakes of these tests were low for students; they received course points based on test completion, not test performance. Tests were administered in a counterbalanced order across 2 administrations. Response time effort, a measure of the…

Purpose--The purpose of this research is to examine participants' response rate on dual style training course evaluation forms. These combine structured and open-ended formats. Pencil and paper forms have a long history of use by trainers in business and commerce and more recently in education. Research methods texts tend to have neglected the…

This review presents an overview of selected articles on the leniency hypothesis: the idea that students give higher evaluations to instructors who grade more leniently. Such articles comprise a small subset of the voluminous research on student evaluations of teaching (SETs). In this diverse literature, research methods and aims have frequently…

This study compared four methods for setting item response time thresholds to differentiate rapid-guessing behavior from solution behavior. Thresholds were either (a) common for all test items, (b) based on item surface features such as the amount of reading required, (c) based on visually inspecting response time frequency distributions, or (d)…

The present paper describes 2 studies that present a conceptual interpretation and experimental findings involving the developing and dismantling of equivalence classes consisting of terrorist stimuli. In the first study, 8 United States citizen participants were trained to match nonterrorist stimuli to American and terrorist images. Afterwards,…

When low-stakes assessments are administered to examinees, the degree to which examinees give their best effort is often unclear, complicating the validity and interpretation of the resulting test scores. This study introduces a new method for measuring examinee test-taking effort on computer-based test items based on item response time. This…