Most faculty developers have a wide variety of rating scales that fly across their desk tops as their incremental program activities unfold during the academic year. The primary issue for this column is: What is the quality of those ratings used for decisions about people and programs? When students, faculty, and administrators rate a program or…

Previous studies of "the Chinese learner" have confounded the effects of culture and context or have used heterogeneous samples of students. In this study, 134 British students and 207 students from mainland China following 1-year postgraduate programmes at six British business schools completed the Course Experience Questionnaire (CEQ)…

Random responding to psychological inventories is a long-standing concern among clinical practitioners and researchers interested in interpreting idiographic data, but it is typically viewed as having only a minor impact on the statistical inferences drawn from nomothetic data. This article explores the impact of random responding on the size and…

The aim of the present research was to compare the use of multiple-choice questions (MCQs) as an examination method against the oral examination (OE) method. MCQs are widely used and their importance seems likely to grow, due to their inherent suitability for electronic assessment. However, MCQs are influenced by the tendency of examinees to guess…

The outcomes of surveys of "the student experience" that are sector-wide, such as the National Student Survey in the UK and the Course Experience Questionnaire in Australia, are of considerable significance for intending students and institutions. Whilst they may satisfy psychometric criteria, some aspects of their design have been…

Questionnaire instruments are routinely translated to digital administration systems; however, few studies have compared the differential effects of these administrative methods, and fewer yet in authentic contexts-of-use. In this study, 326 university students were randomly assigned to one of two administration conditions, paper-based (PBA) or…

Semantic differential instruments are often used to assess fluent speakers' attitudes toward people who stutter (PWS). Such instruments are prone to response bias and often lack the power to explain respondents' general impressions of PWS. To address these concerns 149 fluent university students completed an open-ended questionnaire in which they…

A belief bias effect in syllogistic reasoning (Evans, Barston, & Pollard, 1983) is observed when subjects accept more valid than invalid arguments and more believable than unbelievable conclusions and show greater overall accuracy in judging arguments with unbelievable conclusions. The effect is measured with a contrast of contrasts, comparing…

Over 99 percent of business schools use student evaluation of instruction to measure teaching and classroom performance. The resultant measures are utilized in judgments of merit pay, tenure, and promotion. In such an environment, an inspection of exceptions to their assumed validity is justified. This paper investigates one such issue that is…

Randomized response techniques (RRTs) aim to reduce social desirability bias in the assessment of sensitive attributes but differ regarding privacy protection. The less protection a design offers, the more likely respondents cheat by disobeying the instructions. In asymmetric RRT designs, respondents can play safe by giving a response that is…

The combination of a weak economy with a corresponding decline in tax revenue has created deficits in state and local budgets which adversely affect the financial stability of community colleges. This leaves community colleges struggling to continue to provide education in support of their missions. To provide a source of alternative revenue,…

With the proliferation of computer networks and the increased use of Internet-based applications, many forms of social interactions now take place in an on-line context through "Computer-Mediated Communication" (CMC). Many universities are now reaping the benefits of using CMC applications to collect data on student evaluations of…

Historically, responses to the Course Experience Questionnaire (CEQ) were required to be collected by self-administered paper or online questionnaire to be eligible for official analysis. CEQ responses collected by telephone were excluded from the final analysis file to minimise the potential for bias due to mode effects: systematic variation in…

It has often been suggested that actual or anticipated final grades may influence the ratings given by students in student experience surveys but few studies have been able to test this using actual grades. A study was carried out involving six courses over all four year levels of an undergraduate engineering programme, where students were asked…

Older adults sometimes show a recall advantage for emotionally positive, rather than neutral or negative, stimuli (S. T. Charles, M. Mather, & L. L. Carstensen, 2003). In contrast, younger adults respond "old" and "remember" more often to negative materials in recognition tests. For younger adults, both effects are due to…