Although researchers can easily select probability samples of addresses using the U.S. Postal Service's Delivery Sequence File, randomly selecting respondents within households for surveys remains challenging. Researchers often place within-household selection instructions, such as the next or last birthday methods, in survey cover letters to…

In UK medical schools, five-option single-best answer (SBA) questions are the most widely accepted format of summative knowledge assessment. However, writing SBA questions with four effective incorrect options is difficult and time consuming, and consequently, many SBAs contain a high frequency of implausible distractors. Previous research has…

Objective: To evaluate a text message (SMS) program as a booster to an in-person alcohol intervention with mandated college students. Participants: Undergraduates (N = 224; 46% female) who violated an on-campus alcohol policy over a 2-semester period in 2014. Methods: The SMS program sent drinking-related queries each Thursday and Sunday and…

This paper investigates the relationship between blank and non-blank email subject lines on levels of response to a solicitation to participate in an interview, and on participation in a web survey. Email use has grown substantially in recent years, presenting significant opportunity to the empiricist seeking research respondents. However,…

Eight short surveys based on select items from the National Survey of Student Engagement (NSSE) were administered to approximately five hundred students over a nine-week period at five diverse colleges and universities. The goal of the experiment was to investigate what impact a survey panel data collection approach would have on recruitment,…

Although there are widely held assumptions about the characteristics of peer bullying that are of greatest concern, very few studies have empirically assessed which characteristics most affect its impact. The current research addresses this gap by using a nationally representative U.S. sample of youth ages 10-20 to examine the relative effects of…

Surveys often spend substantial money on multiple mailings and telephone calls to ensure high overall response rates and adequate representation of hard-to-reach demographic subgroups. We examine the extent to which an additional mailing and additional sets of telephone calls are effective in attaining these goals across a variety of subgroups in…

Research has begun to show that certain schoolwide characteristics--such as student-centered learning environments, leadership, and safety--can be important for improving student outcomes. In keeping with these insights, school improvement efforts around the country are becoming less narrowly focused on the performance of individual students and…

A national study of family and consumer sciences (FCS) professionals in higher education was analyzed as a case study to illustrate procedures useful for investigating issues related to FCS. The authors analyzed response rates of more than 1,900 FCS faculty and administrators by comparing those invited to participate and the 345 individuals who…

Concerns over the usefulness and validity of student ratings of instruction (SRI) have continued to grow with online processes. This paper presents seven common and persistent concerns identified and tested during the development and implementation of a revised SRI policy at a Canadian research-intensive university. These concerns include bias due…

This article presents the analysis of evaluation methods used in a well-designed and comprehensive evaluation effort of a significant Extension program. The evaluation data collection methods were analyzed by questionnaire mode and timing of follow-up surveys. Response rates from the short- and long-term follow-ups and different questionnaire…

Calendar instruments incorporate aided recall techniques such as temporal landmarks and visual time lines that aim to reduce response error in retrospective surveys. Those calendar instruments have been used extensively in off-line research (e.g., computer-aided telephone interviews, computer assisted personal interviewing, and paper and pen…

Recent research has shown mixed-mode surveys are advantageous for organizations to use in collecting data. Previous research explored web/mail mode effects for four-contact waves. This study explores the effect of web/mail mixed-mode systems over a series of contacts on the customer satisfaction data from the Florida Cooperative Extension Service…

This paper describes the effects that organisational reforms at Spanish public universities have had on the job satisfaction of the academics they employ, using an adaptation of the "Job Descriptive Index". The work is based on the lecturers' opinions as expressed through a questionnaire. The research concludes that the most visible and…

Congregation-based health program evaluations often rely on surveys, but little documentation is available regarding specific methods and challenges. Here we describe methods used to achieve acceptable response rates (73-79%) in a survey of HIV-related attitudes and behaviors in two African American and three Latino churches in high HIV-prevalence…