Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

Previous research has shown that increasing the size of incentives can increase response rates for probability-based, cross-sectional surveys. However, the effects of incentives on web panels have not been extensively studied. We sought to answer the question: What is the effect of larger, postpaid incentives on (1) response, (2) data quality, and…

Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national…

Questionnaire design choices, such as handling 'do not know' answers or using check all that apply questions may impact the level of item- and unit nonresponse. We used experimental data from an online panel and the questions of ESS to examine how applying forced answering, offering DK/NA options and specific question formats (CATA vs. forced…

Gender differences in item nonresponse are well-documented in high-stakes achievement tests, where female students are shown to omit more items than male students. These gender differences in item nonresponse are often linked to differential risk-taking strategies, with females being risk-averse and unwilling to guess on an item, even if it could…

Telephone surveys face more and more criticism because of decreasing coverage and increasing costs, and the risk of producing socially desirable answers. Consequently, survey administrators consider switching their surveys to the web mode, although the web mode is more susceptible to item nonresponse. Still, we do not know whether this is true for…

In 2007, Randolph conducted a meta-analysis of response-card articles to determine the effect of response cards on test achievement, quiz achievement, class participation, and off-task behavior. This meta-analysis is an update of that analysis, including new studies conducted in the last 12 years. A total of 15 studies published between 2005 and…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

College students complete end-of-term surveys during their undergraduate education to report on their experiences of curriculum, faculty, and overall course satisfaction. Significant decisions are based on these surveys' results, despite limited and potentially unrepresentative results. Low student response rates on digital, electronic course…

Low response rate and quality are common challenges when administrating student evaluations of teaching (SETs). This study aimed to increase SET response rate and quality by investigating a widely recommended strategy to overcome an underlying reason for students' non-responsiveness, namely the lack of transparency about SET processes. In Study 1,…

A decline in response rates was found for agricultural education research studies using survey research methods. The use of incentives and various response modes can affect survey response rates and were the focus of this experiment. The purpose of this study was to determine the effects of survey response mode and incentives on response rates…

Virtually, all large-scale family surveys in the United States and Europe have yielded a positive view of family ties in contemporary societies. The present study examines whether surveys like these are affected by selective nonresponse. Are people with negative family ties less likely to participate in surveys, and if so, to what extent does this…

Student evaluations of teaching (SETs) can provide valuable assessment information. However, online administration of SETs has corresponded with lower SET completion rates. We examined perceptions of strategies for increasing SET completion rates and the effect of offering psychological prompts (completion goals, reminders, progress feedback) and…

Collecting biological data in representative surveys is becoming more common due to their potential to inform research and policy. Nevertheless, using nurses to collect these data can lead to unintended effects. In this paper, we investigate how nurses influence the non-response process by looking at five waves of data coming from two surveys in…

Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects…