Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on…

Expected yield rates are essential to a survey's data collection plan, as they inform requisite sample sizes to meet the survey's objectives. Given an overall expected yield rate for a self-administered mail survey, this short take describes a simple method for using the Census Planning Database to assign differential yield rates to lower-level…

The Student Evaluation of Teaching (SET) instrument provides insight for instructors and administrators alike, often touting high response-rates to endorse their validity and reliability. However, response-rate alone omits consideration for "adequate quantity of 'observational sampling opportunity' (OSO) data points" (e.g., high student…

The PPIC Statewide Survey was inaugurated in 1998 to provide a way for Californians to express their views on important public policy issues. The survey provides timely, relevant, nonpartisan information on Californians' political, social, and economic opinions. It seeks to inform and improve state policymaking, raise awareness, and encourage…

The Federal Employee Viewpoint Survey is an annual survey of over 800,000 permanently employed civilian personnel from 87 agencies. First administered in 2002, the web-based survey measures a broad range of employee perceptions, attitudes, and behaviors, serving as a valuable tool for human resources managers to determine which aspects of an…

Background: Recruitment is a widely cited barrier of representative intellectual disability research, yet it is rarely studied. This study aims to document the rates of recruiting children with intellectual disabilities using two methods and discuss the impact of such methods on sample characteristics. Methods: Questionnaire completion rates are…

We present an equation, derived from standard statistical theory, that can be used to estimate sampling margin of error for student evaluations of teaching (SETs). We use the equation to examine the effect of sample size, response rates and sample variability on the estimated sampling margin of error, and present results in four tables that allow…

Recent guidance on the treatment of missing data in experiments advocates the use of sensitivity analysis and worst-case bounds analysis for addressing non-ignorable missing data mechanisms; moreover, plans for the analysis of missing data should be specified prior to data collection (Puma et al., 2009). While these authors recommend only that…

This report presents findings on crime and violence in U.S. public schools, using data from the 2015-16 School Survey on Crime and Safety (SSOCS:2016). First administered in school year 1999-2000 and repeated in school years 2003-04, 2005-06, 2007-08, 2009-10, and 2015-16, SSOCS provides information on school crime-related topics from the…

In survey sampling the randomized response (RR) technique can be used to obtain truthful answers to sensitive questions. Although the individual answers are masked due to the RR technique, individual (sensitive) response rates can be estimated when observing multivariate response data. The beta-binomial model for binary RR data will be generalized…

The "U.S. TIMSS and PIRLS 2011 Technical Report and User's Guide" provides an overview of the design and implementation of the Trends in International Mathematics and Science Study (TIMSS) 2011 and the Progress in International Reading Literacy Study (PIRLS) 2011 in the United States and the nine participating benchmarking states:…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

The online survey is a popular tool for taking the pulse of an alumni body. However, response rates for these surveys have been declining over the years, making them potentially less useful. Are there easy ways to increase these rates? The author has conducted a number of experiments to try to find that out. He discusses surveys that explored…

The current research was conducted using a quasi-experimental method and a sample of 456 incoming college students at a selective, mid-western Protestant, evangelical liberal arts college. The treatment group consisted of 215 incoming students who choose to participate in an optional ABOP prior to the beginning of regular orientation. The control…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) public-use data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011), which includes the first release of the public version of the third-grade data. This manual mainly provides information specific…