Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010-2011. A key step is the construction of indices of nonresponse bias based on proxy…

The Student Evaluation of Teaching (SET) instrument provides insight for instructors and administrators alike, often touting high response-rates to endorse their validity and reliability. However, response-rate alone omits consideration for "adequate quantity of 'observational sampling opportunity' (OSO) data points" (e.g., high student…

"Apprentice and Trainee Outcomes 2021" provides a summary of the outcomes of apprentices and trainees who completed an apprenticeship or traineeship during 2020, with the data collected in mid-2021. The figures are derived from apprentices' and trainees' responses to the National Student Outcomes Survey (SOS), which is an annual survey…

The PPIC Statewide Survey was inaugurated in 1998 to provide a way for Californians to express their views on important public policy issues. The survey provides timely, relevant, nonpartisan information on Californians' political, social, and economic opinions. It seeks to inform and improve state policymaking, raise awareness, and encourage…

Postelection surveys regularly overestimate voter turnout by 10 points or more. This article provides the first comprehensive documentation of the turnout gap in three major ongoing surveys (the General Social Survey, Current Population Survey, and American National Election Studies), evaluates explanations for it, interprets its significance, and…

We discuss methods that can improve response rates in large-scale cross-sectional and longitudinal studies. Regardless of the specific study topic, sample member population, or method of contact, data collections should be designed with certain core principles in mind: legitimizing the study to prospective participants; presenting study…

This guide describes a five-step collaborative process that educators can use with other educators, researchers, and content experts to write or adapt questions and develop surveys for education contexts. This process allows educators to leverage the expertise of individuals within and outside of their organization to ensure a high-quality survey…

This Workshop on Survey Methods in Education Research tool consists of a facilitator guide and workshop handouts. The toolkit is intended for use by state or district education leaders and others who want to conduct training on developing and administering surveys. The facilitator guide provides materials related to various phases of the survey…

This chapter examines the impact of declining student response rates on surveys administered at small- and medium-sized institutions. The potential for nonresponse bias and its effects are addressed.

Realistic response rate expectations are important for successfully allocating and managing data collection efforts under limited resources. Interviewer performance is often evaluated against response rate standards, and face-to-face interviewer performance can vary due to, in part, the socioeconomic characteristics of the neighborhoods in which…

Written for students and researchers who wish to understand the conceptual and practical aspects of sampling, this book is designed to be accessible without requiring advanced statistical training. It covers a wide range of topics, from the basics of sampling to special topics such as sampling rare populations, sampling organizational populations,…

Research has begun to show that certain schoolwide characteristics--such as student-centered learning environments, leadership, and safety--can be important for improving student outcomes. In keeping with these insights, school improvement efforts around the country are becoming less narrowly focused on the performance of individual students and…

In survey sampling the randomized response (RR) technique can be used to obtain truthful answers to sensitive questions. Although the individual answers are masked due to the RR technique, individual (sensitive) response rates can be estimated when observing multivariate response data. The beta-binomial model for binary RR data will be generalized…

This article provides an overview of issues involved with traditional paper versus online course evaluations. Data were gathered from university faculty, who transitioned from traditional paper to online course evaluations. Faculty preferred traditional course evaluations versus online course evaluations by a small margin. However, faculty…

The online survey is a popular tool for taking the pulse of an alumni body. However, response rates for these surveys have been declining over the years, making them potentially less useful. Are there easy ways to increase these rates? The author has conducted a number of experiments to try to find that out. He discusses surveys that explored…