The Total Survey Error (TSE) paradigm provides a framework that supports the effective planning of research, guides decision making about data collection and contextualises the interpretation and dissemination of findings. TSE also allows researchers to systematically evaluate and improve the design and execution of ongoing survey programs and…

Errors in methodology occur regularly in the conduct of surveys for educational research. This paper discusses some of these errors and alternatives. In the area of survey design, errors are common in: (1) missed opportunities in attitude scale planning; (2) blunders in item construction; (3) missed opportunities in item construction; (4) blunders…

The popularity of sample surveys in evaluation and research makes it necessary for consumers to tell a good survey from a poor one. Several sources were identified that gave advice on how to evaluate a sample design used in a survey study. The sources are either too limited or too extensive to be useful practically. The purpose of this paper is to…

This paper helps researchers develop criteria for conducting surveys. Cost considerations frame the paper's suggestions. Specifically, the text advises that researchers consider the human and material resources needed, type of survey instrument, medium for conducting the survey (mail, telephone, personal interview, etc.), data analysis…

One of the goals of the Strategies and Models for Improved Learning through Effective Data Use (SMILE) project was to develop a data-capacity survey (DCS) to measure a schools capacity to use data. In this study, a DCS was developed and field tested. The DCS, which was field tested at six Milwaukee Public Schools (Wisconsin), was a pen-and-paper…

A brief, practical overview of "design effects" (DEFFs) is presented for users of the results of sample surveys. The overview is intended to help such users to determine how and when to use DEFFs and to compute them correctly. DEFFs are needed only for inferential statistics, not for descriptive statistics. When the selections for…

Although the mail survey has been widely criticized as a viable research methodology, it remains the most feasible approach for retrieving data from large, widely-dispersed populations. This paper suggests that there exists a readily accessible body of pragmatic recommendations which, if adhered to throughout the instrument design and data…

Standard statistical methods are used to analyze data that is assumed to be collected using a simple random sampling scheme. These methods, however, tend to underestimate variance when the data is collected with a cluster design, which is often found in educational survey research. The purposes of this paper are to demonstrate how a cluster design…

This paper discusses the problems of conducting research on a low-base rate sensitive family problem, parental child snatching, and proposes that telephone interviewing is a cost efficient and methodologically appropriate solution to these problems. The paper reviews the scant literature on parental child snatching by presenting what are…

The paper details a study supporting the hypothesis that people's opinions about nuclear arms control are influenced by their logically relevant beliefs about nuclear weapons, nuclear war, and the Soviet Union. The hypothesis should not be construed to imply that these beliefs are the only influences or the most powerful influences on arms control…

As the procedures of evaluation research have developed during recent years, it has become clear that the results of evaluation studies have failed to provide policy decision makers with useful information. An approach towards designing and implementing more useful evaluations--the stakeholder survey--is discussed. Stakeholders are individuals, or…

This paper shares the findings of an inquiry that evaluated 50 survey articles published in a refereed journal, "Educational Administration Quarterly," by examining the 53 sample designs reported in the articles. The paper presents a typology of the sample designs identified, discusses the problems of sample selection and estimation…

This study explored the utility of developing an alumni survey specifically designed for graduate alumni to increase response rates and provide specific information for planning. The previous year's survey of graduate alumni had seen a very low participation rate and those that had responded offered several negative comments on the survey design.…

This paper (1) presents observations about the major paradigms and assumptions that have historically shaped media research; (2) encapsulates the activities, thinking, and paradigms of the present; and (3) reports on a study in which 100 theoreticians and researchers were asked to respond to 50 hypothetical statements about media in the learning…

The methodology of using a mixed qualitative and quantitative research design to evaluate 16 "inclusive" preschool programs in a continuing study is detailed. The qualitative approach was used to understand the general phenomenon and integrated with more quantitative, structured, and precise measures in an iterative, sequential process to develop…