Education researchers often encounter scenarios where an abrupt policy change occurs within or across jurisdictions or populations that affect key student outcomes. Difference-in-differences is a research design analysts can use to estimate causal effects of these "natural experiments." This article introduces education researchers to…

As lines between research paradigms continue to blur with the ever-increasing popularity of mixed methods research, there are useful, and occasionally oxymoronic, opportunities for educational researchers to juxtapose tools from opposing methods. The gold standard is just not possible in so much of what we do with small-scale research, nor is it…

Donald Campbell's approach to causal inference (D. T. Campbell, 1957; W. R. Shadish, T. D. Cook, & D. T. Campbell, 2002) is widely used in psychology and education, whereas Donald Rubin's causal model (P. W. Holland, 1986; D. B. Rubin, 1974, 2005) is widely used in economics, statistics, medicine, and public health. Campbell's approach focuses on…

This article outlines the planning towards a research design to learn about leadership as it is constructed, experienced and developed in schools. It is intended that the research would go beyond an individual's account to gain an insight into the relationships and social dynamic within the organization. The hypothesis is that the degree of…

This paper examines representative research in information science and compares its designs to an abstract ideal of the experimental research design. Threats to validity of conclusions are highlighted, including history, maturation, testing, instrumentation, statistical regression, selection biases, experimental mortality, and selection-maturation…

Much of the current rhetoric in areas of child and family research and in early childhood education emphasizes the importance of listening to children in research that has a direct impact on them. Despite this, there remain qualms in some research contexts and amongst some researchers about the reliability, validity and generalizability of…

This article describes the strengths and weaknesses of different models of classification (primarily monothetic and polythetic) and then focuses on cluster analysis as a method of pursuing a polythetic model. Design features that need to be incorporated in a cluster analytic study are discussed in relation to theory formulation, internal validity,…

This article is the third contribution to a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information that decision makers can use with confidence when conducting program evaluation and policy assessment…

This paper examines the metatheoretical concepts associated with ethnographic/qualitative educational inquiry and overviews the more commonly utilized research designs, data collection methods, and analytical approaches. The epistemological and ontological assumptions of this newer approach differ greatly from those of the traditional educational…

This study addressed the validity of using a five-state multifaceted approach to defining reading disabilities. Comparison of 204 reading-disabled (selected by criteria such as intraindividual differences and low achievement) and normally achieving junior high students on motivational, cognitive, and metacognitive variables (usually associated…

Review of the research literature on functional assessment-based interventions for students with or at risk for emotional and behavioral disorders identified key issues in the design of these studies. Issues included (1) an emphasis on descriptive analysis; (2) interventions employed and procedural integrity; (3) generalization and maintenance;…

Only a limited number of single-subject studies exist in the literacy field, despite the upsurge of such studies in a wide variety of disciplines. The phrase "single-subject" refers not so much to the number of subjects, but to the way the data are analyzed: each subject's responses are examined individually; they are not averaged with…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

Experimental methods have been used extensively for many years to conduct research in education and psychology. However, applications of experiments to investigate technology and other instructional innovations in higher education settings have been relatively limited. The present paper examines ways in which experiments can be used productively…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…