The purpose of this paper is to provide a detailed description of the Monitoring the Future research design, including sampling design, data collection procedures, measurement content, and questionnaire format. This study assesses the changing lifestyles, values, and preferences of American youth on a continuing basis. Each year since 1975, at…

In this chapter, the authors discuss the issue of research design in conducting inquiry on college impact and demonstrate the importance of longitudinal pretest-posttest designs in maximizing the internal validity of findings. They begin by discussing the strengths and weaknesses of different types of research design in the college impact…

Pascarella (J Coll Stud Dev 47:508-520, 2006) has called for an increase in use of longitudinal data with pretest-posttest design when studying effects on college students. However, such designs that use multiple measures to document change are vulnerable to an important threat to internal validity, regression to the mean. Herein, we discuss a…

The Combined Modified Design is presented to overcome problems of internal and external validity in the conduct of true experiments in longitudinal studies. It combines a modified version of the Randomized Invitation Design with the lottery longitudinal experimental field trial situation. (SLD)

This article examines the relevancy of large-scale, quantitative methodologies in middle grades education research. Based on recommendations from national advocacy organizations, the need for more large-scale, quantitative research, combined with the application of more rigorous methodologies, is presented. Subsequent sections describe and discuss…

Even though attrition presents a serious threat to the validity of longitudinal research, there is a lack of standardization for reporting it. To examine the effectiveness of four tests for attrition -- two for external validity and two for internal validity -- the tests were applied to two large scale projects: the first, Project HASP, is a…

This executive summary presents the major findings of Interim Report III, which reports preliminary evaluation of Project Developmental Continuity (PDC). A Head Start demonstration program, PDC is aimed at promoting greater educational and developmental continuity as children make the transition from preschool to school. The report addresses three…

This occasional paper updates and extends earlier papers in the Monitoring the Future project. It provides a detailed description of the project's design, including sampling design; data collection procedures; measurement content; and questionnaire format. It attempts to include sufficient information for others who wish to evaluate the results,…

The sampling of teachers for nationwide surveys offers a challenging endeavor in obtaining a representative and adequate sample to truly represent opinions of the teachers. Ten national surveys of public school teachers conducted between 1980 and 1985 are presented with respect to their sampling design and procedures. Concepts and theoretical…

The measurement of change is such a broad topic that this article must limit its focus to a few specific subtopics. These specific topics include: longitudinal research design, attrition in research studies, the statistical analysis of difference scores, and the comparison of analysis of variance (ANOVA) and multivariate analysis of variance…