When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

This article presents the analysis of evaluation methods used in a well-designed and comprehensive evaluation effort of a significant Extension program. The evaluation data collection methods were analyzed by questionnaire mode and timing of follow-up surveys. Response rates from the short- and long-term follow-ups and different questionnaire…

This chapter provides examples of innovative methods and tools to collect, analyze, and report both quantitative and qualitative data in student affairs assessment.

Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

Special education in Saudi Arabia was formally established in 1962. The earliest cited literature on special education written in English was a 1970 government report. This article presents results from the first synthesis of internationally published Saudi special education literature over a 44-year period. This synthesis yielded information…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

With the increasing demand for accountability of Extension programming, Extension professionals need to apply rigorous evaluation designs. Randomized designs are useful to eliminate selection biases of program participants and to improve the accuracy of evaluation. However, randomized control designs are not practical to apply in Extension program…

These appendices describe the matching process used to identify an appropriate set of comparison schools for use in the report evaluating Year 2 of the Expanded Success Initiative, "Changing How High Schools Serve Black and Latino Young Men." As described in Chapter 2 of the report, selecting schools similar to ESI schools to serve as a…

The National Reporting System (NRS) is the accountability system for the federally funded, State-administered adult education program. It addresses the accountability requirements of the Adult Education and Family Literacy Act, Title II of the Workforce Investment Act (WIA-P.L.105-220). This document presents (1) the NRS measures that allow…

Findings from the ninth triennial administration of the National Survey of First-Year Seminars, describing the nature and extent of first-year seminars on American college campuses. Drawn from a broad sample of colleges and universities from every institutional type, control, and size, the survey addresses topics including seminar characteristics…

To support the implementation of the Common Core State Standards (CCSS), the Bill and Melinda Gates Foundation invested in the development and dissemination of two tools aimed at operationalizing classroom instruction based on the standards: (1) the Literacy Design Collaborative (LDC)'s Framework; and (2) the Math Design Collaborative (MDC)'s…

In 2004, Lumina Foundation for Education launched "Achieving the Dream: Community Colleges Count," a national initiative aimed at improving success among community college students, particularly low-income students and students of color. Now encompassing more than 130 institutions in 24 states and the District of Columbia, Achieving the…

In January 2009, in the last week of the Bush Administration, the U.S. Department of Education (ED), upon orders from the departing political appointee staff, published the final report in a long running National Evaluation of Upward Bound (UB). The study was conducted by the contractor, Mathematica Policy Research. After more than a year in…

The research reported in this article lends support to using matrix sampling procedures with paired comparisons in survey research. When a large number of items are to be assessed, matrix sampling proves to be a reliable and effective way to obtain survey data. (Author/CT)