Background: Within the realm of public education, there is a well-known "knowledge to practice gap" on current conceptions of classroom assessment. A collaborative research project undertaken by the Elementary Teachers' Federation of Ontario (ETFO) and a research team at Queen's University explored the roots of this gap from the…

This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

Using data strategically to guide decisions and actions can have a positive effect on education practices and processes. This facilitation guide shows education data teams how to move beyond simply reporting data to applying data to direct strategic action. Using guiding questions, suggested activities, and activity forms, this guide provides…

The Early Childhood Educator Survey and the Early Childhood Administrator Survey allow users to collect consistent data on the use of child assessments and learning standards in early childhood learning settings. Each survey includes modules on educator/administrator background information, assessment use, and learning standards implementation.…

Most assessment arguments are about measurement. When is it better to use direct versus indirect measures of student learning? Is one standardized test of critical thinking better than another? Is applying rubrics to student work better than using standardized tests? How valid are self-reported measures of learning? Although these arguments are…

Methodological and political issues arise during the designing, conducting, and reporting of campus-climate studies for LGBT students. These issues interact; making a decision about a methodological issue (e.g., sample size) has an impact on a political issue (e.g., how well the findings will be received). Ten key questions that must be addressed…

Thomas Jefferson recognized the value of reason and scientific experimentation in the eighteenth century. This chapter extends the idea in contemporary ways to standards that may be used to judge the ethical propriety of randomized trials and the dependability of evidence on effects of social interventions.

This article discusses the evaluation of public health in communities, examining common indices, evaluation methods, and uses of findings. (JMB)

Program portrayal is one way of addressing the need for increased descriptive capability in evaluation research. Portrayal supplements traditional reporting by utilizing subjective, anecdotal, or impressionistic information, in an appropriately communicable form, to enrich the description of program transactions, settings, and outcomes. It is…

The ERS Standard for Program Evaluation encompass front-end analysis, evaluability assessment, formative evaluation, impact evaluation, program monitoring, and evaluation of evaluation. Written as simple admonitory statements, the Standards are organized into sections on formative and negotiation, structure and design, data collection and…

The Project on Secondary Analysis directed its attention to methodology and policy issues, focusing on reanalysis of existing data (1979-82)--surveys, program evaluations, etc.--as a vehicle for learning how to improve methods of obtaining and analyzing data, designing program evaluations, and constructing policy to enhance the quality and utility…

The six articles of this issue discuss the place of meta-analysis in the health professions and present two state-of-the-art meta-analyses using a variety of innovative methodologies, statistics, and secondary analytic procedures. A survey conducted for this issue and its sequel explores interventions to facilitate meta-analysis. (SLD)

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

Triangulation strategy results in evidence characterized by the following: (1) convergence; (2) inconsistency; and (3) contradiction. In order to render the data sensible, the researcher or evaluator must report data collection procedures, as well as the three levels of information from which explanations of social phenomena are constructed. (BJV)

The use of formal written standards as a way to improve a product or service is discussed and illustrated by an analysis of the planned development of standards for educational data reporting. The Cooperative Educational Data Collection and Reporting Standards (CEDCARS) project is intended to apply to a wide range of educational data collection…