The purpose of this study was to explore how evaluators justify using story-based methodologies when examining causality. The two primary research questions of the study included: 1) what arguments are made by evaluators to justify the credibility of story-based causal methodologies to evaluation stakeholders; and 2) from the perspective of…

Evaluations that include stakeholders aim to understand their perspectives and to ensure that their views are represented. This article offers a new approach to gaining stakeholder perspectives through crowdsourcing. We recruited a sample of individuals with chronic low back pain through a crowdsourcing site. This sample coded textual data…

Before developing a school- and community-wide work plan around preventing bullying and harassment, school administrators should employ data collection tools to determine their specific areas of focus. Successful bullying prevention efforts must be driven by local data and rooted in research on effective practices. These policies must undergo…

Community-engaged scholars, practitioners, and community partners often find the language of community engagement challenging. Words like "participate," "collaborate," "partner," or "engage" fail to convey who in a community-university partnership has voice and authority in decision-making and responsibility…

During Phase III of the State Systemic Improvement Plan (SSIP), states will assess progress on implementing their SSIPs. This assessment entails evaluating and reporting on progress toward short-term and long-term outcomes as well as the SiMR. The purpose of this interactive self-assessment tool is to lead those within a state responsible for…

Chronic diseases with behavioral risk factors are now the leading causes of death in the United States. A national Behavioral Risk Factor Surveillance System (BRFSS) monitors those risk factors; however, there is a need for national and state evaluations of chronic disease surveillance systems. The Department of Health and Human Services/Centers…

"Using Data for Continuous Improvement in Educator Preparation" provides case studies that illuminate and contextualize the ways in which educator preparation programs determine the data they need to improve, collect data, analyze data, share data with stakeholders, and close the loop by making focused improvements based on the data.…

In this summary article, six recommendations for the design, implementation, and interpretation of educational evaluations are presented and discussed. These recommendations are based on common "threads" that run through most, if not all, of the papers included in this special issue. The recommendations concern (1) the need for awareness…

In March 2020, Advance CTE and the Association for Career and Technical Education (ACTE) convened a Shared Solutions Workgroup of state and national experts to explore strategies for effective Career Technical Education (CTE) data reporting and communication. Over a series of meetings, the workgroup co-designed a set of tools and resources to help…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Data use is becoming a prominent strategy for educational innovation and improvement across countries. However, the fragmentation of data collection often hinders the capacity of policymakers, researchers and practitioners to access and analyse the wealth of data routinely generated in educational institutions. A critical step towards realising…

This article describes lessons learned about implementing evaluations in hospital settings. In order to overcome the methodological dilemmas inherent in this environment, we used a practical participatory evaluation (P-PE) strategy to engage as many stakeholders as possible in the process of evaluating a clinical demonstration project.…

Learning Analytics (LA) is a field that aims to optimize learning through the study of dynamical processes occurring in the students' context. It covers the measurement, collection, analysis and reporting of data about students and their contexts. This study aims at surveying existing research on LA to identify approaches, topics, and needs for…

This document provides an overview of the critical role of fiscal data in state Part C systems. This information is intended to help state Part C lead agency staff better understand strategic fiscal policy questions, the fiscal data elements needed to address those questions, and the benefits of using these data. Fiscal data provide powerful…

Early childhood stakeholders in state departments of education are interested in knowing what child assessment measures are being used in state-funded pre-kindergarten and in kindergarten classrooms. To address this need, the Center on Enhancing Early Learning Outcomes (CEELO) performed a secondary analysis of data in the National Institute for…