The purpose of this article is to identify proper uses for mixed methods in leadership research and assessment. This article will highlight research and assessment questions that are best served by mixed methods and will offer practitioner-friendly guides and examples for integrating quantitative and qualitative data to help eat the whole whale…

Although experimental evaluations have been labeled the "gold standard" of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet,…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Realist evaluation (RE) is a research design increasingly used in program evaluation, that aims to explore and understand the influence of context and underlying mechanisms on intervention or program outcomes. Several methodological challenges, however, are associated with this approach. This article summarizes RE key principles and examines some…

We present a framework to help those working in Extension connect program designs with appropriate evaluation designs to improve evaluation. The framework links four distinct Extension program domains--service, facilitation, content transformation, and transformative education--with three types of evaluation design--preexperimental,…

School counselors are tasked with many activities, including demonstrating the effectiveness of interventions they use with students. The American School Counselor Association recommends that school counselors include assessment, appraisal, and evaluation of delivery and program management in their school counseling program. Single-case research…

The major aim of this manuscript is to bring together two important topics that have recently received much attention in child and adolescent research, albeit separately from each other: single-case experimental designs and statistical mediation analysis. Single-case experimental designs (SCEDs) are increasingly recognized as a valuable…

Most agricultural research organizations strive to address societal challenges and contribute to positive societal impacts. Fulfilling this ambition involves embedding a culture of impact in organizational culture, which, in our view, entails three main elements: understanding the role of the research community in contributing to impacts over the…

Single-case research methods provide the basis for evaluating effective instructional approaches in special education. The purpose of this article is to provide special educators an overview of single-case research methods, with an emphasis on how these designs are used to establish whether an instructional practice relates to improved learner…

Interventions often require multiple decisions to improve outcomes for every student. Whether the decision to implement a practice, tailor an existing protocol, or change approaches, these decisions should be based on individual variables and outcomes via a sequence of treatment. To develop adaptive interventions that have sufficient evidence to…

Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…