Rigor evaluation in mixed methods research is a growing need. Linking rigor to Hong and Pluye's (2019) concepts of methodological and reporting quality, the purpose of this article is to operationalize and expand Harrison et al.'s (2020) Rigorous Mixed Methods Framework. Drawing from a systematic methodological review of 66 inclusive education…

Although well established in developed countries, Ethics review boards in the academia, and specifically for social and behavioral sciences (SBS) research, is a relatively new, and still a controversy inducing endeavor. This study explores the establishment and functioning of ERBs in Israeli academia, serving as a case study for the challenges and…

This case study is based on a program evaluation of a professional certificate program that trains early childhood care and education providers to build and support young children's emotional literacy. The research project described in the case study will address approaches to methodological combination, justifying research design and changes to…

There is an expectation that all researchers will act ethically and responsibly in the conduct of research involving humans and animals. While research ethics is mentioned in quality indicators and codes of responsible researcher conduct, it appears to have little profile in doctoral assessment. There seems to be an implicit assumption that…

There is significant controversy over what counts as evidence in the evaluation of social interventions. It is increasingly common to use methodological criteria to rank evidence types in a hierarchy, with Randomised Controlled Trials (RCTs) at or near the highest level. Because of numerous challenges to a hierarchical approach, this article…

Our understanding of programs is enhanced when trained, skilled, and observant evaluators go "into the field"--the real world where programs are conducted--paying attention to what's going on, systematically documenting what they see, and reporting what they learn. The article opens by presenting and illustrating twelve reasons for…

The purpose of this paper is to provide a basis for judging the adequacy of evaluation plans or, as they are commonly called, evaluation designs. The authors assume that using the procedures suggested in this paper to determine the adequacy of evaluation designs in advance of actually conducting evaluations will lead to better evaluation designs,…

This article is a response to the growing criticisms of the British Educational Research Association (BERA) and Economic and Social Research Council (ESRC) ethical guidelines on anonymity and pseudonymity as default positions for participants in qualitative educational research. It discusses and responds to those criticisms under four…

This descriptive report outlines an innovative project in which Earth Charter International is actively involved. The project aims to develop approaches, indicators and tools for Civil Society Organisations (CSOs) to be able to measure values-based aspects and impacts of their work at the project level. Many CSOs have an intuitive feeling that…

Detecting early signs of autism is essential for timely diagnosis and initiation of effective interventions. Several research groups have initiated prospective studies of high-risk populations including infant siblings, to systematically collect data on early signs within a longitudinal design. Despite the potential advantages of prospective…

All evaluators face the challenge of striving to adhere to the highest possible standards of ethical conduct. Translating the AEA's Guiding Principles and the Joint Committee's Program Evaluation Standards into everyday practice, however, can be a complex, uncertain, and frustrating endeavor. Moreover, acting in an ethical fashion can require…

Describing the state of the science of ABA, this comprehensive handbook provides detailed information about theory, research, and intervention. The contributors are leading ABA authorities who present current best practices in behavioral assessment and demonstrate evidence-based strategies for supporting positive behaviors and reducing problem…

This final chapter summarizes the areas of consensus in the debate on method choice, including considering the nature of the primary evaluation questions, the nature of the phenomenon being evaluated, the constraints on the evaluation, and ethical issues. Pragmatic suggestions based on these areas as well as areas still in contention are offered.…

Discusses need for measuring the impact of career counseling in a more precise and meaningful way. Includes some of the issues raised by a survey of career counseling outcome research. Implications of these issues are presented in the form of a set of recommendations for researchers. (Author)

The design and conduct of a national evaluation study is discussed, demonstrating that a control group may not provide the no-cause baseline information expected. Resolution of this problem requires reexamination of paradigms, research practices, and policies, as well as the underlying real world constraints and views that generate them. (PN)