Recent interest in promoting replication efforts assumes that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our…

Recent interest in promoting replication efforts assumes that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our…

Audit correspondence studies are field experiments that test for discriminatory behavior in active markets. Researchers measure discrimination by comparing how responsive individuals ("audited units") are to correspondences from different types of people. This article elaborates on the tradeoffs researchers face between sending audited…

Outside of education, many academic disciplines developed and promulgated checklists to evaluate the quality of qualitative studies. This article used an embedded mixed methods approach in three stages: development of a conceptual framework reviewing 62 guidelines; a content analysis of key areas of the guidelines; and review of dissertations to…

Experimental designs in the social sciences have received increasing attention due to their power to produce causal inferences. Nevertheless, experimental research faces limitations, including limited external validity and unrealistic treatments. We propose combining qualitative fieldwork and experimental design iteratively--moving back-and-forth…

While research into PhD programs and doctoral students' experiences has increased in recent years, fieldwork is overlooked as a source of learning and support. In education, the focus of this paper, fieldwork remains laced with notions of the anthropologist gathering data in a place that is not their own, which narrowly construct the role of the…

Based on year-long fieldwork on activist-educators' work in South Korea, I reflect on how my research complicates the ontological shift in institutional ethnography: that is, the shift that emphasizes how ruling relations are coordinated through the very actions of people. I discuss two facets of reflective pauses. First, I discuss how the ruling…

Correspondence testing to research discrimination in the marketplace has become common and the use of internet applications has allowed researchers to send greater numbers of applications. While questions of research ethics always arise when planning a correspondence test, the issue receives relatively little attention in published correspondence…

Field experiments, which are a powerful research technique, are common in some fields, but they have not been widely used in studying the effect of financial and counseling planning interventions. Financial services can benefit from the expanded use of field experiments to explore potential causal mechanisms for the effects of financial planning…

World-wide responses to the global pandemic, such as travel restrictions, border closures and lockdowns, have posed new challenges to researchers. For qualitative researchers conducting fieldwork, gathering data in person can be inapplicable (Howlett, 2021). My research investigates English as a Foreign Language (EFL) pre-service teachers' beliefs…

Despite recent emphasis on the use of randomized control trials (RCTs) for evaluating education interventions, in most areas of education research, observational methods remain the dominant approach for assessing program effects. Over the last three decades, the within-study comparison (WSC) design has emerged as a method for evaluating the…

The purpose of this study was to explore the current experiences of students and professors in a Faculty of Education graduate program that has adopted blended learning. It was also intended to uncover some of the enablers and constraints faced by faculty administration in implementing a university wide blended learning initiative. Using a…

Our understanding of programs is enhanced when trained, skilled, and observant evaluators go "into the field"--the real world where programs are conducted--paying attention to what's going on, systematically documenting what they see, and reporting what they learn. The article opens by presenting and illustrating twelve reasons for…

Netnography (Kozinets, 2010) is an ethnographic approach to study communities that exist primarily online. Engaging in online participant observation, the netnographer connects to the online community through a computer screen, and the field is located inside the screen. Although it has been used in marketing research extensively, netnography is a…

The design of experimental ecological fieldwork is difficult to teach to classes, particularly when protocols for data collection are normally carefully controlled by the class organiser. Normally, reinforcement of the some problems of experimental design such as the avoidance of pseudoreplication and appropriate sampling techniques does not occur…