Contrary to its typical presentation in scientific publications as a certain and linear process, in reality, the experimental method, not least the design aspect of it, requires a great deal of trial-and-error and ad hoc decision-making on the part of the researchers. This uncertain and contingent aspect of research, although little known outside…

Factorial surveys use a population of vignettes to elicit respondents' attitudes or beliefs about different hypothetical scenarios. However, the vignette population is frequently too large to be assessed by each respondent. Experimental designs such as randomized block confounded factorial (RBCF) designs, D-optimal designs, or random sampling…

Planned missing data designs allow researchers to have highly-powered studies by testing only a fraction of the traditional sample size. In two-method measurement planned missingness designs, researchers assess only part of the sample on a high-quality expensive measure, while the entire sample is given a more inexpensive, but biased measure. The…

This paper contrasts mixed methods design with strategic research design. Mixed methods research both advocates for itself as always better than singular research methods, while also seemingly allowing a wide variety of researchers to count their work under the very large umbrella of mixed methods. We argue for strategic research design as a set…

We explored the possibility of publication bias in the sleep and explicit motor sequence learning literature by applying precision effect test (PET) and precision effect test with standard errors (PEESE) weighted regression analyses to the 88 effect sizes from a recent comprehensive literature review (Pan & Rickard, 2015). Basic PET analysis…

Collecting data for cross-cultural research is time consuming and expensive. We report on techniques for efficient and effective cross-cultural data collection, drawn from 18 cross-cultural studies we conducted in 22 countries. We discuss research design, site selection and collaboration building, ethical review, cross-site protocol design, data…

The aim of this paper is to introduce a software that is appropriate for the generalizability theory for not only balanced but also unbalanced data sets. Because it is possible to have unbalanced data sets while conducting a study, the researchers have devised an easy solution, other than deleting data, to balance the design to cope with this…

Comparison studies conducted to determine which instructional interventions are most efficient for teaching discrete behaviors to individuals with disabilities are potentially valuable, although some threats to internal validity may be more likely in these studies. Studies included in this review typically met common internal validity standards,…

While there has been a lot of debate over the impact of online and remote learning on mental health and well-being, there has been no systematic syntheses or reviews of the research on this particular issue. In this paper, we review the research on the relationship between mental health/well-being and online or remote learning. Our review shows…

Over the past 15 years, we have seen an increase in the use of cluster randomized trials (CRTs) to test the efficacy of educational interventions. These studies are often designed with the goal of determining whether a program works, or answering the what works question. Recently, the goals of these studies expanded to include for whom and under…

This paper presents the main methodological issues met with during the research on adolescent everyday life information behavior in the context of making informed decisions, which was carried out in Croatia from 2018 to 2020. It does not focus on the research results, but rather on the methodological issues and concerns that had occurred stemming…

Particular ethical tensions and dilemmas emerge when conducting qualitative educational research. This is further compounded where the predominant approach to research ethics is underscored by a dominant principalism which construes ethical rules as both universal and absolute. This article focuses on the 'perfect ethical storm' which is arguably…

This research note offers a critical reflection of the process of conducting qualitative research in the Irish primary school setting. The research discussed took place during the school year 2016-2017. It explored primary school children's understandings of citizenship and, the kinds of collective social actions they participated in as citizens…

The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random…

Mixed methodology holds considerable promise for the field of literacy research, yet it continues to be underrepresented in published research. The purpose of this study was to identify potential problems in conducting and publishing reports of mixed methods research in literacy. Predicated on a view of research as principled argument, we…