This reflective commentary on the character and role of methodology in educational and social inquiry recounts my 45-year journey as an applied researcher and evaluator, primarily in the domain of education. The journey starts in graduate school in the early 1970s, where the methodological challenge was to master "the proper methods, properly…

The recent commentary by Beaujean and Farmer (2020) on the original paper by Dixon et al. (2019) serves a cautionary tale of selective p-values, the law of small N sizes, and the type-II error. We believe these authors have crafted a somewhat questionable argument in which only 57% of the original Dixon et al. data were re-analyzed, based on a…

This comment discusses some issues about the use and reporting of experimental studies in education, illustrated by a recently published study that claimed (i) that an educational innovation was effective despite outcomes not reaching statistical significance, and (ii) that this refuted the findings of an earlier study. The two key issues raised…

Within this "Adult Education Quarterly" ("AEQ") forum, the authors call for a dialogue and examination of research methods in the field of adult and continuing education. Using the article by Boeren as a starting point, the authors analyze both qualitative and quantitative research trends and advocate for more methodological…

In this commentary, we offer a set of visual tools that can assist education researchers, especially those in the field of mathematics, in developing cohesiveness from a mixed methods perspective, commencing at a study's research questions and literature review, through its data collection and analysis, and finally to its results. This expounds…

In their essay, "Why Assessment Will Never Work...," Bacon and Stewart (2016) recommend that instead of carrying out the expensive process of experimenting themselves, many business schools would get a bigger bang for their buck if they used "published pedagogical studies that use direct measures of learning with sufficient…

This letter documents some problems in Ancaiani et al. (2015). Namely the evaluation of concordance, based on Cohen's kappa, reported by Ancaiani et al. was not computed on the whole random sample of 9,199 articles, but on a subset of 7,597 articles. The kappas relative to the whole random sample were in the range 0.07-0.15, indicating an…

The importance of data analysis software in graduate programs in education and post-graduate educational research is self-evident. However the role of this software in facilitating supererogated statistical practice versus "cookbookery" is unclear. The need to rigorously document the role of data analysis software in students' graduate…

In this commentary from Issue 14, n3, authors John Cadogan and Nick Lee applaud the paper by Aguirre-Urreta, Rönkkö, and Marakas "Measurement: Interdisciplinary Research and Perspectives", 14(3), 75-97 (2016), since their explanations and simulations work toward demystifying causal indicator models, which are often used by scholars…

The concepts and paradigms "development", "evolution", and "developmental behavior genetics" target, in their statements, populations. The laws of genetics and evolution are supposed to apply to every single case in a population. It can be counted among the major contributions of Gottlieb (1992, 1995) to have pointed…

Larry Palinkas advances the developing science of social work by providing an explanation of how social science research methods, both qualitative and quantitative, can improve our capacity to draw casual inferences. Understanding causal relations and making causal inferences--with the promise of being able to predict and control outcomes--is…

What topic would you choose if you had the luxury of writing forever? In this article, John Thelin provides his response: He would opt to write about the history of higher education in a way that relies on quantitative data. "Numbers, please!" is his research request in taking on a longitudinal study of colleges and universities over…

This rejoinder keeps the original focus on statistical computing pertaining to the correlation of student achievement between mathematics and science from the Trend in Mathematics and Science Study (TIMSS). Albeit the availability of student performance data in TIMSS and the emphasis of the inter-subject connection in the Next Generation Science…

There is a germane relationship between qualitative and quantitative approaches to social science research. The relationship is empirically and theoretically demonstrated by poverty researchers. The study of poverty, as argued in this article, is a study of both numbers and contextualities. This article provides a general overview of qualitative…

In this invited response to Moe and Anzia (2014), we describe both the points of convergence and divergence between our prior research (2007a, 2007b) and that of Moe (2005) and Moe and Anzia (2014). We also respond to Moe and Anzia's critique of our published work. Moe and Anzia's study helps to refine the policy discussion around seniority…