Survey-based research is vital in education and social sciences, offering insights into human behaviors and perceptions. The prevalence of such studies in medical education has risen by 33% over the past decade. Despite this growth, the utility of survey findings depends on the study design quality and measure validity. Many manuscripts are…

We aimed to evaluate the performance of supervised machine learning algorithms in predicting articles relevant for full-text review in a systematic review. Overall, 16,430 manually screened titles/abstracts, including 861 references identified relevant for full-text review were used for the analysis. Of these, 40% (n = 6573) were sub-divided for…

Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to…

A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

In response to considerable critique of its rigour and relevance, the field of educational research has sought to prove its validity, both in terms of its scientific legitimacy and its relevance to policy and practice. One result of this has been a heightened concern with methodology, to the extent that a form of methodolatry has developed. In…

In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches have been…

Since 1983, the Instructional Theory Framework (ITF) (and its subsequent improvements) has guided instructional designers and researchers in designing and developing useful learner experiences (LX). For the past 40 years, the ITF was laser-focused on the selection of instructional methods, downplaying delivery methods (media) and management…

Most disability research is conducted in high-income countries, despite much of the world's population living in low- and middle-income countries. Given the flexible nature of qualitative research, studies using this methodology have the potential to provide important insights into how disability is perceived across the globe. The aim of the…

Social validity of interventions is often conceptualized as a triad of the social significance of goals, the acceptability of procedures, and the importance of intervention outcomes (Wolf, 1978). Social validity measurement is considered an essential part of quality single-case design studies. Yet, the practice has been inconsistently reflected in…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

Single-case comparative studies could help identify efficient instructional procedures for individuals with disabilities. However, previous literature reported inconsistent efficiency results if multiple comparisons were conducted, indicating that within-participant replication was uncommon. In this review, we examined single-case comparative…

Researchers increasingly take advantage of the comparative case design to build theory, but the degree of case dependence is occasionally discussed and theorized. We suggest that the comparative case study design might be subject to an often underappreciated threat--dependence across cases--under certain conditions. Using research on innovation…

This paper synthesises a large dataset on how social research methods and practices have been adapted or designed for use within pandemic conditions and a climate of crisis and uncertainty. The data were generated through two rapid evidence reviews of the methodological literature and in dialogue with social researchers in online knowledge…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…

Although there is an increasing number of studies concentrating upon education, some researchers have revealed that most studies, including qualitative studies in education, have methodological issues. One of the most common mistakes and neglected issues in qualitative studies is not to ensure the trustworthiness of the research, which indeed is…