Survey-based research is vital in education and social sciences, offering insights into human behaviors and perceptions. The prevalence of such studies in medical education has risen by 33% over the past decade. Despite this growth, the utility of survey findings depends on the study design quality and measure validity. Many manuscripts are…

Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to…

A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

In response to considerable critique of its rigour and relevance, the field of educational research has sought to prove its validity, both in terms of its scientific legitimacy and its relevance to policy and practice. One result of this has been a heightened concern with methodology, to the extent that a form of methodolatry has developed. In…

Since 1983, the Instructional Theory Framework (ITF) (and its subsequent improvements) has guided instructional designers and researchers in designing and developing useful learner experiences (LX). For the past 40 years, the ITF was laser-focused on the selection of instructional methods, downplaying delivery methods (media) and management…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

Single-case comparative studies could help identify efficient instructional procedures for individuals with disabilities. However, previous literature reported inconsistent efficiency results if multiple comparisons were conducted, indicating that within-participant replication was uncommon. In this review, we examined single-case comparative…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…

Since 1999, Indigenous scholars across the world have recentered research on Indigenous ways of knowing and doing. This radical change marks the decolonization of research. This new paradigm is based on the validity of Indigenous epistemologies, ontologies, and methodologies to conduct research. To appraise the recent evolution of this shifting…

The research project assignment can create meaningful opportunities for students to apply sociological concepts. For grading these projects, assessment rubrics are useful pedagogical tools to evaluate students' abilities in achieving course learning objectives. In this study, I analyzed final research papers collected over multiple semesters in my…

Purpose: Caregiver-mediated communication intervention outcomes are inconsistently measured, varying by assessment settings, materials, and activities. Standardized materials are often used for measuring outcomes, yet it remains unknown whether such standardized contexts equitably capture caregiver and child intervention outcomes representative of…

This article nuances an ongoing discussion among researchers about external researchers in emancipatory action research in the educational field. It examines opportunities and challenges for emancipatory action research for participants in top-down and bottom-up initiated action research projects with external researchers. An analysis based on…

Research has increasingly focused on the intersection between gender diversity and autism. Understanding the foci, methods, and rigor of recent studies could help guide and maximize impact in this accelerating research area. We conducted a scoping review of peer-reviewed literature on this topic published between 2018 and 2023. The search…

Research shows that the global society as organized today, with our current technological and economic system, is impossible to sustain. We are living in an era in which human activities in highly industrialized countries are responsible for overshooting several planetary boundaries, with poorer communities contributing the least to the problems…

These are the appendixes for the report, "Strengthening the Pennsylvania School Climate Survey to Inform School Decisionmaking." This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey;…