I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Focusing on systematic observation, one of the most potent methods of studying teaching quality, represents one of the numerous contributions of Daryl Siedentop to the profession. While he had a clear focus on issues of validity and reliability concerning systematic observation, over the past decades, attention to such issues appears to have…

Critical thinking (CT) consists of a deliberate and reflective process that can lead to informed decisions. It involves scrutinizing the trustworthiness and consistency of underlying assumptions, the sources of data, and the validity of other information. CT embodies deliberate, self-regulated judgment incorporating cognitive abilities such as…

This study focuses on Grounded Theory, which is one of the qualitative research designs. Glaser and Strauss developed the Grounded Theory; it has been revised by other scientists, resulting in three distinct Grounded Theory approaches: the systematic design (Corbin and Strauss approach), the classical design (Glaser approach), and the…

Background: Gaining insight into sleep-wake patterns of persons with intellectual disabilities is commonly done using wrist actigraphy. For some people, contactless alternatives are needed. This study compares a contactless bed sensor with wrist actigraphy to monitor sleep-wake patterns of people with moderate to profound intellectual…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…

This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims…

Background: Views can be collected from individuals (self-report) or others on their behalf (proxy-report). Objective: We aimed to review the literature on methods and statistical approaches used to evaluate observer versus self-report responses from individuals with intellectual disability or Down syndrome. Methods: A series of key questions…

Purpose: As society becomes ever more reliant on Internet technology for everyday communications, this paper explores the use of instant messaging (IM) in qualitative research. Discussed within the context of sensitive topic research with potentially hidden and hard-to-reach groups, the purpose of this paper is to discuss the value of adaptive and…

While many instructors are aware of the "Literary Digest" 1936 poll as an example of biased sampling methods, this article details potential further explorations for the "Digest's" 1924-1936 quadrennial U.S. presidential election polls. Potential activities range from lessons in data acquisition, cleaning, and validation, to…

Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent's thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents' thinking. An intended outcome from this special…

The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment…

In the study, the Principal-Teacher Relationship Scale, created originally by Zee, Roorda, and Hanna (2023), was subjected to an adaptation study for Turkish culture. In line with this aim, data for the study were gathered from 389 teachers working in primary and secondary schools located in the districts of Konya, Turkey. The Principal-Teacher…