Background: Intercoder reliability is a statistic commonly reported by researchers to demonstrate the rigour of coding procedures during data analysis. Its importance is debatable in the analysis of qualitative interview data. It raises a question on whether researchers should identify the same codes and themes in a transcript or they should…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

Individual participant data meta-analyses (IPD-MAs) have several benefits over standard aggregate data meta-analyses, including the consideration of additional participants, follow-up time, and the joint consideration of study- and participant-level heterogeneity for improved diagnostic and prognostic model development and evaluation. However,…

Some in our discipline have recently voiced the opinion that political science is a data science. What follows from this argument is that we as instructors are training the next generation of data scientists, especially professionals and researchers who will work with big data. This paper explores the implications for political science education,…

Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4)…

Recital 33 GDPR has often been interpreted as referring to 'broad consent'. This version of informed consent was intended to allow data subjects to provide their consent for certain areas of research, or parts of research projects, conditional to the research being in line with 'recognised ethical standards'. In this article, we argue that broad…

Transcription is an integral part of much qualitative data analysis, yet rarely has it received close attention in debates over the use (or non-use) of "computer assisted qualitative data analysis software" (CAQDAS). This article draws upon a mixed-methods study that involved transcribing conversational interviews with carers, third…

Single-case design is a research methodology that entails repeated measurement to assess the influence of an independent variable on a dependent variable over time. Data collected in this manner are regularly analyzed using visual analysis of data displayed in a linear graph. Although there is agreement regarding critical elements of visual…

Purpose: This paper aims to consider ways to visually model data generated by qualitative case studies, pointing out a need for visualizations that depict both synchronic relations across representations and how those relations change diachronically. To develop an appropriate modeling approach, the paper critically examines Max Boisot's I-Space…

The rapid development of artificial intelligence has driven the transformation of educational evaluation into big data-driven. This study used a systematic literature review method to analyzed 44 empirical research articles on the evaluation of big data education. Firstly, it has shown an increasing trend year by year, and is mainly published in…

Managing and analysing large qualitative datasets pose a particular challenge for researchers seeking a consistent and rigorous approach to qualitative data analysis. This paper describes and demonstrates the development and adoption of a matrix tool to guide the qualitative data analysis of a large sample (N = 122) of interview data. The paper…

Students typically find research methods and statistics classes intimidating. In particular, learning different types of data measurement and operationalization can take significant time and practice to understand. Utilizing a pedagogical approach that turns a party game into a fun exercise, students collaboratively learn to operationalize…

This study provides a picture of the impact the novel Coronavirus (COVID-19) had on action research performed by graduate students at a small Midwest university. A qualitative case study was conducted to examine how the participants' abilities to implement their research, gather data, and analyze the results was impacted by COVID-19. Research…

Development of graphical methods for representing data has not kept up with progress in statistical techniques. This article presents a brief history of graphical representations of research findings and makes the case for a revival of methods developed in the early and mid-twentieth century, notably ISOTYPE and Chernoff's faces. It resurrects and…

Problem-based learning (PBL) can take many different shapes but has as a common denominator that it builds on the principles of collaborative, constructive, contextual, and self-directed learning. Systematic review approaches that aim to provide insight in what features make PBL work generally fall short, as they tend to disregard the influential…