The linear dependence of age, period, and birth cohort is a challenge for the analysis of social change. With either repeated cross-sectional data or conventional panel data, raw change cannot be decomposed into over-time differences that are attributable to the effects of common experiences of alternative birth cohorts, features of the periods…

Single-case design (SCD) is frequently utilized in applied contexts, such as schools or clinics, due to its utility in evaluating individual intervention effects of students. Data collected in SCD are often displayed in a linear graph, which can vary drastically in their construction leading to inconsistencies in rater interpretation. This has led…

Teachers' data literacy and interpretive process are critical to understanding how they make sense of data. However, little is known about how mental representations shape and evolve in response to teachers' interpretive process. In the present study, I model and explore this recursive relationship between teachers' cognitive framing and…

In visual communication, people glean insights about patterns of data by observing visual representations of datasets. Colormap data visualizations ("colormaps") show patterns in datasets by mapping variations in color to variations in magnitude. When people interpret colormaps, they have expectations about how colors map to magnitude,…

Predicting student performance using educational data is a significant area of machine learning research. However, class imbalance in datasets and the challenge of developing interpretable models can hinder accuracy. This study compares different variations of the Synthetic Minority Oversampling Technique (SMOTE) combined with classification…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

Equating is a statistical procedure used to adjust for the difference in form difficulty such that scores on those forms can be used and interpreted comparably. In practice, however, equating methods are often implemented without considering the extent to which two forms differ in difficulty. The study aims to examine the effect of the magnitude…

Treatment fidelity refers to the extent to which an intervention is implemented as planned. If researchers do not assess and report treatment fidelity, or if treatment fidelity is shown to be low, findings from intervention studies are difficult to interpret, because the intervention may not have been implemented as planned. In this article, our…

Background: Learning analytics (LA) collects, analyses, and reports data from the learning environment, to provide evidence of the effects of a particular learning design. Learning design (LD) outlines the conceptual framework for a meaningful interpretation of Learning analytics data. Objectives: The study aims to identify the most relevant…

This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

World university rankings have had an impact on academic competition worldwide. The comparability of ranking results depends on how data is collected within each university. When data concepts are interpreted differently, data variety is introduced and ranking results cannot be used in a meaningful manner. In this case study, the effect of…

The use of inter-rater reliability (IRR) methods may provide an opportunity to improve the transparency and consistency of qualitative case study data analysis in terms of the rigor of how codes and constructs have been developed from the raw data. Few articles on qualitative research methods in the literature conduct IRR assessments or neglect to…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

This contribution deals with effect measures for covariates in ordinal data models to address the interpretation of the results on the extreme categories of the scales, evaluate possible response styles, and motivate collapsing of extreme categories. It provides a simpler interpretation of the influence of the covariates on the probability of the…