Although generalizability theory (GT) designs typically are analyzed using analysis of variance (ANOVA) procedures, they also can be integrated into structural equation models (SEMs). In this tutorial, we review basic concepts for conducting univariate and multivariate GT analyses and demonstrate advantages of doing such analyses within SEM…

At present, research on computational thinking in universities is gaining interest, and more attention is being paid to the cultivation and teaching of computational thinking. However, there is a lack of computational thinking assessment tools for college students, which makes it difficult to understand the current status and development of their…

Over the past several years, creativity has been recognized as an important skill for success in STEM education, engineering design and computational thinking. There is limited research on how to apply Conceive, Design, Implement, Operate (CDIO) engineering design in STEM courses and how it affects students' creativity. This study strategically…

Here, we assess whether quantity representations are influenced by the perceptual biases hypothesized to manifest in depressive individuals. In contrast to this clinical model, several prominent models of numerical cognition assume that quantity representations are abstract, and therefore are independent of the items that are being quantified. If…

This article presents "concept landscapes"--a novel way of investigating the state and development of knowledge structures in groups of persons using concept maps. Instead of focusing on the assessment and evaluation of single maps, the data of many persons is aggregated and data mining approaches are used in analysis. New insights into…

Educational data mining focuses on exploring increasingly large-scale data from educational settings, such as Learning Management Systems (LMS), and developing computational methods to understand students' behaviors and learning settings better. There has been a multitude of research dedicated to studying the student learning process, leading to…

In the study of music from a mathematical perspective, several types of counting problems naturally arise. For example, how many different rhythms of a specified length (in beats) can be written if we restrict ourselves to only quarter notes (one beat) and half notes (two beats)? What if we allow whole notes, dotted half notes, etc.? Or, what if…

Test-retest studies for assessing stability and change are widely used in different domains and allow improved or additional individual estimates of interest to be obtained. However, if these estimates are to be validly interpreted the responses given at Time-2 must be free of retest effects, and the fulfilment of this assumption must be…

Longitudinal research in higher education faces several challenges. Appropriate methods of analyzing competence growth of students are needed to deal with those challenges and thereby obtain valid results. In this article, a pretest-posttest-posttest multivariate multilevel IRT model for repeated measures is introduced which is designed to address…

The usefulness of the l[subscript z] person-fit index was investigated with achievement test data from 20 exams given to more than 3,200 college students. Results for three methods of estimating ? showed that the distributions of l[subscript z] were not consistent with its theoretical distribution, resulting in general overfit to the item response…

This paper proposes a structural analysis for generalized linear models when some explanatory variables are measured with error and the measurement error variance is a function of the true variables. The focus is on latent variables investigated on the basis of questionnaires and estimated using item response theory models. Latent variable…

Intraclass correlation coefficients (ICCs) are commonly used in behavioral measurement and psychometrics when a researcher is interested in the relationship among variables of a common class. The formulas for deriving ICCs, or generalizability coefficients, vary depending on which models are specified. This article gives the equations for…

Many latent traits in the human sciences have a hierarchical structure. This study aimed to develop a new class of higher order item response theory models for hierarchical latent traits that are flexible in accommodating both dichotomous and polytomous items, to estimate both item and person parameters jointly, to allow users to specify…

In the social sciences, latent traits often have a hierarchical structure, and data can be sampled from multiple levels. Both hierarchical latent traits and multilevel data can occur simultaneously. In this study, we developed a general class of item response theory models to accommodate both hierarchical latent traits and multilevel data. The…

This article presents the Variable Match Index (VM-Index), a new statistic for detecting answer copying. The power of the VM-Index relies on two-dimensional conditioning as well as the structure of the test. The asymptotic distribution of the VM-Index is analyzed by reduction to Poisson trials. A computational study comparing the VM-Index with the…