Due to the complexity of latent transition analysis (LTA) model structure and qualitative decision making in LTA, power analysis has less been reported and studied. Baldwin (2015) and Gudicha, et al., (2016) recently reported results about power analysis in LTA, which included useful information. On the other hand, both studies are limited in the…

The gold standard for identifying more effective pedagogical approaches is to perform an experiment. Unfortunately, frequently a hypothesized alternate way of teaching does not yield an improved effect. Given the expense and logistics of each experiment, and the enormous space of potential ways to improve teaching, it would be highly preferable if…

Classification evaluation metrics are often used to evaluate adaptive tutoring systems-- programs that teach and adapt to humans. Unfortunately, it is not clear how intuitive these metrics are for practitioners with little machine learning background. Moreover, our experiments suggest that existing convention for evaluating tutoring systems may…

The purpose of this study was to evaluate the combined effects of reduced equating sample size and shortened anchor test length on item response theory (IRT)-based linking and equating results. Data from two independent operational forms of a large-scale testing program were used to establish the baseline results for evaluating the results from…

Researchers who make tutoring systems would like to know which sequences of educational content lead to the most effective learning by their students. The majority of data collected in many ITS systems consist of answers to a group of questions of a given skill often presented in a random sequence. Following work that identifies which items…

Describes a new combinatorial algorithm for fitting additive trees to proximity data. This generalized triples method examines all triples of objects of interest in relation to the remaining set of objects to be clustered. The procedure is illustrated, and a simulation study shows its advantages. (SLD)

Multiple comparison procedures for controlling familywise Type I error and the false discovery rate are described and compared, including the traditional Bonferroni correction, a sequential (step-up) Bonferroni procedure (Hochberg, 1988), and a sequential false discovery rate procedure proposed by Benjamini and Hochberg (1995). Motivation for…

This study presents and evaluates a method of standardization that may be used by test practitioners to standardize classical item statistics when sample sizes are small. The effectiveness of this standardization approach was compared through simulation with the one-parameter logistic (1PL) and three parameter logistic (3PL) models based on the…

Real world data often fail to meet the underlying assumptions of normal statistical theory. Many statistical procedures in the psychological and educational sciences involve models that may include a system of statistical equations with non-normal correlated variables (e.g., factor analysis, structural equation modeling, or other complex…

Using simulated data, the MULTILOG and PARSCALE software packages were compared for their recovery of item and trait parameters under the graded response and generalized partial credit item response theory models. The shape of the latent population distribution (normal, skewed, or uniform) and the sample size (250 or 500) were varied. Parameter…

It is common to assume during statistical analysis of a multiscale assessment that the assessment has simple structure or that it is composed of several unidimensional subtests. Under this assumption, both the unidimensional and multidimensional approaches can be used to estimate item parameters. This paper theoretically demonstrates that these…

Multiple-hypothesis testing in the context of a correlation matrix is used to compare the statistical power of the original Bonferroni with six modified Bonferroni procedures that control the overall Type I error rate. Three definitions of statistical power are considered: (1) the ability to detect at least one true relationship; (2) the ability…

A set of APL (A Programing Language) programs written for use on a time-sharing IBM System/370 computer and used to aid in the teaching of selected econometric concepts is described. The programs involve the simulation of a set of n observations; of a simple regression model Y = A BX U; the plotting of the Y and X simulated values; the estimation…

Whether one should use null hypothesis testing, confidence intervals, and/or effect sizes is a source of continuing controversy in educational research. An alternative to testing for statistical significance, known as equivalence testing, is little used in educational research. Equivalence testing is useful in situations where the researcher…

This simple method for simulating the Central Limit Theorem with students in a beginning nonmajor statistics class requires students to use dice to simulate drawing samples from a discrete uniform distribution. On a chalkboard, the distribution of sample means is superimposed on a graph of the discrete uniform distribution to provide visual…