Assuming item parameters on a test are known constants, the reliability coefficient for item response theory (IRT) ability estimates is defined for a population of examinees in two different ways: as (a) the product-moment correlation between ability estimates on two parallel forms of a test and (b) the squared correlation between the true…

Indefinite symmetric matrices that are estimates of positive-definite population matrices occur in a variety of contexts such as correlation matrices computed from pairwise present missing data and multinormal based methods for discretized variables. This note describes a methodology for scaling selected off-diagonal rows and columns of such a…

The aim of the research presented here is the use of extensions of longitudinal item response theory (IRT) models in the analysis and comparison of group-specific growth in large-scale assessments of educational outcomes. A general discrete latent variable model was used to specify and compare two types of multidimensional item-response-theory…

This paper presents a study of the impact of prior structure on paradoxical results in multidimensional item response theory. Paradoxical results refer to the possibility that an incorrect response could be beneficial to an examinee. We demonstrate that when three or more ability dimensions are being used, paradoxical results can be induced by…

A general theory on the use of correlation weights in linear prediction has yet to be proposed. In this paper we take initial steps in developing such a theory by describing the conditions under which correlation weights perform well in population regression models. Using OLS weights as a comparison, we define cases in which the two weighting…

Multinomial processing tree models are widely used in many areas of psychology. A hierarchical extension of the model class is proposed, using a multivariate normal distribution of person-level parameters with the mean and covariance matrix to be estimated from the data. The hierarchical model allows one to take variability between persons into…

We demonstrate the use of a multidimensional extension of the latent Markov model to analyse data from studies with repeated binary responses in developmental psychology. In particular, we consider an experiment based on a battery of tests which was administered to pre-school children, at three time periods, in order to measure their inhibitory…

A model for longitudinal latent structure analysis was proposed that combined the values of a latent variable at two time points in a two-dimensional latent density. The correlation coefficient between the two values of the latent variable can then be estimated. (NSF)

Uses classical test theory to show that it is the nature of the range restriction, rather than the nature of the available reliability coefficient, that determines the sequence for applying corrections for range restriction and unreliability. Shows how the common rule of thumb for choosing the sequence is tenable only when the correction does not…

A new look at latent trait models is proposed. The event of an item being solved by a person is related to a person-specific random component and an item-specific random component. This allows for the interpretation of item discriminating power in terms of a product-moment correlation. (Author/JKS)

A simple stochastic model is formulated in order to determine the optimal time between the first test and the second test when the test-retest method of assessing reliability is used. A forgetting process and a change in true score process are postulated. Some numerical examples and suggestions are presented. (Author/JKS)

Bond criticized the base-free measure of change proposed by Tucker, Damarin, and Messick by pointing to an incorrect derivation which is here viewed instead as a correct derivation entailing an inadequately specified assumption. Bond's revision leads to negatively biased estimates, whereas the original approach leads to unbiased estimates.…

Four types of metric scales are distinguished: absolute, ratio, difference, and interval. A general coefficient of association for two variables of the same scale type is developed which reduces to specific coefficients of association for each scale type. (NSF)

A family of coefficients of relational agreement for numerical scales is proposed, generalizing to multiple judges the theory of F. E. Zegers and J. M. F. ten Berge (1985) of association coefficients for two variables, using the premise that choice of coefficient depends on scale type of the variables. (SLD)

In many instances it is reasonable to assume that the population covariance matrix has positive elements. This assumption implies for the single factor analysis model that the loadings and regression weights for best linear factor prediction are positive. For the multiple factor analysis model where each variable loads on a single factor and a…