A latent variable modeling method is outlined, which accomplishes estimation of criterion validity and reliability for a multicomponent measuring instrument with hierarchical structure. The approach provides point and interval estimates for the scale criterion validity and reliability coefficients, and can also be used for testing composite or…

A method for interval estimation of scale reliability with discrete data is outlined. The approach is applicable with multi-item instruments consisting of binary measures, and is developed within the latent variable modeling methodology. The procedure is useful for evaluation of consistency of single measures and of sum scores from item sets…

This article outlines a readily and widely applicable procedure of reliability evaluation for scales with unidimensional measures. The method is developed within the framework of the popular latent variable modeling methodology, and it accomplishes point, as well as interval, estimation of measuring instrument reliability. The approach can be…

A didactic discussion of a procedure for interval estimation of change in scale reliability due to revision is provided, which is developed within the framework of covariance structure modeling. The method yields ranges of plausible values for the population gain or loss in reliability of unidimensional composites, which results from deletion or…

A latent variable analysis procedure for evaluation of reliability coefficients for 2-level models is outlined. The method provides point and interval estimates of group means' reliability, overall reliability of means, and conditional reliability. In addition, the approach can be used to test simple hypotheses about these parameters. The…

A method for point and interval estimation of change in criterion validity of multiple-component measuring instruments as a result of revision is outlined. The procedure is developed within the framework of covariance structure modeling, which complements earlier methods for testing change in composite reliability due to addition or deletion of…

A covariance structure modeling perspective on reliability estimation can be used to construct a formal approach to estimation of reliability in multilevel models. This article presents a didactic discussion of the relation between a structural modeling procedure for scale reliability estimation and the notion of reliability of observed means in…

A method is outlined for evaluating the reliability and criterion validity of weighted scales based on sets of unidimensional measures. The approach is developed within the framework of latent variable modeling methodology and is useful for point and interval estimation of these measurement quality coefficients in counseling and education…

Outlines a correlation structures modeling approach to the study of stability in reliability of multiple, repeatedly administered measures and illustrates the method on data from a fluid intelligence study (P. Bates and others, 1986). The method is also applicable when examining relationships between model parameters across all variables.…

Proposes a test for change in composite reliability as a result of scale revision or modification. The test, which is useful for examining whether a revision changes the population reliability of a scale undergoing development, is illustrated with two examples. (SLD)

Unlike a substantial part of reliability literature in the past, this article is concerned with weighted combinations of a given set of congeneric measures with uncorrelated errors. The relationship between maximal coefficient alpha and maximal reliability for such composites is initially dealt with, and it is shown that the former is a lower…

Studied the population discrepancy of coefficient alpha from the composite reliability coefficient for fixed congeneric measures with correlated errors and expressed it in terms of parameters of the measures. Recommends structural equation modeling for identifying cases in which the discrepancy can be large. (SLD)

A linear combination of a set of measures is often sought as an overall score summarizing subject performance. The weights in this composite can be selected to maximize its reliability or to maximize its validity, and the optimal choice of weights is in general not the same for these two optimality criteria. We explore several relationships…

A structural equation modeling based method is outlined that accomplishes interval estimation of individual optimal scores resulting from multiple-component measuring instruments evaluating single underlying latent dimensions. The procedure capitalizes on the linear combination of a prespecified set of measures that is associated with maximal…

Discusses a method for obtaining point and interval estimates of reliability for composites of measures with a general structure. The approach is based on fitting a correspondingly constrained structural equation model and generalizes earlier covariance structure analysis methods for scale reliability estimation with congeneric tests. (SLD)