Despite much evidence that the Jenkins Activity Survey Type A (JAS Type A) scale is lacking in essential psychometric properties, it continues to be widely used for measuring coronary-prone behavior. Four psychometric properties of the scale were assessed. The scale failed to satisfy accepted reliability and validity criteria. (Author/JAZ)

The problem of predicting universe scores for samples of examinees based on their responses to samples of items is treated. The measurement model categorizes items according to the cells of a table of test specifications, and the linear function derived for minimizing error variance in prediction uses responses to these categories. (Author/JKS)

These analyses suggest that if a criterion-referenced test had a reliability (defined in terms of internal consistency) below 0.5, a simple a priori procedure would provide better estimates of students' universe scores than would individual observed scores. (Author/LMO)

A methodology for determining the optimal number of observations to use in a measurement design when resource constraints are imposed is presented. Two- and three-facet designs are outlined. Parallel closed form formulae can easily be determined for other designs. (TJH)

A natural parameterization and formalization of the problem of measuring change in dichotomous data is developed. Mathematically-exact definitions of specific objectivity are presented, and the basic structures of the linear logistic test model and the linear logistic model with relaxed assumptions are clarified. (SLD)

The general transformation approach to time series analysis is extended to the analysis of multiple unit data by the development of a patterned transformation matrix. The procedure includes alternatives for special cases and requires only minor revisions in existing computer software. (SLD)

Demonstrates the use of Generalizability (G) theory as an alternative method of validating direct behavioral measures. Reliability and validity from a classic test score theory are explored and rephrased in terms of G theory. Two studies that used oral reading fluency measures within a curriculum-based measurement approach are examined with G…

Demonstrates how perspectives from covariance structural modeling and generalizability theory can be combined for a comprehensive assessment of latent constructs. This approach to examining variance components is illustrated by one- and two- facet designs, and can be extended to more complex designs. (MAK)

Research on developing technology for large-scale performance assessments in science is reported briefly, and a conceptual framework is presented for defining, generating, and evaluating science performance assessments. Types of tasks are discussed, and the technical qualities of performance assessments are discussed in the context of…

Studied the sampling variability of estimated variance components using data collected over several years for a listening and writing performance assessment and evaluated the stability of estimated measurement precision. Results indicate that the estimated variance components varied from one year to another and suggest that the measurement…

Generalizability theory is used to show that the assumption that reliability for groups is greater than that for persons (and that error variance for groups is less than that for persons) is not necessarily true. Examples are provided from course evaluation and performance test literature. (SLD)

Used generalizability theory to assess the impact of using independent, randomly equivalent groups of experts to develop scoring algorithms for computer simulation tasks designed to measure physicians' patient management skills. Results with three groups of four medical school faculty members each suggest that the impact of the expert group may be…

Presents a generalizability theory (GT) analysis of data from 531 agricultural students' evaluations of teaching. Illustrates GT estimations of reliability for student and class means and the use of GT in obtaining standard errors. (SK)

Presents a model-based approach to rater reliability for essays read by multiple raters. The approach is motivated by generalizability theory, and variation of rater severity and rater inconsistency is considered in the presence of between-examinee variations. Illustrates methods with data from standardized educational tests. (Author/SLD)

The current study extended previous research on curriculum-based measurement in mathematics (M-CBM) assessments. The purpose was to examine the generalizability and dependability of multiple-skill M-CBM computation assessments across various assessment durations (1, 2, 3, 4, 5, and 6 minutes). Results of generalizability and dependability studies…