The present study was conducted to characterize (a) the features of the thousands of primary reports synthesized in 47 reliability generalization (RG) measurement meta-analysis studies and (b) typical methodological practice within the RG literature to date. With respect to the treatment of score reliability in the literature, in an astounding…

Investigated how dissimilar in composition and variability samples inducting reliability coefficients from prior studies were from the cited prior samples from which coefficients were generalized. Results from 20 articles show that citing reliability coefficients from prior studies as the basis for concluding new scores are reliable is only…

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

The program evaluation standards approved by the American National Standards Institute (ANSI) in 1994 that deal with reliability and validity accurately represent contemporary views of the psychometric community with regard to reliability and validity. As such, these standards move the field forward. The ANSI standards recognize that reliability…

The reliability and construct validity of scores on the Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) were studied. Classical psychometric analysis of data from 641 participants (item and alpha analyses and both oblique and orthogonal exploratory factor analyses) indicate that the PPSDQ has reasonable properties. (SLD)

Given the potential value of reliability generalization (RG) studies in the development of cumulative psychometric knowledge, the purpose of this paper is to provide a tutorial on how to conduct such studies and to serve as a guide for researchers wishing to use this methodology. After some brief comments on classical test theory, the paper…

Illustrates a number of ways in which confidence intervals for reliability coefficients can be estimated. Suggests that authors who submit articles to "Educational and Psychological Measurement" report confidence intervals for reliability estimates whenever they report score reliabilities and that they note the interval estimation…

After presenting a general linear model as a framework for discussion, this paper reviews five methodology errors that occur in educational research: (1) the use of stepwise methods; (2) the failure to consider in result interpretation the context specificity of analytic weights (e.g., regression beta weights, factor pattern coefficients,…

Research libraries are increasingly supplementing collection counts with perceptions of service quality as indices of status and productivity. The present study was undertaken to explore the reliability and validity of scores from the SERVQUAL measurement protocol (A. Parasuraman and others, 1991), which has previously been used in this type of…

Conducted a reliability generalization meta-analysis of subscale and total scale scores on the Web-administered LibQUAL+ (tm) (Cook and others, 2002), a measure of library service quality. Data for 18,161 participants from 43 universities show that score reliabilities are remarkably invariant across campuses and different over groups. (SLD)

Used confirmatory factor analysis to evaluate the score integrity of LibQUALl+, an instrument to measure perceptions of library service quality. Results for 60,027 graduate and undergraduate students suggest that the model implied by LibQUAL is reasonable and invariant across independent samples and fits all three major subgroups of library users.…

Includes four articles that discuss LibQUAL+[TM], a collaborative effort of the Association of Research Libraries and Texas A&M University responding to the need for greater accountability in measuring the delivery of library services to research library users. Discusses the reliability of LibQUAL+[TM] scores in measuring perceived library…

This study was conducted to evaluate whether the adjectival self-description checklist may provide a viable method of quickly obtaining initial personality type information. The Personal Preferences Self-Description Questionnaire (PPDSQ) was administered to more than 420 college students, and data were analyzed using classical reliability analysis…

This study evaluated the reliability and construct validity of scores from the "Children's Role Inventory" (A. Potter and D. Williams, 1991). The measure specifies four roles fulfilled by children: Hero, Lost Child, Mascot, and Scapegoat. Theory and some research also suggest that adults continue to interact based on role assignments…

The mission of the "Journal of Counseling and Development" (JCD) includes the attempt to serve as a "scholarly record of the counseling profession" and as part of the "conscience of the profession." This responsibility requires the willingness to engage in self-study. This study investigated two aspects of research…