T. Vacha-Haase (1998) proposed her "reliability generalization" methodology to characterize (a) typical score reliability for a measure across studies, (b) the variability of score reliabilities, and (c) what measurement protocol features predict the variability in score reliabilities across administration. The present article provides…

Surveyed AERA members regarding their perceptions of: statistical issues and statistical significance testing; the general linear model; stepwise methods; score reliability; type I and II errors; sample size; statistical probabilities as exclusive measures of effect size; p values as direct measures of result value; and p values evaluating…

A procedure for estimating reliability in a factor analytic context, when reliability of the extracted factors is not an emphasis, is identified. The procedure is an extension of Dressel's work and might be applied in attitude measurement. It assesses how homogeneous the weighted original item responses are, when they are scored for pattern…

Investigated measurement characteristics of the Multidimensional Health Locus of Control (MHLC) Scales when the scales are used with elementary school children. The MHLC scales were administered to 876 fourth, fifth, and sixth graders. Results from four analyses of data strongly support the reliability and factorial validity of the revised MHLC…

After presenting a general linear model as a framework for discussion, this paper reviews five methodology errors that occur in educational research: (1) the use of stepwise methods; (2) the failure to consider in result interpretation the context specificity of analytic weights (e.g., regression beta weights, factor pattern coefficients,…

Factor analysis can be a valuable tool for assessing validity; however, the reliabilities of identified factors must be attended to. This study examined the impacts of item variance on factor stability and structure. The attempt was to determine empirically whether unnumbered graphic scales scored using a larger number of scale steps produce more…

Investigated measurement characteristics of both forms of Finding Embedded Figures Test (FEFT). College students (N=302) completed both forms of FEFT or one form of FEFT and Group Embedded Figures Test. Results suggest that FEFT forms provide reasonable reliable and valid data. (Author/NB)

The measurement integrity of M. A. Rahim's Organizational Conflict Inventory (ROCI-II) and D. M. Roussel's Managerial Frames of Mind Survey (MFMS) was investigated, as was the relationship between scores on the two measures. Subjects were 369 managers from three types of organizations: (1) higher education; (2) not-for-profit public sector…

The present study investigated the factor structure underlying responses to a measure of psychological type, the Personal Preferences Self-Description Questionnaire (PPSDQ). Measures of psychological type have been extremely useful in various applications, including career counseling and in assessing learning styles. Subjects were 422 university…

Attachment styles have been shown to be enduring and influential, and studies of attachment phenomena require scores that are reliable and valid. The present study investigated the psychometric integrity of scores on the Adult Attachment Scale using data from 283 college students. This instrument is an 18-item Likert scale that is an expansion of…

This paper presents analyses of score reliability for a mathematics placement test developed by the Mathematical Association of America in 1984 for use with undergraduate college students. Subjects included all 589 students seeking admission to the college mathematics curricula at a private university in the South during the course of the study.…

Most training programs in education and psychology focus on classical test theory techniques for assessing score dependability. This paper discusses generalizability theory and explores its concepts using a small heuristic data set. Generalizability theory subsumes and extends classical test score theory. It is able to estimate the magnitude of…

Discusses features of a microcomputer program, SCOREIT, used at New Orleans' Loyola University and several high schools to score and analyze test results. Benefits and dimensions of the program's automated test and item analysis are outlined, and several examples illustrating test and item analyses by SCOREIT are presented. (MBR)

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

The Myers-Briggs Type Indicator (MBTI) is one of the most frequently used measures of personality. MBTI Form G and a self-descriptive adjectival checklist, the "Personal Preferences Self-Description Questionnaire" (PPSDQ), were administered to 191 college students. The four dimensions of personality measured by the MBTI are:…