Classroom context and climate are inherently classroom-level (L2) constructs, but applied researchers sometimes--inappropriately--represent them by student-level (L1) responses in single-level models rather than more appropriate multilevel models. Here we focus on important conceptual issues (distinctions between climate and contextual variables;…

Whether "more is ever too much" for the number of indicators per factor in confirmatory factor analysis was studied by varying sample size and indicators per factor in 35,000 Monte Carlo solutions. Results suggest that traditional rules calling for fewer indicators for smaller sample size may be inappropriate. (SLD)

During the last 15 years, there has been a steady increase in the popularity and sophistication of the confirmatory factor analysis approach to multitrait-multimethod (MTMM) data. However, important problems exist, the most serious being the ill-defined solutions that plague MTMM studies and the assumption that so-called method factors primarily…

Study examined the factorial invariance of responses by preadolescent males and females to a multidimensional self-concept instrument. Also demonstrated how confirmatory factor analysis is used to test factorial invariance and examined problems with its use and interpretation. (RB)

The multitrait-multimethod (MTMM) paradigm is used widely to assess construct validity, but D. A. Kenny and D. A. Kashy (1992) lament that even after 30 years we still do not know how to analyze MTMM data. The Composite Direct Product (CDP) model has recently attracted considerable attention. Its strengths and weaknesses are evaluated, and a…

Methodological problems have so biased the search for potential biases in student ratings of university teachers that the search itself has approximated a witch hunt. Meta-analysis and systematic review are required for more accurate estimates of the size of effects that have been reported and the conditions under which they were found. (SLD)

Within-class experimental designs (with experimental and control groups in the same classroom) are subject to diffusion effects whereby both experimental and control students benefit from the intervention, thereby contaminating the control group and biasing evaluations of intervention effects. In support of diffusion effects, this study shows that…

The factorial structure of the Rotter Internal-External (IE) scale was examined. While there was strong evidence against the unidimensionality of the Rotter scale, the findings suggested that the first-order factors do define a single higher-order construct that may represent the generalized IE construct. (Author/LMO)

The purposes of the present investigation were to examine the dimensionality of the Rotter Internal-External (I-E) scale, to test the invariance of its factor structure before and after an intervention designed to alter I-E, and to demonstrate the use of confirmatory factor analysis. An a priori model based on the content of the Rotter items…

A number of research reports and meta analyses on student evaluation of college teaching were reviewed. Student ratings were found to be multidimensional, reliable, valid, and relatively unbiased. Results were useful for feedback, course selection, and personnel decisions. Marsh's Students' Evaluations of Educational Quality (SEEQ) was also…

This study compares multitrait-multimethod analyses (MTMM) performed on items and factor scores derived from the items. Based upon this demonstration, researchers are encouraged to conduct a preliminary factor analysis before analyzing MTMM data whenever there is a doubt about the underlying trait structure. (Author/PN)

The "Students Evaluation of Educational Quality" is an instrument measuring dimensions of college teaching effectiveness. A study showed that, for ratings of 123 instructors in 3,079 classes over 13 years, each instructor has a distinct profile of ratings that generalizes over time, different courses, and course level. (Author/MSE)

H. W. Marsh's monograph (1987) on students' evaluations of teaching effectiveness in higher education is summarized. The research, which emphasized the construct validity approach, led to the development of the Students' Evaluations of Educational Quality (SEEQ) instrument. Factor analysis resulted in identification of nine SEEQ factors--learning…

The purposes of this study are to examine the factorial invariance of responses by preadolescent males and females to a multidimensional self-concept instrument, and to demonstrate the use of confirmatory factor analysis (CFA). Sets of responses by 500 males and by 500 females were each randomly divided in half to form four groups (M1, M2, F1, and…

The purpose of the present investigation is to study the hierarchical structure of academic self-concept. The original Shavelson model posited specific facets of academic self-concept to define a single higher-order facet, but Marsh and Shavelson (1985) found the hierarchical structure to be more complicated. In a revised model they proposed that…