The author contends that model misspecification can occur even after researchers have selected the generally most appropriate class of methods, or general linear model techniques. It is suggested specifically that canonical correlation analysis may provide more meaningful results, as compared with regression, particularly if analysis is augmented…

Given decades of lucid, blunt admonitions that statistical significance tests are often misused, and that the tests are somewhat limited in utility, what is needed is less repeated bashing of statistical tests, and some honest reflection regarding the etiology of researchers' denial and psychological resistance (sometimes unconscious) to improved…

Virtually all parametric statistical procedures have been shown to be special cases of canonical correlation analysis. This article proposes a logic for conducting stepwise canonical correlation analyses, based upon evaluation of canonical communality coefficients. The procedure is a direct analogue of stepwise multiple regression. (Author/RD)

In early intervention, researchers often are interested in interpretation aids that can help determine the relative importance of variables when multiple regression models are used, and that facilitate deeper insight into prediction dynamics. Commonality analysis is one approach for helping researchers understand the contributions independent or…

Various realizations have led to less frequent use of the "OVA" methods (analysis of variance--ANOVA--among others) and to more frequent use of general linear model approaches such as regression. However, too few researchers understand all the various coefficients produced in regression. This paper explains these coefficients and their…

As an extension of B. Thompson's 1998 invited address to the American Educational Research Association, this paper cites two additional common faux pas in research methodology and explores some research issues for the future. These two errors in methodology are the use of univariate analyses in the presence of multiple outcome variables (with the…

The advantages and disadvantages of three analytic methods used to analyze experimental data in educational research are discussed. The same hypothetical data set is used with all methods for a direct comparison. The Analysis of Variance (ANOVA) method and its several analogs are collectively labeled OVA methods and are evaluated. Regression…

Editorial board members of "Educational and Psychological Measurement" were asked to list up to five publications each, written since roughly 1950, that they thought were seminal to shaping the measurement field. This bibliography lists 59 of their selections as a "hit parade" of measurement readings. (SLD)

Three criticisms of overreliance on results from statistical significance tests are noted. It is suggested that: (1) statistical significance tests are often tautological; (2) some uses can involve comparisons that are not completely sensible; and (3) using statistical significance tests to evaluate both methodological assumptions (e.g., the…

The SERVQUAL measure was developed by A. Parasuraman, L. Berry, and V. Zeithaml (1988) to measure perceptions of service quality, originally in the retailing sector. However, libraries and other educational institutions are also service providers. Librarians in particular have increasingly become interested in measuring quality of service as the…

The utility of combining confirmatory factor analysis and second-order methods is illustrated in a study of responses of 487 undergraduate and graduate students to the love instrument of C. Hendrick and S. Hendrick. Second-order confirmatory methods allow the researcher to explore complex realities more thoroughly. (SLD)

Comments on discussions of statistical significance testing in this special issue, placing the articles in the context of contemporary research literature. Empirical evidence is cited that suggests that the American Psychological Association's policy of encouraging effect size reporting has had no appreciable effect on the research literature.…

Conventional statistical significance tests do not inform the researcher regarding the likelihood that results will replicate. One strategy for evaluating result replication is to use a "bootstrap" resampling of a study's data so that the stability of results across numerous configurations of the subjects can be explored. This paper…

Q-technique factor analysis identifies clusters or factors of people, rather than of variables, and has proven very popular, especially with regard to testing typology theories. The present study investigated the utility of three different protocols for obtaining data for Q-technique studies. These three protocols were: (1) a conventional ipsative…

Problems with using stepwise analytic methods are discussed, and better alternatives are illustrated. To make the illustrations concrete, an actual data set, involving responses of 91 medical school admissions directors to 30 variables, was used. The 30 variables involved perceptions of barriers to medical school with respect to characteristics of…