Implications of metanalytic results from Monte Carlo studies of the robustness of the F test in the one- and two-factor fixed effects analysis of variance (ANOVA) models and Monte Carlo results for the B. L. Welch (1947) and Kruskal-Wallis (1952) tests are discussed. (SLD)

A methodological framework is provided for quantitatively integrating Type I error rates and power values for Monte Carlo studies. An example is given using Monte Carlo studies of a test of equality of variances, and the importance of relating metanalytic results to exact statistical theory is emphasized. (SLD)

Monte Carlo studies of statistical tests are prominently featured in the methodological research literature. Unfortunately, the information from these studies does not appear to have significantly influenced methodological practice in educational and psychological research. One reason is that Monte Carlo studies lack an overarching theory to guide…

Concern over the validity of statistical tests performed on data that may not satisfy underlying assumptions has prompted methodological researchers to perform Monte Carlo studies for frequently used tests. Unfortunately, these studies appear to have had little impact on methodological practice. One reason is the lack of an overarching framework…