Tingir et al. (2017) concluded from their meta-analysis that the subject areas taught through mobile devices had significantly higher achievement scores (d = 0.48) than the ones taught with traditional teaching methods. Given the relatively high positive effect of mobile devices on student achievement, we carefully analysed the selected research…

The purpose of this study was to synthesize internal consistency reliability for the subscale scores on the Maslach Burnout Inventory (MBI). The authors addressed three research questions: (a) What is the mean subscale score reliability for the MBI across studies? (b) What factors are associated with observed variance in MBI subscale score…

This paper examines the impact of quality-score weights in meta-analysis. A simulation examines the roles of study characteristics such as population effect size (ES) and its variance on the bias and mean square errors (MSEs) of the estimators for several patterns of relationship between quality and ES, and for specific patterns of systematic…

In a recently published meta-analysis, Tran, Sanchez, Arellano, and Swanson (2011) synthesized 13 studies that permitted assessment of characteristics of children who were adequate and inadequate responders to instruction. The authors indicated that "[t]he central question addressed in this review is whether individual differences in…

A meta-analysis of the reliability of the scores from a specific test, also called reliability generalization, allows the quantitative synthesis of its properties from a set of studies. It is usually assumed that part of the variation in the reliability coefficients is due to some unknown and implicit mechanism that restricts and biases the…

The purpose of this study was to employ the meta-analytic method of Reliability Generalization to investigate the magnitude and variability of reliability estimates obtained across studies using Curriculum-Based Measurement reading aloud. Twenty-eight studies that met the inclusion criteria were used to calculate the overall mean reliability of…

This meta-analysis is designed to build on the existing knowledge base by examining vocabulary interventions specifically for factors associated with child outcomes for at-risk children. Specifically, the authors addressed the following questions: (1) To what extent are vocabulary interventions an effective method for at-risk children prior to…

The Structured Interview of Reported Symptoms (SIRS; Rogers, Bagby, & Dickens, 1992) is often touted as the gold standard of measures of feigning. This label likely arises in part out of the impressive accuracy rates reported in the extensive validation research that preceded its publication. However, since its publication, researchers not only…

As the public profile of early childhood education has increased, state education agency staff, policymakers, and researchers are interested in understanding the lasting impacts of quality pre-K. Particularly for states beginning an investment in early childhood education or expanding access to an existing program, it is important to examine the…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

This article presents a method to evaluate pretest effects on posttest scores in the absence of an un-pretested control group using published results of pretesting effects due to Willson and Putnam. Confidence intervals around the expected theoretical gain due to pretesting are computed, and observed gains or differential gains are compared with…

Extensive research has examined the effectiveness of admissions tests for use in higher education. What has gone unexamined is the extent to which tests are similarly effective for predicting performance at both the master's and doctoral levels. This study empirically synthesizes previous studies to investigate whether or not the Graduate Record…

Literature shows that most researchers are unaware of some of the characteristics of reliability. This paper clarifies some misconceptions by describing the procedures, benefits, and limitations of reliability generalization while using it to illustrate the nature of score reliability. Reliability generalization (RG) is a meta-analytic method…

There is a substantial literature relating the personality trait "anxiety sensitivity" (AS; tendency to fear anxiety-related sensations) and its lower order dimensions to the mood and anxiety (i.e., internalizing) disorders. However, particularly given the disorders' high comorbidity rates, it remains unclear whether AS is broadly related to these…

Charter schools are largely viewed as a major innovation in the public school landscape, as they receive more independence from state laws and regulations than do traditional public schools, and are therefore more able to experiment with alternative curricula, pedagogical methods, and different ways of hiring and training teachers. Unlike…