Differential bundle functioning (DBF) has been proposed to quantify the accumulated amount of differential item functioning (DIF) in an item cluster/bundle (Douglas, Roussos, and Stout). The simultaneous item bias test (SIBTEST, Shealy and Stout) has been used to test for DBF (e.g., Walker, Zhang, and Surber). Research on DBF may have the…

In this article, we describe current research findings on assessment accommodations and universal design within the context of emerging interactive digital assessment tasks that employ simulations such as in science, technology, engineering, and mathematics (STEM). STEM education in many classrooms now includes digitally based activities such as…

Test accommodations have been proposed to help overcome the unfair challenges faced by English Language Learners (ELLs) due to their relatively low English proficiency. A test accommodation is regarded as effective when it improves the test performance of ELLs. However, this improvement raises the question of whether such accommodations give ELLs…

Objective: The role of diet and of food colors in attention-deficit/hyperactivity disorder (ADHD) or its symptoms warrants updated quantitative meta-analysis, in light of recent divergent policy in Europe and the United States. Method: Studies were identified through a literature search using the PubMed, Cochrane Library, and PsycNET databases…

This is the first meta-analysis that investigates the differential prediction of undergraduate and graduate college admission tests for women and men. Findings on 130 independent samples representing 493,048 students are summarized. The underprediction of women's academic performance (d = 0.14) and the overprediction of men's academic performance…

In this study, differential item functioning (DIF) trends were examined for English language learners (ELLs) versus non-ELL students in third and tenth grades on a large-scale reading assessment. To facilitate the analyses, a meta-analytic DIF technique was employed. The results revealed that items requiring knowledge of words and phrases in…

This study examined the percentage of task-sampling variability in performance assessment via a meta-analysis. In total, 50 studies containing 130 independent data sets were analyzed. Overall results indicate that the percentage of variance for (a) differential difficulty of task was roughly 12% and (b) examinee's differential performance of the…

The question of how high a response rate is needed in order for telephone surveys to obtain data that accurately represent the entire sample, was investigated via reevaluating results of three previously published studies and reporting on three 1989 studies for the first time. The three previous studies indicated that, if the sample…

This study used meta-analysis research techniques to determine if there are differences in General Aptitude Test Battery (GATB) validities and test scores between males and females. The sample consisted of 26,111 subjects from 122 Specific Aptitude Test Battery (SATB) validation or revalidation studies analyzed since 1972. Four approaches were…

Although the criterion problem has been acknowledged as critical in personnel research, few attempts have been made to systematically examine the nature and covariates of criterion measures of performance. The present research used meta-analytic techniques to examine the race effect size for objective measures of performance and to compare the…

This article presents a meta-analysis of the effects of examiner familiarity/unfamiliarity on children's performance during individual testing. Data came from 22 controlled studies involving 1489 subjects. In a typical study, the effect of examiner familiarity raised test performance by .35 standard deviations. Differential performance favoring…

Based on data from 22 controlled studies, this article presents a meta-analysis of the effects of examiner familiarity on children's test performance. It was found that examiner familiarity raised scores especially when subjects were: (1) of low socioeconomic status; (2) tested on difficult tests; and (3) knew the examiner for a long duration.…

This article presents a quantitative synthesis of examiner familiarity effects on Caucasian and minority students' test performance. Fourteen controlled studies were coded in terms of methodological quality (high vs. low) and race-ethnicity (Caucasian vs. Black and Hispanic). An analogue to analysis of variance conducted on weighted unbiased…

Meta-analytic research techniques were used to compare the General Aptitude Test Battery (GATB) validities of blacks and non-minorities. The sample consisted of 7,854 black and 15,769 non-minority subjects from 113 Specific Aptitude Test Battery (SATB) validation studies analyzed since 1972. The first approach was to compare average validities…