Improving teacher selection is an important strategy for strengthening the quality of the teacher workforce. As districts adopt commercial teacher screening tools, evidence is needed to understand these tools' predictive validity. We examine the relationship between Frontline Education's TeacherFit instrument and newly hired teachers' outcomes. We…

For many practical purposes, it is often assumed that the quality of a marker is directly related to their seniority. At its extreme, the assumption is that the most senior marker (the Principal Examiner) is always right even in cases where large numbers of junior markers have a collectively different opinion regarding the mark that should be…

The reliability of an assessment is defined as the extent to which candidates' results would remain stable if the entire assessment exercise was repeated. Whilst numerous studies have evaluated the reliability of written examinations, relatively little has been done to quantify the reliability of internal teacher assessment within schools. This is…

Classroom observations are increasingly common in education policies as a means to assess the quality of teachers and/or education programs for purposes of making high-stakes decisions. This article considers one policy, the Head Start Designation Renewal System (DRS), which involves classroom observations to assess the quality of Head Start…

Proposals to evaluate teachers based on their "value-added" to student test scores generate intense debate. Underlying the debate are concerns about three factors: "bias," "precision," and "relevance." Previous Carnegie Foundation briefs have detailed the reasons why the first two are significant concerns.…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

Concordance tables have been used for decades to relate scores on different tests measuring similar but distinct constructs. These tables, typically derived from statistical linking procedures, provide a direct link between scores on different tests and serve various purposes. Aside from describing how a score on one test relates to performance on…

This Center for American Progress report examines whether states' adoption of standards-based policies predicts low-income students' NAEP achievement trends in fourth and eighth grade math and reading throughout the 2003-2013 decade. The report claims to analyze changes across five separate two-year intervals, but it only reports findings for…

The College Board's SAT[R] Score Choice[TM] policy allows students to choose which set(s) of scores to send to colleges and universities to which they plan to apply. Based on data gathered before the implementation of that policy, the following study evaluated the predictive validity of the various sets of SAT scores. The value of five score sets…

Claims of changes in the validity coefficients associated with general mental ability (GMA) tests due to the passage of time (i.e., temporal validity degradation) have been the focus of an on-going debate in applied psychology. To evaluate whether and, if so, under what conditions this degradation may occur, we integrate evidence from multiple…

Oral language skills are important to consider in school psychology practice, as they are directly tied to many areas of academic functioning. For example, research has demonstrated that oral language skills in early elementary school predict reading comprehension in later grades (Kendeou, van den Broek, White, & Lynch, 2009). With a…

The continued accumulation of validity evidence for the intended uses of educational assessment scores is critical to ensure that inferences made using the scores are sound. To that end, the College Board has continued to collect college outcome data to evaluate the relationship between SAT® scores and college success. This report provides updated…

Graduate studies, and in particular doctoral ones, pursue the development of scientific researchers able to make original contributions in a specific area of knowledge. However, attrition rates indicate that achieving this goal is not easy. The available evidence indicates that there are behavioral factors, positive and negative, that influence…

Students with positive attitudes toward statistics are likely to show strong academic performance in statistics courses. Multiple surveys measuring students' attitudes toward statistics exist; however, a comparison of the validity and reliability of interpretations based on their scores is needed. A systematic review of relevant electronic…

As applications for graduate and professional degree programs have reached unprecedented levels over the past decade, the applicant pool has become more diverse with more mid-career students deciding to return to school. Given the growth and diversification of the graduate applicant pool, many graduate programs are struggling to develop stronger…