Purpose: The purposes of this meta-review are to (a) articulate the importance of transparency and reproducibility in meta-analysis, (b) assess the transparency and reproducibility of meta-analyses published in journals of the American Speech-Language-Hearing Association (ASHA), and (c) discuss the implications of our findings and recommendations…

Ongoing or recently completed across the United States are a series of lawsuits via which teacher plaintiffs are contesting how they are being evaluated using value-added models (VAMs) as part of states'/districts' teacher accountability systems. To investigate the empirical and pragmatic matters addressed in court, researchers conducted a case…

With artificial intelligence (AI) is extensively applied in education, human-centered AI (HCAI) has become an active field. There although has been increasing concern about how to systematically enhance the AI applications effect, AI risk governance in HCAI education has not been discussed yet. This study adopted literature meta-analysis, along…

Higher education institutions and faculty have vested interests in fair tenure processes. We explored perceptions of fairness from the perspective of faculty who did not obtain tenure. Our 22 participants indicated that they experienced organizational justice violations related to distributive justice (fairness of decisions), procedural justice…

Contemporary teacher evaluation systems are built upon multiple measures including, primarily, teacher-level value-added and observational estimates. While researchers have conducted examinations of these systems and indicators, researchers have not investigated how using these systems might distort the validity of the inferences being drawn,…

State and federal accountability policies are predicated on the ability to estimate valid and reliable measures of school impacts on student learning. The typical spring-to-spring testing window potentially conflates the amount of learning that occurs during the school year with learning that occurs during the summer. We use a unique dataset to…

This study investigates knowledge structures and scientific communication using bibliometric methods to explore scientific knowledge production and dissemination. The aim is to develop knowledge about this growing field by investigating studies using international large-scale assessment (ILSA) data, with a specific focus on those using Programme…

Responsible Operations is intended to help chart library community engagement with data science, machine learning, and artificial intelligence (AI) and was developed in partnership with an advisory group and a landscape group comprised of more than 70 librarians and professionals from universities, libraries, museums, archives, and other…

Authentic assessments used in response to accountability demands in higher education face at least two threats to validity. First, a lack of interchangeability between assessment tasks introduces bias when using aggregate-based scores at an institutional level. Second, reliance on written products to capture constructs such as critical thinking…

Being an expert involves explaining how things are supposed to work, and, perhaps more important, why things might not work as supposed. In this study, researchers surveyed scholars with expertise in value-added models (VAMs) to solicit their opinions about the uses and potential of VAMs for teacher-level accountability purposes (for example, in…

Since 1992, the UK Government has published so-called "school league tables" summarising the average General Certificate of Secondary Education (GCSE) "attainment" and "progress" made by pupils in each state-funded secondary school in England. While the headline measure of school attainment has remained the percentage…

The daily report card (DRC) is a commonly employed behavioral intervention for treating attention deficit hyperactivity disorder (ADHD) in schools. Much of the support for the DRC comes from single-case studies, which have traditionally received less attention than group studies. This lack of attention to single-case studies results in an…

Bias in teachers' judgment formation and decision making has long been acknowledged. More specifically, studies have repeatedly demonstrated discrepancies between teacher ratings of minority and majority students with similar academic profiles. Studies have also demonstrated that increasing accountability reduced bias. Little is known, however,…

The Daily Report Card (DRC) is a commonly employed behavioral intervention for treating Attention Deficit Hyperactivity Disorder (ADHD) in schools. Much of the support for the DRC comes from single-case studies, which have traditionally received less attention than group studies. This lack of attention to single-case studies results in an…

Meta-analyses are syntheses of effect-size estimates obtained from a collection of studies to summarize a particular field or topic (Hedges, 1992; Lipsey & Wilson, 2001). These reviews are used to integrate knowledge that can inform both scientific inquiry and public policy, therefore it is important to ensure that the estimates of the effect…