The present study explores two rating methods for peer assessment (analytical rating using criteria and comparative judgement) in light of concurrent validity, reliability and insufficient diagnosticity (i.e. the degree to which substandard work is recognised by the peer raters). During a second-year undergraduate course, students wrote a one-page…

This systematic review examined evidence of the utility of learning progression (LP)--based assessments to inform teaching and student learning in classroom contexts. Fifty-nine studies met inclusion criteria and were analyzed against four research questions. Evidence highlighted their potential for supporting judgments about learning, informing…

The purpose of this research is to make a meta-evaluation of the program evaluation studies on teacher training programs in Turkey. Meta-evaluation is the process of revealing the deficiencies and errors of the research as the last stage of the program evaluation process. In this context, the steps of the meta-evaluation processes were followed…

The challenges and possibilities for improvement may vary across the three levels of an assessment system--classroom assessment, school or district assessment, and state-level accountability assessment. In this brief, the discussion of the challenges and possibilities focuses on these three levels and on two forms of assessment--formative and…

The addition of 'clinically significant impairment' (American Psychiatric Association, Diagnostic and statistical manual of mental disorders, Author, 2013) to the diagnostic criteria for autism in DSM-5 attempts to establish a threshold for the condition. However, the increased prominence of the neurodiversity paradigm and social model of…

Higher education in post-independence Africa remains trapped in foreign knowledge systems, despite decades of strong cries to replace them with Afrocentric systems. The purpose of this dissertation-in-practice was to evaluate the Africanization of an undergraduate program at a college in Southern Africa. Using the CIPP Model of evaluation, a…

Assessment is overdue for a technology-supported reboot, and this practical guide will help you do just that. Within its pages, you'll discover a balanced approach to assessment for learning that includes conversations and performance-based observations as key components. Real-world case studies and differentiated implementation options are…

In this article, Julia So discusses the purpose of program assessment, four common missteps of program assessment and reporting, and how to prevent them. The four common missteps of program assessment and reporting she has observed are: (1) unclear or ambiguous program goals; (2) measurement error of program goals and outcomes; (3) incorrect unit…

While early career researchers (ECRs) often read and produce articles for peer reviewed journals, they are of ten less familiar with peer review reports (PRRs). Most ECRs learn about the genre of PRRs by reading reports written about their authored manuscripts, and through hands-on experience crafting their own PRRs, albeit often with little…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Many studies have found that supported employment (SE) has effectively helped people with severe mental illness obtain and maintain competitive employment. However, most SE studies have asked "What works?" rather than discerning what works for whom, in what circumstances, in what respects and how. It is important to understand the…

Construct maps and related item type frameworks, which respectively describe and identify common patterns in student reasoning, provide teachers with tools to support instruction built upon students' intuitive thinking. We present a methodological approach--embedded within common assessment development processes--for developing such construct maps…

Formative evaluation provides stakeholders with timely feedback to support an intervention's improvement during implementation to maximize its effectiveness. We describe the qualitative methods that guided one study within a formative evaluation of a multicomponent care delivery intervention. We then describe the challenges and lessons learned…

The assessment and evaluation process is crucial for building or reforming any educational system. Saudi Arabia, via its different educational entities, has invested heavily in developing assessment and evaluation programs and practices at many levels of the education sector. A national student assessment framework is needed to support…