Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

This chapter will value of including diverse voices of researchers. An innovative, cost-effective model for assessment will be described, capturing the process implemented at a university in its efforts to center social justice within assessment and evaluation research practices.

Massive Open Online Courses (MOOCs) concentrate an important number of students and are set up as an alternative for acquiring knowledge and continuing education. The objective of this article is to analyze how the quality and effectiveness of the MOOCs were measured in empirical studies between 2012 and 2017. For which a systematic mapping study…

This chapter provides examples of innovative methods and tools to collect, analyze, and report both quantitative and qualitative data in student affairs assessment.

Trying to understand PISA is analogous to the parable of the blind men and the elephant. There are many facets of the PISA program, and thus many ways to both applaud and critique this ambitious international program of assessment that has gained enormous importance in the crafting of contemporary educational policy. One of the facets discussed in…

Comparability between different educational qualifications is an important issue within policy discourse in the UK. In this context, the comparability of qualification demands has been explored through the use of expert human judgement. The involvement of human judgement in estimating assessment demands has consequences for methodology. This…

Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their…

The problems of shifting from norm-referenced assessment to criterion-referenced assessment have been identified by several scholars in recent years. These important critiques touch on a number of areas, but neglect a key question about how assessors learn to accomplish what Shay calls a "socially situated interpretive act". Research…

The Annual Status of Education Report (ASER) is a national citizen-led rapid assessment of children's ability to read simple text and do basic arithmetic. ASER is designed and facilitated by the Indian nongovernment organisation Pratham, and has been conducted every year since 2005 by partner organisations in every rural district of India,…

This appendix presents the data collection instruments used for the "National Evaluation of Title III Implementation: Report on State and Local Implementation" study. The purpose of this study is not to monitor Title III implementation, but to describe the implementation of Title III in states and school districts across the country. The…

This book contains the full text of papers and posters presented at the International Conference on Education and New Developments (END 2020), organized by the World Institute for Advanced Research and Science (W.I.A.R.S.), that this year had to be transformed into a fully Virtual Conference as a result of the Coronavirus (COVID 19) pandemic.…

Never before in the history of the teaching profession has there been such a need for comprehensive evaluation of all teacher preparation programs, most especially professional development schools (PDSs). This need is driven not only by the pressures of the age of accountability, but also by the need for the PDS movement to act ethically and…

This paper examines the practice of metaevaluation as indicated by the Metaevaluation standard of the Program Evaluation Standards, as the evaluation of a specific evaluation to inform stakeholders about the evaluation's strengths and weaknesses. The findings from an analysis of eighteen metaevaluations, including a description of the data…

The ability of school (or teacher) value-added models to provide unbiased estimates of school (or teacher) effects rests on a set of assumptions. In this article, we identify six assumptions that are required so that the estimands of such models are well defined and the models are able to recover the desired parameters from observable data. These…

Purpose: District effectiveness research (DER) is an emerging field concerned with identifying the organizational structures, administration, and leadership practices at the school district level that help districts find success with all of their students across the schools within the system. This work has mirrored much of the early school…