The Research Excellence Framework is a high-stakes exercise used by the UK government to allocate billions of pounds of quality-related research (QR) funding and used by the media to rank universities and their departments in national league tables. The 2008, 2014 and 2021 assessments were zero-sum games in terms of league table position because…

This new ACT publication is an annual report offering meaningful research insights for some of the most pressing questions impacting admissions and enrollment practice. In the first release of this report, ACT research sheds light on the following topics: (1) the practice of super-scoring; (2) STEM major choice; (3) factors impacting retention and…

The accuracy of self-assessment has long been examined empirically in higher education research, producing a substantial body of literature that casts light on numerous potential moderators. However, despite the growing popularity of self-assessment in interpreter training and education, very limited evidence-based research has been initiated to…

The Research Excellence Framework (REF) is a new system for assessing the quality of research in UK higher education institutions (HEIs). For the first time, part of the assessment included the wider impact of research. RAND Europe was commissioned to evaluate the assessment process of the impact element of REF submissions, and to explore the…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high-stakes testing arena rely on classical test theory…

In February 2009, the Higher Education Funding Council for England (HEFCE) commissioned RAND Europe to review approaches to evaluating the impact of research as part of their wider work programme to develop new arrangements for the assessment and funding of research--referred to as the Research Excellence Framework (REF). The objectives were 1) to…

This catalog lists research reports, research notes, and other publications available from the College Board's website. The catalog briefly describes research publications available free of charge. Introduced in 1981, the Research Report series includes studies and reviews in areas such as college admission, special populations, subgroup…

This hermeneutically crafted qualitative study examines how six university-educated middle-class Pakistani Muslim women negotiate the competing expectations of traditional Muslim culture and the emancipated ethos of the university. It uses Robert Kegan's constructive-developmental theory, whose Subject-Object scoring system distinguishes a…

This monograph for institutional researchers on questionnaire survey research aims to be both a guide to the basic steps of survey research and a useful reference tool. The monograph is in an informal, question and answer format and organized around the various steps of the survey research process. Chapter I discusses planning the survey including…

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…

To study the stability of students' writing performances across occasions, four essays were obtained from each of 107 college students. These were scored with an analytic system that counts errors in 18 categories. Score reliability, computed by summing the 18 categories, was .36 for a single essay and .68 for the set of four essays. Score…

Reports two studies of a method for classifying justifications of moral judgments and suggests its use in demonstrating developmental trends during adolescence. Argues that this method distinguishes content of moral judgments from justifications for them, analyzes justifications relative to both abstraction and reflection, and assigns…

Traditionally the unit of analysis in marital research has been the individual spouse. More recently the marital relationship has often been defined as a process of interaction and dynamic exchanges such that spouses have autonomous needs as well as corporate needs for interdependence. Thus modern systems theory heightens the importance of both…

This report is Part I of a 3 part project report on THE VALIDATION OF A BIOGRAPHICAL INVENTORY AS A PREDICTOR OF COLLEGE SUCCESS. This part, dealing with the development and validation of a scoring key for the Biographical Inventory, covers the major quantitative analysis of the data. Part II is concerned with sociometric and interview contingency…