In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

Purpose: Graduate admission has become a critical process for quality assurance in tertiary education. Hitherto, most research has investigated the validity of admissions instruments. However, surprisingly little work has been conducted on the overall organization of admission, which often remains "informal, ad hoc, and lacking in…

Multitiered frameworks of service delivery have traditionally underserved students with mental health needs. Whereas research has supported the assessment and intervention of social and academic behavior across tiers, evidence is limited with regard to mental health concerns including internalizing behaviors (e.g., anxiety and depression). In…

In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A…

Secondary data on 1,028 graduate students nested within 24 programs and admitted into either a Ph. D. or Ed. D. program between 1990 and 2006 at an American public university were used to illustrate the benefits of employing multilevel discrete-time hazard analysis in understanding the timing of doctorate completion in Education and the factors…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

Assessing student attainment in the major field of study is increasingly important to employers and accrediting bodies alike. Construction and manufacturing firms do not like engineers who design faulty bridges and airplanes. Marketing firms want to hire students who understand the difference between a niche market and a global market. School…

Tasks are the most visible element in an educational assessment. Their purpose, however, is to provide evidence about targets of inference that cannot be directly seen at all: what examinees know and can do, more broadly conceived than can be observed in the context of any particular set of tasks. This paper concerns issues in an assessment design…

Discusses whether scores achieved by college seniors on standardized tests such as Graduate Record Examination can express collegiate value added (knowledge, skills, and abilities added to students during undergraduate studies). Encourages professional organizations to serve as forums to arrive at consensus on how to explain efficacy of…

The aim of this research was to identify, develop, and evaluate empirically new reasoning item types that might be used to broaden the analytical measure of the Graduate Record Examinations (GRE) General Test and to strengthen its construct validity. Six item types were selected for empirical evaluation, including the two currently used in the GRE…

This report examines the belief that education administration (EA) has attracted students of below-average verbal, quantitative, and analytic scores, as measured by standardized tests. The paper makes two assertions: principals as school leaders need academic credibility to relate with teachers as "critical friends," and successful…

A wide variety of potential indicators of graduate student performance are reviewed. Based on research literature, experience with recent and current research projects, and conversations with graduate faculty members and administrators, the various indicators are considered in two ways. First, they are analyzed within the framework of the…

This study examined the factor structure of the Graduate Record Examinations (GRE) General Test to appraise the extent to which an analytical factor could be identified that was distinguishable from verbal and quantitative factors. Full-information factor analysis was employed in several groups of undergraduate majors on items from one edition of…