Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

Success rates in California community college developmental mathematics courses have hovered around 50% for decades. These gatekeeper courses have prevented many students from earning college degrees. Since community college is the starting point for the majority of California's potential college graduates and the majority of these students…

The determinants of sentencing are of much interest in criminal justice and legal research. Understanding the determinants of sentencing decisions is important for ensuring transparent, consistent, and justifiable sentencing practice that adheres to the goals of sentencing, such as the punishment, rehabilitation, deterrence, and incapacitation of…

A simulation study was conducted in an attempt to examine how evaluators modify their evaluation design in response to differing stakeholder groups. In this study, evaluators were provided with a fictitious description of a school-based program. They were then asked to design an evaluation of the program. After the evaluation design decisions were…

Sampling has been the single most influential component of conducting research with lesbian, gay, and bisexual (LGB) populations. Poor sampling designs can result in biased results that will mislead other researchers, policymakers, and practitioners. Investigators wishing to study LGB populations must therefore devote significant energy and…

Effective policymaking requires understanding the causal effects of competing proposals. Relevant causal quantities include proposals' expected effect on different groups of recipients, the impact of policies over time, the potential trade-offs between competing objectives, and, ultimately, the optimal policy. This dissertation studies causal…

I define a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, including comparisons that are relatively unknown in both the literature and practice. I then assess the relative merit, worth, and value of all possible comparisons based on the…

Background: The philosophical underpinnings of evaluation guidelines set forth by a funding agency can sometimes seem inconsistent with that of the intervention. Purpose: Our purpose is to introduce questions pertaining to the contrast between the instructional program's underlying philosophical beliefs and assumptions and those underlying our…

In the context of intensifying accountability for academic work internationally, there are increasing pressures on individual supervisors, departments and universities to evaluate the quality of doctoral supervision. Existing evaluation tools are focused at departmental rather than individual level and are mostly quantitative. Evaluation for…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Program providers work extremely hard to offer services that they believe will enhance the lives and future prospects of children and youth. But how can they be sure that their program is having the intended impacts? How can funders and policy makers be sure that their investments in programs are paying off in substantially better outcomes for…

This study (1) explores the effectiveness of the contextualized history of science on student learning of nature of science (NOS) and genetics content knowledge (GCK), especially interrelationships among various genetics concepts, in high school biology classrooms; (2) provides an exemplar for teachers on how to utilize history of science in…

Recently, the importance of ill-structured problem-solving in real-world contexts has become a focus of educational research. Particularly, the hypothesis-development process has been examined as one of the keys to developing a high-quality solution in a problem context. The authors of this study examined predictive relations between young…

The aim of this study was to develop and validate an assessment tool for research consent competence in older participants. A four-item instrument was developed to assess the capacity of the older adults to consent to research. Data were obtained from 203 nursing home residents from two facilities and 201 community-dwelling older adults in a…

For over four decades the Wisconsin Card Sorting Test (WCST) has been one of the most distinctive tests of prefrontal function. Clinical research and recent brain imaging have brought into question the validity and specificity of this test as a marker of frontal dysfunction. Clinical studies with neurological patients have confirmed that, in its…