Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

A utilization-focused evaluation (Patton, 2008) was conducted to systematically investigate special education teacher candidates' preparation to teach English language learners (ELLs) with disabilities. The results were used to (1) determine current effectiveness of departmental programs and (2) guide program improvement efforts. The initial…

As the method, instrument, and reliability of teacher and principal evaluations have come under extreme scrutiny since the Education Reform Act of 2010, school systems across the nation have examined and refined the evaluation process for teachers and principals. Studies have shown the integration of peer evaluation as a model of teacher…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…

The horse has left the barn. Distance education is here to stay and the number of degree programs offered online is growing rapidly. California State University Channel Islands (CI) admitted its first students in 2002, and the undergraduate and graduate degrees in business were among its first program offerings. From its inception, the…

Over the last two decades, there has been renewed interest in formative assessment, in large part due to the increasing pressures and prevalence of "high stakes" summative assessments. As states try to meet the requirements of the No Child Left Behind law, teachers and administrators are realizing that formative assessment offers an…

Effective classroom assessment techniques are directly linked to course objectives and proposed outcomes. Results within formative and summative assessments have been studied in the online learning environment as educators seek to meet objectives with respect to student success in the non-traditional setting. Online classroom assessment techniques…

The use of behavioral skills training (BST) to educate 3 adolescent boys on the risks of lighters and fire setting was evaluated using in situ assessment in a school setting. Two participants had a history of fire setting. After training, all participants adhered to established rules: (a) avoid a deactivated lighter, (b) leave the training area,…

Nonprofit organizations are under great pressure to use evaluations to show that their programs "work" and that they are "effective." However, empirical evidence indicates that nonprofits struggle to perform useful evaluations, especially when conducted under accountability pressures. An increasing body of evidence highlights…

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

The purpose of this study is to report National Board Certified Teachers' (NBCTs) perceived impact on student learning. The guiding research question for this study, "How do teachers perceive the influence of the National Board Certification process on student learning in their own classrooms?" was explored. A total of 496 NBCTs…

This article details a case of using ePortfolios in the evaluation process and assessment of the Department of Communication at the University of Hawai'i at Manoa. The program is guided by seven SLOs (student learning outcomes), which are demonstrable skills or abilities that students are expected to possess before receiving their degrees. The SLO…

This chapter describes the historical and contemporary theoretical underpinnings of learning communities and argues that there is a need for more complex models in conceptualizing and assessing their effectiveness.