Logic modeling, the process that explicates how programs are constructed and theorized to bring about change, is considered to be standard evaluation practice. However, logic modeling is often experienced as a transactional, jargon-laden, discrete task undertaken to produce a document to comply with the expectations of an external entity, the…

[This paper is part of the Focused Collection on Instructional labs: Improving traditions and new directions.] In recent years, physics instructional labs have been under considerable research and development. However, there seems to be no shared understanding of how the assessment of instructional labs should be arranged to best serve students'…

Background: Adoption of the Whole School, Whole Community, Whole Child (WSCC) model has been slowed by a lack of available tools to support implementation. The Wellness School Assessment Tool (WellSAT) WSCC is an online assessment tool that allows schools to evaluate the alignment of their policies with the WSCC model. This study assesses the…

Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

This study evaluates techniques to identify high-quality teachers. Since tenure restricts dismissals of experienced teachers, schools must predict productivity and dismiss those expected to perform ineffectively prior to tenure receipt. Many states rely on evaluation scores to guide these personnel decisions without considering other dimensions of…

Although there are some federal and state statutes and regulations regarding principal evaluation systems, there are a variety of principal evaluation systems across the nation and in California. California's principal evaluation system is at the district level, meaning that implementation and effectiveness rest solely on the district. A district…

The purpose of this study was to conduct a program evaluation case study on the impact of standards-based grading in a North Carolina school district. The implementation procedures and end products of grading reform were assessed using the CIPP model. Data from teacher questionnaires, principal implementation checklists, interviews, and…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Background and Context: Students' programming projects are often assessed on the basis of their tests as well as their implementations, most commonly using test adequacy criteria like branch coverage, or, in some cases, mutation analysis. As a result, students are implicitly encouraged to use these tools during their development process (i.e., so…

The large scale expansion of online courses has led to the crisis of course quality issues. In this study, we first established an evaluation index system for online courses using factor analysis, encompassing three key constructs: course resource construction, course implementation, and teaching effectiveness. Subsequently, we employed factor…

In the existing literature, scholars have proposed various indices to measure the lexical richness (LR) of English as a foreign language (EFL) writing. However, there are currently issues of redundant indices and inconsistent usage. Attempting to address the research question of which indices are the most sensitive and effective ones to…

Program evaluation is an essential practice for providers of behavior analytic services, as it helps providers understand the extent to which they are achieving their intended mission to the community they serve. A proposed method for conducting such evaluations, is through the use of a consecutive case series design, for which cases are…

Evaluative criteria define a "high quality" or "successful" evaluand and provide the basis for judgment of merit and worth, yet they are often assumed and implicit in the evaluation process. This article presents an empirically supported model that describes and integrates two aspects of criteria: domain and source. Domain…

Student satisfaction is a key performance indicator in evaluating any degree program's performance. In light of the vast difference between online and traditional degree programs, factors that may significantly affect student satisfaction and thus contribute to the success of online degree programs still need to be explored. Previous literature on…

Program-level assessment is a holistic approach for arranging assessments throughout a degree program that supports sequential development of discipline knowledge, transferable skills and career readiness. Currently, the modular arrangement of courses means that student learning is partial, limited to passing the assessment and compartmentalized…