Assessing the effectiveness of educational technology professional development (ETPD) must go beyond obtaining feedback from participants about their level of satisfaction with a workshop presenter. Effective and meaningful assessment of ETPD requires that we design inservice learning activities that can be measured using methods that are…

In 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students' knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the…

Although the federal No Child Left Behind program judges the effectiveness of schools based on their students' achievement status, many policy analysts argue that schools should be measured, instead, by their students' achievement growth. Using a 10-year student-level panel data set from North Carolina, we examine how school-specific pressure…

Purpose: District effectiveness research (DER) is an emerging field concerned with identifying the organizational structures, administration, and leadership practices at the school district level that help districts find success with all of their students across the schools within the system. This work has mirrored much of the early school…

Alternatives to vertical scales are compared for measuring longitudinal academic growth and for producing school-level growth measures. The alternatives examined were empirical cross-grade regression, ordinary least squares and logistic regression, and multilevel models. The student data used for the comparisons were Arabic Grades 4 to 10 in…

The current main world university rankings broadly group the leading research universities of nations. Australia's Go8 universities are generally within the top 250 ranked universities, with several institutions in the top 50-100 on some measures. This recognition is commendable, however imperfect the individual rankings may be. Use is made of…

Educational commentators have offered many pedagogical rationales for using Web 2.0 to support learning in higher education, and academics are being encouraged to find ways for their students to use social web technologies. Questions arise as to the value of these activities compared to more conventional assignments, and whether implementing such…

This toolkit is designed to help community schools evaluate their efforts so that they learn from their successes, identify current challenges, and plan future efforts. It provides a step-by-step process for planning and conducting an evaluation at your community school site(s). The toolkit is a practical, hands-on guide that makes it possible for…

In education, artificial intelligence (AI) has not made much headway. In the one area where it would seem poised to lend the most benefit--assessment--the reliance on standardized tests, intensified by the demands of the No Child Left Behind Act of 2001, which holds schools accountable for whether students pass statewide exams, precludes its use.…

This paper presents the effects of a continuous assessment process on mechanical engineering education at Kuwait University. This process has been in place for the last five academic years and is producing results. Efforts to educate faculty and students about the process are beginning to produce accurate and consistent measurements of student…

This excerpt from the opening plenary asks evaluators to consider two questions regarding learning and evaluation: (a) How do evaluators know if, how, when, and what people are learning during an evaluation? and (b) In what ways can evaluation be a learning experience? To answer the first question, evaluators can apply the commonplaces of…

The purpose of this study is to explore aspects and indicators most commonly used to assess the quality of education systems in different countries through the comparison of 12 national publications describing the state of the educational system. To compare indicators the CIPP model was chosen. This model is organized in four main parts: Context,…

This research study investigated the assessment practices of five different undergraduate business programs. It examines the learning outcomes required for the business programs and their linkages with general education outcomes. Specific assessment methods, the results from assessments, and how business program faculty use assessment findings to…

We join the authors in this special issue in their call to embrace a culture of evaluation. Obstacles to change are formidable. Educators debate their purpose--provide knowledge or achieve environmental goals--and we have limited evidence of the effectiveness of environmental programs and policies. Change requires collaboration across…

Effective and efficient measurement of the development of skill and knowledge, especially in domains of human activity that involve complex and challenging problems, is important with regard to workplace and academic performance. However, there has been little progress in the area of practical measurement and assessment, due in part to the lack of…