Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a…

This commentary highlights convergent themes from four articles in the March 2009 issue of "Educational Researcher" on measuring classroom instruction. Classroom instruction is a complex enterprise that occurs at the intersection of teachers, students, and texts within the surrounding classroom, school, and community environments. Progress in…

Article is in the form of a major paper followed by responses of five art educators. (MB)

Egon G. Guba and Yvonna S. Lincoln were among the first to develop a set of extensive criteria for establishing naturalistic inquiry as a disciplined research methodology. The naturalistic paradigm--also called post-positivist, ethnographic, phenomenological, and qualitative--has gained acceptance as a legitimate alternative to the previously…

The structure of an organization plays a vital role in the evaluation of the organization. Social science researchers often assume that controls inherent in the physical sciences are as applicable to human subjects. Evaluation of Head Start is an example of the social relation of investigator to subject matter and of the variables introduced by…

This paper was prepared for school officials and researchers who plan to conduct an assessment of student writing but have limited field experience with this activity. The paper identifies twelve critical questions assessors should consider, and it explores issues involved in reaching a decision about each from the perspectives of measurement…

Using examples from an evaluation design of a bilingual preschool program, the authors have developed a paradigm resting on contextually based evaluation and involving implementation strategies and participant researchers. Multiple methods of gathering environment-specific data are used in the process. (MH)

Directors of educational projects need to be aware of the consequences their decisions may have for evaluation and appreciate the need for working closely with their evaluators from the earliest planning stage. Attempting to address the needs of project directors and evaluators, this guidebook deals with one central aspect of project…

In order to make policy decisions, educators must evaluate educational research proposals and projects. Findings immediately related to practice are often inadequate, omitting the theoretical establishment of principles by which we can explain and predict the phenomena of our world. These theoretical linkages to the practical world of…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…