In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

Everyone who runs a youth program believes in their hearts that their program helps kids, but in their heads, they know they need convincing data to prove it. This guide--updated from 2011--is here to help them get the data they need. The guide addresses a common problem throughout the youth field: Out-of-school time (OST) programs can help youth…

It has been suggested that both internal (e.g., acceptability) and external (e.g., feasibility) factors should be taken under consideration in order to fully understand children's usage of interventions designed to improve their behavior. The purpose of this study was to initiate development of a student self-report measure (Children's Usage…

This study, involving five experienced and trained speech language pathologists, categorized the elicited imitations of five profoundly and five severely prelingually hearing-impaired subjects using the Phonetic Level Evaluation. Failure to obtain acceptably high levels of reliability suggests that this measure may not yet be an accurate and…

A comprehensive assessment of children with Attention Deficit Disorder should include use of teacher rating scales. Rater biases, positive and negative halo effects, practice effects, and other problems are outweighed by the ease of use, low cost, and reasonable reliability and validity of teacher rating scales. (Author/DB)

Evaluation of a checklist by teachers to rate 60 secondary level learning-disabled and nondisabled students for mainstream competencies found no overall mean group differences and no inter-rater reliability, though ratings on work habits did predict course grades for all three groups (fully mainstreamed, partially mainstreamed, and nondisabled).…

A program evaluation was conducted of a summer program for academically gifted students in 5th through 10th grades. The purpose of this study was to evaluate discrepancies and congruencies among program teachers, counselors, and students in perceptions of program goal emphasis. The evaluation instrument used was a rating form composed of 60 goal…

Although higher education institutions dislike rankings published in the mass media, they like the attention the rankings create and prefer to be included rather than excluded. Common criticisms of the methodology include emphasis on inappropriate criteria, unfair comparison of private and public institutions, faulty assumptions, inaccurate data,…

In order to collect the necessary information on various practices and devices used in school climate assessment, 22 of the 39 school improvement projects mentioned in the Miles and Kaufman directory of effective schools programs were selected for a survey. A questionnaire was used to collect the primary data. Each program was asked for copies of…

The Center for the Study of Evaluation's (CSE) expository and narrative rating scales have been developed to meet the need for instructionally relevant methods for assessing students' writing competence. Research indicates that large numbers of raters can be trained in the use of these scales and that, during training and independent rating, they…

This manual describes the theory behind the Learning Process Questionnaire (LPQ) used in Australia and defines what the subscale and scale scores mean. The LPQ is a 36-item self-report questionnaire that yields scores on three basic motives for learning and three learning strategies, and on the approaches to learning that are formed by these…

A study compared student evaluations made by residency directors and deans in 2 medical schools, using 3 standard methods of ranking 20 students per school. Ordinal ranking showed substantial agreement for 15 of 16 residency directors. Two methods of clustering into fixed groups gave high agreement only for top students. (Author/MSE)

The School Subjects Attitude Scales is an instrument for measuring students' attitudes toward school subjects for grades 5-12. Twenty-four bipolar word pairs are used with evaluation, usefulness, and difficulty scales. The word pairs were selected on the basis of discussions and analysis of trial forms. Results can be used in program evaluation…

This manual describes the theory behind the Study Process Questionnaire (SPQ) and explains what the subscale and scale scores mean. The SPQ is a 42-item self-report questionnaire used in Australia to assess the extent to which a tertiary student at a college or university endorses different approaches to learning and the motives and strategies…

Presents globally oriented scoring sheet, reference guide, and rating scale for facilitating clinical hypotheses from children's Kinetic School Drawings (KSDs) and further empirical evaluations of KSD technique. Provides information on instrument construction and preliminary findings in terms of procedures' reliability and discriminant validity.…