Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)

Purpose: To provide educationalists with an understanding of the key quality issues relating to multiple-choice tests, and a set of guidelines for the quality assurance of such tests. Design/methodology/approach: The discussion of quality issues is structured to reflect the order in which those issues naturally arise. It covers the design of…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

Describes a practical approach that teachers can use to check for test-item validity in test construction. The Kuder-Richardson Reliability Formula is used. Detailed instructions describe the procedure for evaluating items for difficulty and using statistical methods to determine test validity. (AM)

This book is a guide to categorizing, measuring, testing, and assessing aspects of language, and is intended for language teachers, speech therapists and other language-related practitioners, and researchers, in conjunction with other resources on research methods and statistics. The first part is a discussion of basic terminology and the varied…

The Bilingual Education Evaluation System was developed to help local bilingual education projects overcome evaluation obstacles and design sound, useful evaluations within the constraints of available funding and with responsiveness to current federal legislation and regulations. The evaluation system proposed involves a process component, an…

A quantitative study modeled the inherently subjective admissions process for 592 graduate school candidates and 72 raters. Logistic regression models were well-fitting and parsimonious, allowing analysis of each stage of the process. Extended committee discussion/deliberation phases were of limited productivity when inter-rater agreement was…

The interrelationships of a variety of student aptitude and achievement measures are examined in a sample of 88 Australian undergraduate students, and the critial role of the data analyst in examining the relationships is discussed. (MSE)

Administers an experimental college version of the Musical Aptitude Profile (CMAP) and 2 motivation measures to 187 nonmusic majors in a music appreciation course. Eliminates CMAP results from analysis resulting from low reliability. Includes data table that were significantly related. (NL)

Describes two QuickBASIC programs that provide students direct experience with interpreting correlation scatter-plots. Maintains that the programs can be used in classroom exercises to highlight factors that influence the size of a Pearson correlation coefficient. (CFR)

Describes a QuickBASIC program for demonstrating the differences between main effects and interactions in factorial designs. The program can be used in conjunction with a traditional lecture to improve student understanding and develop skills in recognizing main effects and interactions from graphic displays. (CFR)

Instructional leadership studies are plentiful but have many shortcomings, including lack of definition of key variables, problems of causality, overrepresentation of exemplary schools, and lack of validity and reliability in research design and implementation. Definitions of "leadership" and "instruction" are needed. There is…

Higher education relies on student ratings to evaluate faculty teaching, partly because the alternatives (expert peer appraisals or objective performance criteria) are costly or unavailable. Because student ratings are crucial not only to improving instruction, but also in making or breaking faculty careers, it is important to assure that they…

In statistical terms, transfer rates require two components: a numerator that represents community college students who transfer and a denominator that approximates the pool of potential transfer students. The California Task Force adopted a set of criteria to judge the appropriateness of prospective pairs of numerators and denominators. Its form…