In this paper, the author aims to provide novice researchers with an understanding of the general problem of validity in social science research and to acquaint them with approaches to developing strong support for the validity of their research. She provides insight into these two important concepts, namely (1) validity; and (2) reliability, and…

School districts and states across the Regional Educational Laboratory Mid-Atlantic Region and the country as a whole have been modifying their teacher evaluation systems to identify more effective and less effective teachers and provide better feedback to improve instructional practice. The new systems typically include components related to…

This study reports on the validation of the language domain subtest of a developmental assessment scale for Cantonese Chinese preschool children. Three hundred and seventy eight multi-stage randomly selected children between 3;4 and 6;3 years of age were tested on the 104-item subtest. Fifty-four of these children, spreading across three age…

Developing normed treatment outcome measures is important to research addressing treatment effectiveness and to improved clinical care. The Preschool Outcome Questionnaire (POQ) is a new measure designed for use with preschool children aged two to six. Designed in collaboration with parents and clinicians, the POQ is brief, easy to administer,…

Few classroom measures of English language proficiency have been evaluated for reliability and validity. This research examined the concurrent and predictive validity of an oral language test, titled A Developmental English Language Proficiency Test (ADEPT), and the relationship to the California English Language Development Test (CELDT) in the…

In a provocative and influential paper, Jesse Rothstein (2010) finds that standard value added models (VAMs) suggest implausible future teacher effects on past student achievement, a finding that obviously cannot be viewed as causal. This is the basis of a falsification test (the Rothstein falsification test) that appears to indicate bias in VAM…

Although reliability is essential to validity, most research on violence risk assessment tools has paid little attention to strategies for improving rater agreement. The authors evaluated the degree to which perceived subjectivity in scoring guidelines for items from two measures--the Psychopathy Checklist-Revised (PCL-R) and the Historical,…

The purpose of the current study was to evaluate the psychometric properties of alternative approaches to administering and scoring curriculum-based measurement for written expression. Specifically, three response durations (3, 5, and 7 minutes) and six score types (total words written, words spelled correctly, percent of words spelled correctly,…

Background: Sentence construction and syntactic organization are known to be poor in children with specific language impairments (SLI), but little is known about the way in which children with SLI approach language tasks, and static standardized tests contribute little to the differentiation of skills within the population of children with…

The purpose of the current study was to evaluate a screening instrument. The sample contained 496 elementary children from the rural southeast. Properties of the Teacher, Parent, and Student Forms of the Behavioral and Emotional Screening System were examined. Results indicated that all forms had high levels of internal consistency. There were low…

This work presents the evaluation and refinement of a chemistry attitude measure, Attitude toward the Subject of Chemistry Inventory (ASCI), for college students. The original 20-item and revised 8-item versions of ASCI (V1 and V2) were administered to different samples. The evaluation for ASCI had two main foci: reliability and validity. This…

Identifying and understanding the foundational skills children need to participate effectively in formal schooling is an important objective for research in early childhood education. One component of school readiness is cognitive self-regulation (CSR). The question this study addresses is how to assess CSR with prekindergarten-aged children in a…

Consistent with previous research, the authors found that the combined use of undergraduate grade point average and the Graduate Management Admission Test (GMAT) verbal and quantitative sections successfully predicted performance in a master of business administration (MBA) program. However, these measures did not successfully predict the…

We examined the measurement properties of fall-related psychological instruments with a sample of 133 older adults (M age = 74.4 years, SD = 9.4). Measures included the Comprehensive Falls Risk Screening Instrument, Falls-efficacy Scale-International (FES-I), Activities-specific Balance Confidence (ABC), modified Survey of Activities and Fear of…

The purpose of this study was to contribute to the academic discussion regarding the validity of Multiple Intelligences (MI) theory through focusing on the validity of an important construct embedded in the theory, that of congruence between instructional style and preferred MI style for optimal learning. Currently there is insufficient empirical…