The purpose of this study was to develop and test the construct validity and reliability of a self-report measure of self-regulated practice behaviors for beginning and intermediate instrumentalists. A questionnaire was designed to assess the motive, method, behavior, time management, and social influences dimensions of the theoretical model of…

We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Although peer nominations provide invaluable data on social status and reputations of classmates, the large size and organizational structure of secondary schools pose a practical challenge to utilizing nomination methods. Particularly problematic is determining the appropriate reference group when students are no longer in self-contained…

This article illustrates how test specifications based solely on academic content standards, without attention to other cognitive skills and item response demands, can fall short of their targeted constructs. First, the authors inductively describe the science achievement construct represented by a statewide sixth-grade science proficiency test.…

Distractor-driven multiple-choice assessment items and Rasch modeling were used as diagnostic tools to investigate students' understanding of middle school chemistry ideas. Ninety-one items were developed according to a procedure that ensured content alignment to the targeted standards and construct validity. The items were administered to 13360…

This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item…

Background: Cigarette smoking is a health-risk behavior of global proportions. Self-efficacy plays an important role in both smoking acquisition and smoking resistance. Reliability and validity of an instrument is fundamental to research results, particularly in its simplified form on a different population. The purpose of this study was to…

This study examined the structure, internal consistency, and construct validity of the ClassMaps Survey, a measure of classroom characteristics that are related to students' resilience and classroom success. Participants were 1,019 fifth- through eighth-grade science students who completed the ClassMaps Survey, a survey describing their classroom…

The purpose of this study was to examine students' psychosocial perceptions of their science classroom learning environment in order to identify exemplary teachers. This mixed-method study used the valid and reliable What Is Happening In this Class? (WIHIC) questionnaire with over 3,000 middle school students in 150 classrooms in Australia.…

With the recent addition of engineering to most K-12 testable state standards, efficient and comprehensive instruments are needed to assess changes in student knowledge and perceptions of engineering. In this study, I developed the Students' Awareness and Perceptions of Learning Engineering (STAPLE) instrument to quantitatively measure fourth…

This paper reports on part of a large-scale study aimed at examining students' perceptions of assessment. This paper will report on a study utilising mixed methodology in 150 Australian middle school classrooms. The purpose of the study described in this paper was to use the Students' Perceptions of Assessment Questionnaire on Teacher Interaction…

In this technical report, data are presented on the practical utility, reliability, and validity of the easyCBM[R] mathematics (2009-2010 version) measures for students in grades 3-8 within four districts in two states. Analyses include: minimum acceptable within-year growth; minimum acceptable year-end benchmark performance; internal and…

American educators and researchers have spent decades attempting to determine the most effective middle level school configuration. Although various models have been conceptualized in order to resolve one of our most extensive educational reform movements, a recent nationwide increase in K-8 schools suggest interested parties have accepted the K-8…

This measurement study examined the construct validity of the retell component of the Texas Middle School Fluency Assessment (Texas Education Agency, University of Houston, & The University of Texas System, 2008a) within a confirmatory factor analysis framework. The role of retell, provided after a one-minute oral reading fluency measure, was…