Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

Researchers suggest that certain supportive behaviors of mentors could increase the benefits of school-based mentoring for youth. However, the literature contains few validated instruments to measure these behaviors. In our present study, we aimed to construct and validate a tool to measure the supportive behaviors of mentors participating in…

This addendum to previously published results presents alternative analyses of data from large-scale effectiveness studies of Cognitive Tutor Algebra I in middle schools and high schools. These alternative analyses produce results that are substantively the same as previously reported. We find a significant positive effect of 0.21 standard…

The identification of children at-risk for reading problems can be costly and time-consuming. Previous research has indicated that teachers are relatively accurate in assessing children's overall reading ability. This study investigated the accuracy of kindergarten and first grade teacher rating scales in predicting children's reading…

Over many decades, science education researchers have developed, validated, and used a wide range of attitudinal instruments. Data from such instruments have been analyzed, results have been published, and public policies have been influenced. Unfortunately, most science education instruments are not developed using a guiding theoretical…

Quality measurement serves as a foundation for child care Quality Rating and Improvement Systems (QRIS). Understanding the variation that exists in quality measurement, the different contexts in which states make decisions, and the factors that play into their decisions can help administrators identify where their state may fall along the spectrum…

The purpose of this study is to determine online self-regulated learning levels of students by adapting "Online Self-Regulated Learning Scale" designed by Barnard and his colleagues into Turkish. Present study, irrespective of being a scale analysis, is at the same time a qualitative research. It is executed via scan model. Study group…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) public-use data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011), which includes the first release of the public version of the third-grade data. This manual mainly provides information specific…

The purpose of the study was to determine the relationship between teacher perceptions of the frequency and effectiveness of principal instructional leadership behaviors and student achievement in high-poverty elementary schools. In order to accomplish the purpose, survey methodology was employed. Teachers from six high-poverty elementary schools…

Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

A study was conducted to assess the equivalence of validity and reliability of two forms of the Self-Esteem Rating Scale. A total of 228 responses were obtained from a purposive sample. Several data analysis methods were used to test specific hypotheses, and two methods of equating observed scores on the two forms were used. The results were…

Three numerical coefficients for analyzing the validity and reliability of ratings are described. Each coefficient is computed as the ratio of an obtained to a maximum sum of differences in ratings. The coefficients are also applicable to the item analysis, agreement analysis, and cluster or factor analysis of rating-scale data. (Author/BW)

In research with children, there is a common problem which could reduce the reliability of a questionnaire for some children but not others: verbal comprehension. (Authors)

It was hypothesized that unstable subject-item interactions on personality scales would be associated with small psychological distances between subjects and items. It was further hypothesized that this relationship would be more demonstrable when the psychological test was more homogeneous. To clarify the rationale of the first hypothesis, an…