A "review" is textual feedback provided by a reviewer to the author of a submitted version. Peer reviews are used in academic publishing and in education to assess student work. While reviews are important to e-commerce sites like Amazon and e-bay, which use them to assess the quality of products and services, our work focuses on…

We systematically evaluated the peer-reviewed Rorschach validity literature for the 65 main variables in the popular Comprehensive System (CS). Across 53 meta-analyses examining variables against externally assessed criteria (e.g., observer ratings, psychiatric diagnosis), the mean validity was r = 0.27 (k = 770) as compared to r = 0.08 (k = 386)…

This meta-analysis (148 studies, k = 197, N = 31,718) examined the relationship between motivation and transfer in professional training. For this purpose, motivation was conceptualized in the following nine dimensions: motivation to learn, motivation to transfer, pre- and post-training self-efficacy, mastery orientation, performance orientation,…

During this decade there have been numerous efforts to identify instructional practices that improve students' writing. These include "Reading Next" (Biancarosa and Snow, 2004), which provided a set of instructional recommendations for improving writing, and "Writing Next" (Graham and Perin, 2007) and "Writing to Read" (Graham and Hebert, 2010),…

This study examined the effects of training on peer assessment and comments provided regarding oral presentations in EFL (English as a Foreign Language) classrooms. In Study 1, both the treatment and control groups received instruction on skill aspects, but only the treatment group was given an additional 40-minute training on how to rate…

Subjected 48 quantitative peer assessment studies that compared peer and teacher marks to meta-analysis. Peer assessments were found to resemble teacher assessments more closely when global judgments based on well understood criteria were used rather than when marking involved assessing several individual dimensions. (Author/SLD)

Used meta-analysis to review the literature regarding the correlation between self-supervisor, self-peer, and peer-supervisor ratings. Results indicated a relatively high correlation between peer and supervisor ratings, but only a moderate correlation between self-supervisor and self-peer ratings, with job type seeming to moderate self-peer and…

A meta-analysis of studies examining the interrater reliability of the standard practice of peer assessments of quality of care was conducted through the use of several databases. The mean weighted kappa of 21 findings from 13 studies was 0.31, which suggests that the interrater reliability of peer assessment is limited. (SLD)