NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1330505
Record Type: Journal
Publication Date: 2022-Mar
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0175
EISSN: N/A
Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?
Ceh, Simon Majed; Edelmann, Carina; Hofer, Gabriela; Benedek, Mathias
Journal of Creative Behavior, v56 n1 p41-54 Mar 2022
Creativity research crucially relies on creativity evaluations by external raters, but it is not clear what properties characterize good raters. In the present study, we investigated whether rater personality and rater creativity are related to discernment (i.e., the ability to distinguish creative from uncreative responses) when evaluating others' responses. To this end, 166 novice raters evaluated a pre-selected set of responses from the alternate uses task for creativity. We further assessed the rater's creativity and personality and explored the role of task factors such as rating motivation and rating time. We found that creativity in terms of creative potential and creative achievement independently predicted rater discernment. At the level of personality, openness to experience was related to higher discernment, but not any other Big-Five factors or dark triad traits. Rater discernment also increased with rating time, rating motivation, and rater leniency (i.e., the tendency to appreciate creative responses). Finally, we seized the large rater sample to estimate to what extent inter-rater reliability depends on rater number and how dependable ratings are across the rating scale. Together, these findings highlight relevant factors at person, task, and method level predicting individual discernment, which should be considered to ensure good inter-rater reliability in creativity ratings.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A