NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1404199
Record Type: Journal
Publication Date: 2023
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1040-0419
EISSN: EISSN-1532-6934
Comparing Expert, Quasi-Expert, and Novice Evaluations of Award-Winning Design Products Using the Consensual Assessment Technique
Linna Hu; May Boggess; Mardelle M. Shepley
Creativity Research Journal, v35 n4 p730-748 2023
The consensus-based assessment has long been a prevalent methodology employed in "panel crit" settings in design education and professional design awards. Acknowledging the subjective nature of design evaluation and its importance to the design development process, we report two studies investigating the effect of three levels of design expertise (expert, quasi-expert, and novice) on the evaluation of award-winning lamp designs using the consensual assessment technique (CAT). The pilot study (N = 30) preliminarily examined expertise-related differences in evaluation outcome (i.e., ratings and rankings) and the use of the CAT instrument. In a follow-up study (N = 135), we tested four hypotheses using the refined CAT instrument. Results showed a significant interaction effect between expertise group and design on evaluation. Correlations between groups showed that quasi-experts were more similar to novices than experts. This finding contributes to the discussion on whether quasi-experts should be considered proper substitutes for experts. Furthermore, the reliability of ratings on individual CAT scale items varied among groups, suggesting that the degree to which raters were consistent within a group depends upon which aspect of design quality they were assessing. Taken together, the findings provide valuable insights into the influence of design education and experience on judging design quality.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A