ERIC Number: EJ1448221
Record Type: Journal
Publication Date: 2024
Pages: N/A
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0958-2029
EISSN: EISSN-1471-5449
Noted, but Not Decisive. A Cross-Disciplinary Analysis of Metrics Usage in Polish Evaluative Cultures
Research Evaluation, v33 Article rvae045 2024
Metrics-based reasoning patterns diffuse from core to periphery as peripheral and semi-peripheral countries adopt Western evaluation standards as formal categories or cultural scripts. While these scripts are applied across disciplines, each field maintains its own traditional criteria for scientific assessment. Consequently, scholars navigate between internalized and externally imposed evaluative frameworks when writing reviews. This study examines how metrics-based reasoning diffuses differently across disciplines through evaluative practices, with metrics being transformed and interpreted within the context of each field's unique evaluative culture. To compare diffusion patterns, this article analyzes 174 negative habilitation reviews across four Polish disciplines: art history, mathematics, materials engineering, and sociology. Despite uniform policy incentives, reviewers employed diverse criteria when assessing publication records. Materials engineering exhibited the most extensive use and emphasis on metrics, while art history relied minimally on indicators. Crucially, metrics were never the sole basis for negative conclusions but were consistently accompanied by additional forms of reasoning.
Descriptors: Evaluation Methods, Art History, Mathematics, Engineering, Sociology, Policy, Publications, Interdisciplinary Approach, Cultural Influences
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A