NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1275027
Record Type: Journal
Publication Date: 2020
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0260-2938
EISSN: N/A
Research Project Assessments and Supervisor Marking: Maintaining Academic Rigour through Robust Reconciliation Processes
McQuade, Richard; Kometa, Simon; Brown, Jeremy; Bevitt, Debra; Hall, Judith
Assessment & Evaluation in Higher Education, v45 n8 p1181-1191 2020
Research project modules are a key part of UK undergraduate and postgraduate bioscience degree programmes. Report marking invariably uses two assessors, but marking models are mixed with some institutions using two independent markers and others using the project supervisor as one of the assessors. This latter model is controversial with critics suggesting that it is vulnerable to supervisor bias whilst proponents argue that it ensures subject expertise in the assessment process. Our undergraduate bioscience programmes utilise the supervisor as one of the report assessors, whilst postgraduate programmes do not. With the aim of exploring the impacts, if any, of using the supervisor as an assessor, the grades relating to undergraduate and postgraduate reports marked and reconciled during the period 2011/12 to 2016/17 were compared. Analyses of undergraduate reports (897), showed the grades awarded by the supervisor were on average 2.3% higher (p < 0.01) than those awarded by the independent assessor, although 22.8% of report grades differed by 10% and required reconciliation. After reconciliation the supervisor grades were an average of 1.3% higher (p < 0.01). Evaluation of postgraduate reports (894) showed grades awarded by 'home' assessors were on average 1.0% higher (p < 0.05) than the grades awarded by assessors from other universities, but 33.1% of the report grades differed by 10%. Following their reconciliation the average difference was 0.4%. Modification of the undergraduate reconciliation process so the two assessors agreed a single grade resulted in an average 0.5% difference (p < 0.05; Cohen's d value 0.1), which supported minimal supervisor bias and defended supervisor involvement as a project report marker.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A