Table 2

Interrater reliability and internal consistency for each quality domain (n=33)

	Intraclass correlation^*
Domains	1 appraiser	2 appraisers	3 appraisers	4 appraisers	Cronbach α
^*The Spearman-Brown formula to obtain the ICC for the mean of k ratings from the ICC of 1 rating is: ICC_k = k(ICC₁)/1 + (k – 1)ICC₁.
1. Scope and purpose	0.44	0.61	0.70	0.76	0.88
2. Stakeholder involvement	0.47	0.64	0.72	0.78	0.72
3. Rigour of development	0.71	0.83	0.88	0.91	0.88
4. Clarity and presentation	0.25	0.39	0.49	0.57	0.69
5. Applicability	0.50	0.67	0.75	0.80	0.79
6. Editorial independence	0.34	0.51	0.61	0.67	0.64