Rethinking diagnostic delay in cancer: how difficult is the diagnosis? ====================================================================== * Georgios Lyratzopoulos * Jane Wardle * Greg Rubin **Georgios Lyratzopoulos**, **Jane Wardle**, and **Greg Rubin** argue that delays in referral for suspected cancer are unlikely to be caused by poor professional performance and explore other potential causes and strategies for improvement The timely diagnosis of cancer is a frequent theme in the lay press and an increasingly common topic for quality improvement initiatives.1 2 The UK’s health secretary has advocated ranking general practices on the NHS Choices website according to how promptly patients subsequently diagnosed with cancer are referred to specialist services for suspected cancer.3 But is such a policy based on evidence? Its main assumption is that the multiple visits made by these patients to primary care before referral chiefly reflect poor professional performance rather than factors such as clinical complexity, reasonable watchful waiting, or the need for appropriate investigations in primary care. We review the occurrence of multiple pre-referral consultations and discuss how a better understanding of variation between cancers might improve the timeliness of diagnosis. ## How common are multiple consultations? Most patients with cancer present to primary care with symptoms that have low or very low positive predictive values. Even “red flag” symptoms (such as rectal bleeding, dysphagia, haemoptysis, and haematuria) have positive predictive values for cancer of <10% in men,4 and these values are typically up to twofold lower for women and even lower for young adults and children (<1%).5 This means that the great majority of patients with such symptoms will not have cancer. Despite the low specificity of cancer symptoms, about 80% of patients subsequently diagnosed with cancer are referred to a hospital specialist after one (50%) or two (30%) consultations.6 7 But a substantial minority (20%) of patients with cancer visit a primary care doctor with relevant symptoms three or more times before referral. This number is often considered by policy makers and cancer charities to reflect an avoidable delay.8 9 In this article we use the term “multiple consultations” to denote three or more visits to primary care before referral. ## Why multiple consultations matter The number of consultations is associated with increased time from presentation to referral for cancer. National audit data show that the median time to referral is 34 days for patients having three consultations, 47 days for four consultations, and 96 days for five or more consultations.6 However, these interval data are skewed to the right, meaning that many patients experience notably longer times to referral—for example, a quarter of patients with three, four, and five or more consultations experience intervals longer than 64, 90, and 172 days, respectively. Stage at diagnosis is a strong predictor of survival, so prolonging the interval from presentation to diagnosis could increase the risk of stage progression and poorer clinical outcomes.10 11 However, confounding by patients with rapidly progressive disease who present with advanced cancer and have poor outcomes despite prompt referral makes the interpretation of observational studies challenging.12 Multiple consultations also adversely affect the experience of care as patients with cancer and their relatives express strong preferences for a prompt diagnosis.8 13 Not suspecting the diagnosis of cancer, or failing to act on such a suspicion, can also be upsetting for doctors. ## Why do multiple consultations occur? Considering different cancers separately is critical for gaining insight into the challenges of diagnosis. Although often referred to as a single entity, cancer is a highly heterogeneous disease, arising from different organs and systems and associated with diverse symptoms. National audit and patient survey data show that the strongest predictor of multiple consultations is tumour site. Between 30% and 50% of patients subsequently diagnosed with multiple myeloma or pancreatic, stomach, or lung cancer have multiple consultations, compared with <10% of patients subsequently diagnosed with breast cancer or melanoma (figure⇓).6 7 These differences seem to reflect the “symptom signature” of different cancers—cancers where most patients present with fairly specific symptoms (such as a palpable breast lump or a visible skin lesion) are less associated with multiple consultations than those where most patients present with non-specific symptoms (such as back or abdominal pain). The proportion of patients with a given cancer who experience multiple consultations could therefore be considered a marker of the difficulty of suspecting that cancer at first presentation to primary care. ![Figure1](https://www.bmj.com/https://www.bmj.com/content/bmj/349/bmj.g7400/F1.medium.gif) [Figure1](https://www.bmj.com/content/349/bmj.g7400/F1) Percentage of patients with cancer who had three or more consultations with a general practitioner before referral. These data can be used to categorise cancers as “easier to suspect” (melanoma, breast, endometrial cancer), “harder to suspect” (multiple myeloma, pancreatic, ovarian, stomach, lung), or of intermediate diagnostic difficulty. Reprinted from Lyratzopoulos G, Neal RD, Barbiere JM, Rubin GP, Abel GA. Variation in number of general practitioner consultations before hospital referral for cancer: findings from the 2010 National Cancer Patient Experience Survey in England. *Lancet Oncol* 2012;13:353-65 with permission from Elsevier. Another relevant factor is the need for initial investigations for non-specific symptoms in primary care. This is good clinical practice but often requires additional consultations to discuss the results and to plan the next steps.14 In the English National Audit of Cancer Diagnosis in Primary Care about 80% of patients with multiple consultations had at least one diagnostic test—twice the proportion of patients who were referred after a single consultation. Factors unrelated to the quality of clinical reasoning during the consultation may also be implicated. A recent study of significant event audits in the diagnosis of lung cancer revealed several such factors, including poor communication between primary and secondary care services and patient preference for delayed referral.1 If poor medical practice were the main reason for multiple consultations, they might be expected only in patients consulting a minority of clinicians. But given that up to 20% of all patients with newly diagnosed cancer in England have multiple consultations, it seems improbable that these thousands of patients are seen by a few poorly performing GPs. Considered together, these observations suggest that diagnostic difficulty and the need for investigation of poorly differentiated symptoms in primary care are more likely to be the drivers for multiple consultations than poor diagnostic reasoning and suboptimal professional practice. ## Diagnostic difficulty The association between cancer site and multiple consultations led us to question whether individual cancers could be classified by diagnostic difficulty. If so, this knowledge might help to guide the development of tests and interventions for decision support and quality improvement, providing a useful framework to guide future practice, policy, and research.15 Using the proportion of patients who have multiple consultations as a measure of diagnostic difficulty, cancers can be divided into those that are harder to suspect (>30% of patients), easier to suspect (<10%), and those of intermediate diagnostic difficulty (10-30%) (table⇓). View this table: [Table1](https://www.bmj.com/content/349/bmj.g7400/T1) How interventions to improve diagnostic timeliness might be applied to cancers in different diagnostic difficulty categories ### Harder to suspect cancers Most patients with these cancers present with non-specific symptoms that are often seen in primary care. For example, two thirds of patients with multiple myeloma present with back pain,16 and nearly half of patients with pancreatic cancer with abdominal pain.17 Breakthroughs in diagnostic technology and the more frequent and systematic use of existing tests could be particularly useful in shortening the interval to referral for patients with these cancers (table⇑). For example, diagnosis of multiple myeloma might be improved by a point of care (finger prick) test currently in early clinical application, which detects immunoglobulin free light chains,18 or by greater use of existing blood tests, such as those for inflammatory markers including plasma viscosity.19 For pancreatic cancer, tests that measure microRNA levels in blood are being explored.20 Another approach is to make imaging technologies, such as ultrasonography for abdominal complaints, more accessible at the point of care.21 Novel diagnostic tests will need careful evaluation, ideally in pragmatic randomised controlled trials in primary care. ### Easier to suspect cancers These cancers (for example, breast, endometrial, or testicular cancer) are of lower diagnostic difficulty because most patients present with fairly specific signs and symptoms. However, some patients experience multiple consultations for reasons that are not entirely clear but are likely to include atypical presentations, personal preference for delayed referral, and suboptimal clinical reasoning or other healthcare factors.1 When patients who had multiple consultations are subsequently diagnosed with easier to suspect cancers, quality improvement approaches, such as significant event audits, should be triggered to help understand the factors responsible and to identify opportunities for improvement (table⇑). ### Intermediate cancers Some patients with cancers in the intermediate category of diagnostic difficulty (such as colorectal and renal cancers) have specific symptoms but others present atypically. The interventions that could be helpful for this category of cancers are potentially useful for all cancers. Decision support interventions may be of particular value.22 Enabling access to specialist expertise or investigations (such as imaging and endoscopy) may also be particularly helpful, and can be supported by case discussion arrangements with specialists. In a national primary care audit, GPs judged that better access to investigations would have altered management in 8-20% of patients subsequently diagnosed with cancers for which endoscopy or imaging are the principal diagnostic modalities, such as abdominal organ cancers.6 ## Potential indirect benefits and harms Incidental diagnosis of asymptomatic lesions of uncertain prognosis may occur in symptomatic patients who have imaging investigations for suspected cancer, with unclear patient benefit.23 On the other hand, investigations in some patients with suspected cancer will enable diagnosis of other diseases that are causing the symptoms (for example, inflammatory bowel disease diagnosed as a result of tests for suspected colorectal cancer), and these patients will benefit from timely and accurate diagnosis and treatment. A better understanding is needed of the potential for indirect benefits and harms from tests for symptomatic patients, bearing in mind that most patients express a preference to be investigated for potential cancer at risk levels as low as 1%,24 which is well below current detection rates of about 10% among patients referred for suspected cancer.25 ## Cancer policy and research Efforts to reduce multiple consultations should not deflect attention from opportunities to shorten diagnostic intervals that may lie either with the patient before presentation or with secondary care after referral. For example, the time from symptom onset to first presentation is longer than a month for a quarter of women later diagnosed with breast cancer, compared with an average interval to referral after presentation of zero days.6 26 Avoidable delays after referral have been reported for patients later diagnosed with colorectal cancer—in a US study the median time from first referral to completion of colonoscopy was 123 days,27 although relevant UK evidence is currently sparse. When cancer is suspected but symptoms are non-localising, new models of multispecialty diagnostic services can help to integrate diagnostic assessment processes and minimise prolonged investigation intervals or the risk of referral to the “wrong” specialty. Such services have been recently established in Denmark and are being piloted in England through the Accelerate Coordinate Evaluate (ACE) NHS initiative. Any new interventions or diagnostic service models need to be evaluated using rigorous study designs in primary care populations. Examining variation in measures of diagnostic activity (such as use of endoscopy or imaging) across general practices might provide insight into how to improve diagnostic quality.28 29 Improving the diagnostic process requires the development of failsafe systems for overlooked abnormal tests and recall of patients who did not attend planned investigations or follow-up appointments.30 31 Substantial advances in surgical safety have been made by considering the performance of theatre teams and hospital systems in addition to the competency of individual surgeons.32 Similarly, research to improve diagnostic timeliness should encompass system-wide factors, including communication between primary and secondary care. We argue that prolonged diagnostic intervals chiefly reflect limitations in scientific knowledge and in the organisation and delivery of healthcare. This understanding is critical for informing the development of novel research strategies and policies to improve diagnostic quality. We advocate a framework for future research and improvement strategies that recognises the central role of variation in diagnostic difficulty across different cancers and organisational factors. We also advocate better information for the public, the media, and policy makers about the origins of prolonged intervals between presentation and diagnosis of cancer. #### Key messages * Most patients who have cancer diagnosed after the onset of symptoms are referred after one or two GP consultations (80%), but a substantial minority (20%) have three or more consultations * Multiple GP consultations prolong diagnostic intervals and may affect clinical outcomes and care experience * The proportion of patients who have multiple consultations varies by cancer site, consistent with variation in each cancer’s symptom signature, with some cancers being harder to suspect than others * Diagnostic difficulty and the need for investigations in primary care could contribute substantially to the risk of multiple consultations * Diagnosis may be swifter if facilitated by decision support interventions, better interactions between generalists and specialists, and easier access to diagnostics * Policy initiatives focusing solely on professional performance are unlikely to be effective ## Notes **Cite this as:** *BMJ* 2014;349:g7400 ## Related links ### thebmj.com * [Read more analysis articles from The BMJ ](http://www.bmj.com/news/analysis) ## Footnotes * GL is supported by a postdoctoral fellowship award from the National Institute for Health Research 2012-14 (PDF-2011-04-047). JW is supported by Cancer Research UK. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research, the Department of Health, or any other organisation. * Contributors and sources: The article was developed iteratively through discussions between the authors, who work in public health and clinical epidemiology (GL), behavioural science (JW), and primary care and general practice research (GR). All authors contributed to the arguments and the proposed stratification framework. GL is the guarantor. * Competing interests: We have read and understood BMJ policy on declaration of interests and declare the following interests: GL is a member (2012-15) of NICE’s development group for the guideline on the recognition and management of suspected cancer in children, young people and adults; the arguments made in this paper are the product of academic research unrelated to the scope of the guideline. GR led the National Audit of Cancer Diagnosis in Primary Care on behalf of the Royal College of General Practitioners in 2010-12 and was the RCGP Clinical Lead for Cancer between 2012 and March 2014. JW has no relevant interests to declare. * Provenance and peer review: Not commissioned; externally peer reviewed. This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/). ## References 1. Mitchell ED, Rubin G, Macleod U. Understanding diagnosis of lung cancer in primary care: qualitative synthesis of significant event audit reports. Br J Gen Pract2013;63:e37-46. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNjMvNjA2L2UzNyI7czo0OiJhdG9tIjtzOjIzOiIvYm1qLzM0OS9ibWouZzc0MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 2. Leaver L, Gilbert BJ, Jones J, Allaby M. Cancer referrals. Cancer cases diagnosed as emergencies may be fewer than reported. BMJ2013;347:f4773. [FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDcvanVsMzBfNS9mNDc3MyI7czo0OiJhdG9tIjtzOjIzOiIvYm1qLzM0OS9ibWouZzc0MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 3. Malnick, E. GPs to be named and shamed over cancer diagnosis. Telegraph2014 Jun 29. [www.telegraph.co.uk/health/healthnews/10933442/GPs-to-be-named-and-shamed-over-cancer-diagnosis.html](http://www.telegraph.co.uk/health/healthnews/10933442/GPs-to-be-named-and-shamed-over-cancer-diagnosis.html). 4. Jones R, Latinovic R, Charlton J, Gulliford MC. Alarm symptoms in early diagnosis of cancer in primary care: cohort study using General Practice Research Database. BMJ2007;334:1040. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEzOiIzMzQvNzYwMi8xMDQwIjtzOjQ6ImF0b20iO3M6MjM6Ii9ibWovMzQ5L2Jtai5nNzQwMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 5. Dommett RM, Redaniel MT, Stevens MC, Hamilton W, Martin RM. Features of cancer in teenagers and young adults in primary care: a population-based nested case-control study. Br J Cancer2013;108:2329-33. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1038/bjc.2013.191&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=23619924&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000320249500017&link_type=ISI) 6. Lyratzopoulos G, Abel GA, McPhail S, Neal RD, Rubin GP. Measures of promptness of cancer diagnosis in primary care: secondary analysis of national audit data on patients with 18 common and rarer cancers. Br J Cancer2013;108:686-90. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1038/bjc.2013.1&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=23392082&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000316523400029&link_type=ISI) 7. Lyratzopoulos G, Neal RD, Barbiere JM, Rubin GP, Abel GA. Variation in number of general practitioner consultations before hospital referral for cancer: findings from the 2010 National Cancer Patient Experience Survey in England. Lancet Oncol2012;13:353-65. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1016/S1470-2045(12)70041-4&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=22365494&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000302287000043&link_type=ISI) 8. Rarer Cancers Foundation. Primary cause? An audit of the experience in primary care of rarer cancer patients. 2011. [www.rarercancers.org.uk/images/stories/cdf/p8and9/primary%20cause%20-%20final.pdf](http://www.rarercancers.org.uk/images/stories/cdf/p8and9/primary%20cause%20-%20final.pdf). 9. Royal College of General Practitioners. National audit of cancer diagnosis in primary care. 2011. [www.rcgp.org.uk/news/2011/november/~/media/Files/News/National\_Audit\_of\_Cancer\_Diagnosis\_in\_Primary-Care.ashx](http://www.rcgp.org.uk/news/2011/november/~/media/Files/News/National\_Audit\_of\_Cancer_Diagnosis_in_Primary-Care.ashx). 10. Richards MA, Westcombe AM, Love SB, Littlejohns P, Ramirez AJ. Influence of delay on survival in patients with breast cancer: a systematic review. Lancet1999;353:1119-26. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1016/S0140-6736(99)02143-1&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=10209974&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000079858400008&link_type=ISI) 11. Tørring ML, Frydenberg M, Hamilton W, Hansen RP, Lautrup MD, Vedsted P. Diagnostic interval and mortality in colorectal cancer: U-shaped association demonstrated for three different datasets. J Clin Epidemiol2012;65:669-78. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1016/j.jclinepi.2011.12.006&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=22459430&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) 12. Neal RD. Do diagnostic delays in cancer matter? Br J Cancer2009;101(Suppl 2):S9-12. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1038/sj.bjc.6605384&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=19956171&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000273523000003&link_type=ISI) 13. Risberg T, Sørbye SW, Norum J, Wist EA. Diagnostic delay causes more psychological distress in female than in male cancer patients. Anticancer Res1996;16:995-9. [PubMed](https://www.bmj.com/lookup/external-ref?access_num=8687166&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=A1996UP71700070&link_type=ISI) 14. National Institute for Health and Care Excellence. Referral guidelines for suspected cancer. 2005. [www.nice.org.uk/guidance/cg27](http://www.nice.org.uk/guidance/cg27). 15. Graber ML. Medical diagnosis—the promise. Diagnosis2014;1:5-9. 16. Howell DA, Smith AG, Jack A, Patmore R, Macleod U, Mironska E, et al. Time-to-diagnosis and symptoms of myeloma, lymphomas and leukaemias: a report from the Haematological Malignancy Research Network. BMC Hematol2013;13:9. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1186/2052-1839-13-9&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=24238148&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) 17. Stapley S, Peters TJ, Neal RD, Rose PW, Walter FM, Hamilton W. The risk of pancreatic cancer in symptomatic patients in primary care: a large case-control study using electronic records. Br J Cancer2012;106:1940-4. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1038/bjc.2012.190&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=22617126&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000305011100007&link_type=ISI) 18. University of Birmingham. World’s first point-of-care diagnostic device for multiple myeloma. 2013. [www.birmingham.ac.uk/partners/news/items/worlds-first-point-of-care-diagnostic-device-for-multiple-myeloma.aspx](http://www.birmingham.ac.uk/partners/news/items/worlds-first-point-of-care-diagnostic-device-for-multiple-myeloma.aspx). 19. Bird JM, Owen RG, D’Sa S, Snowden JA, Pratt G, Ashcroft J, et al. Guidelines for the diagnosis and management of multiple myeloma 2011. Br J Haematol2011;154:32-75. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1111/j.1365-2141.2011.08573.x&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=21569004&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) 20. Schultz NA, Dehlendorff C, Jensen BV, Bjerregaard JK, Nielsen KR, Bojesen SE, et al. MicroRNA biomarkers in whole blood for detection of pancreatic cancer. JAMA2014;311(4):392-404. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1001/jama.2013.284664&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=24449318&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000329939300025&link_type=ISI) 21. Moore CL, Copel JA. Point-of-care ultrasonography. N Engl J Med2011;364:749–57. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1056/NEJMra0909487&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=21345104&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000287652500009&link_type=ISI) 22. Hamilton W, Green T, Martins T, Elliott K, Rubin G, Macleod U. Evaluation of risk assessment tools for suspected cancer in general practice: a cohort study. Br J Gen Pract2013;63:e30-6. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNjMvNjA2L2UzMCI7czo0OiJhdG9tIjtzOjIzOiIvYm1qLzM0OS9ibWouZzc0MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 23. Guldbrandt LM, Rasmussen TR, Rasmussen F, Vedsted P. Implementing direct access to low-dose computed tomography in general practice-method, adaption and outcome. PLoS One2014;9:e112162. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1371/journal.pone.0112162&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=25383780&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) 24. Banks J, Hollinghurst S, Bigwood L, Peters TJ, Walter FM, et al. Preferences for cancer investigation: a vignette-based study of primary-care attendees. Lancet Oncol2014;15:232-40. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1016/S1470-2045(13)70588-6&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=24433682&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000330228700036&link_type=ISI) 25. Meechan D, Gildea C, Hollingworth L, Richards MA, Riley D, Rubin G. Variation in use of the 2-week referral pathway for suspected cancer: a cross-sectional analysis. Br J Gen Pract2012;62:e590-7. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMToiNjIvNjAyL2U1OTAiO3M6NDoiYXRvbSI7czoyMzoiL2Jtai8zNDkvYm1qLmc3NDAwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 26. Keeble S, Abel GA, Saunders CL, McPhail S, Walter FM, Neal RD, et al. Variation in promptness of presentation among 10 297 patients subsequently diagnosed with one of 18 cancers: evidence from a National Audit of Cancer Diagnosis in Primary Care. Int J Cancer2014;135:1220-8. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1002/ijc.28763&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=24515930&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000337608300023&link_type=ISI) 27. Singh H, Khan R, Giardina TD, Paul LW, Daci K, Gould M, et al. Postreferral colonoscopy delays in diagnosis of colorectal cancer: a mixed-methods analysis. Qual Manag Health Care2012;21:252-61. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1097/QMH.0b013e31826d1f28&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=23011072&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) 28. National Cancer Intelligence Network of Public Health England. General practice profiles. [www.ncin.org.uk/cancer\_information\_tools/profiles/gp\_profiles](http://www.ncin.org.uk/cancer_information_tools/profiles/gp_profiles). 29. Rogers S, Gildea C, Meechan D, Baker R. Access, continuity of care and consultation quality: which best predicts urgent cancer referrals from general practice? J Public Health (Oxf)2014;36:658-66. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoianBobSI7czo1OiJyZXNpZCI7czo4OiIzNi80LzY1OCI7czo0OiJhdG9tIjtzOjIzOiIvYm1qLzM0OS9ibWouZzc0MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 30. Singh H, Giardina TD, Petersen LA, Smith MW, Paul LW, Dismukes K, et al. Exploring situational awareness in diagnostic errors in primary care. BMJ Qual Saf2012;21:30-8. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicWhjIjtzOjU6InJlc2lkIjtzOjc6IjIxLzEvMzAiO3M6NDoiYXRvbSI7czoyMzoiL2Jtai8zNDkvYm1qLmc3NDAwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 31. Murphy DR, Laxmisan A, Reis BA, Thomas EJ, Esquivel A, Forjuoh SN, et al. Electronic health record-based triggers to detect potential delays in cancer diagnosis. BMJ Qual Saf2014;23:8-16. [Abstract/FREE Full Text](https://www.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicWhjIjtzOjU6InJlc2lkIjtzOjY6IjIzLzEvOCI7czo0OiJhdG9tIjtzOjIzOiIvYm1qLzM0OS9ibWouZzc0MDAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 32. Vincent C, Moorthy K, Sarker SK, Chang A, Darzi AW. Systems approaches to surgical quality and safety: from concept to measurement. Ann Surg2004;239:475-82. [CrossRef](https://www.bmj.com/lookup/external-ref?access_num=10.1097/01.sla.0000118753.22830.41&link_type=DOI) [PubMed](https://www.bmj.com/lookup/external-ref?access_num=15024308&link_type=MED&atom=%2Fbmj%2F349%2Fbmj.g7400.atom) [Web of Science](https://www.bmj.com/lookup/external-ref?access_num=000220382400007&link_type=ISI)