Article Text

Original research
Strategies to address recruitment to a randomised trial of surgical and non-surgical treatment for cancer: results from a complex recruitment intervention within the Mesothelioma and Radical Surgery 2 (MARS 2) study
  1. Nicola Mills1,
  2. Nicola Farrar1,
  3. Barbara Warnes1,
  4. Kate E Ashton1,
  5. Rosie Harris1,
  6. Chris A Rogers1,
  7. Eric Lim2,3,
  8. Daisy Elliott1
  1. 1 Bristol Medical School, University of Bristol Faculty of Health Sciences, Bristol, UK
  2. 2 Academic Division of Thoracic Surgery, The Royal Brompton Hospital, London, UK
  3. 3 National Heart and Lung Institute, Imperial College London Faculty of Medicine, London, UK
  1. Correspondence to Dr Nicola Mills; nicola.mills{at}bristol.ac.uk

Abstract

Objectives Recruiting to randomised trials is often challenging particularly when the intervention arms are markedly different. The Mesothelioma and Radical Surgery 2 randomised controlled trial (RCT) compared standard chemotherapy with or without (extended) pleurectomy decortication surgery for malignant pleural mesothelioma. Anticipating recruitment difficulties, a QuinteT Recruitment Intervention was embedded in the main trial phase to unearth and address barriers. The trial achieved recruitment to target with a 4-month COVID-19 pandemic-related extension. This paper presents the key recruitment challenges, and the strategies delivered to optimise recruitment and informed consent.

Design A multifaceted, flexible, mixed-method approach to investigate recruitment obstacles drawing on data from staff/patient interviews, audio recorded study recruitment consultations and screening logs. Key findings were translated into strategies targeting identified issues. Data collection, analysis, feedback and strategy implementation continued cyclically throughout the recruitment period.

Setting Secondary thoracic cancer care.

Results Respiratory physicians, oncologists, surgeons and nursing specialists supported the trial, but recruitment challenges were evident. The study had to fit within a framework of a thoracic cancer service considered overstretched where patients encountered multiple healthcare professionals and treatment views, all of which challenged recruitment. Clinician treatment biases, shaped in part by the wider clinical and research context alongside experience, adversely impacted several aspects of the recruitment process by restricting referrals for study consideration, impacting eligibility decisions, affecting the neutrality in which the study and treatment was presented and shaping patient treatment expectations and preferences. Individual and group recruiter feedback and training raised awareness of key equipoise issues, offered support and shared good practice to safeguard informed consent and optimise recruitment.

Conclusions With bespoke support to overcome identified issues, recruitment to a challenging RCT of surgery versus no surgery in a thoracic cancer setting with a complex recruitment pathway and multiple health professional involvement is possible.

Trial registration number ISRCTN ISRCTN44351742, Clinical Trials.gov NCT02040272.

  • Randomized Controlled Trial
  • QUALITATIVE RESEARCH
  • Thoracic surgery
  • Clinical Trial
  • ONCOLOGY

Data availability statement

Data are available on reasonable request. Data, in terms of deidentified consultation and interview transcripts, are available from the corresponding author on reasonable request. This is on the condition that the request fulfils the necessary approvals in place for 'controlled access' data, that participants have agreed to the optional consent to share their anonymised data, and that participant anonymity or privacy is considered not to be compromised.

https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • Embedding a complex recruitment intervention into a randomised trial deemed difficult to recruit to enabled key challenges to be identified and addressed in ‘real time’.

  • Findings were triangulated from multiple qualitative and quantitative data sources.

  • Over one-third of health care professionals approached were not interviewed and we did not have audio recordings of consultation discussions from half of the study sites.

  • Ability to feedback and engage with individual recruiters on recruitment to study discussions was not always possible, resulting in a written report being sent with no confirmation it was read.

Introduction

Challenges of recruiting to randomised controlled trials (RCTs) are well recognised.1–3 Just over a quarter of respiratory trials and half of surgical trials fail to recruit to their target sample.4–7 Recruitment failure is reported as the prevalent reason for premature closure of surgical trials.8 Challenges tend to be more pronounced in trials comparing markedly different interventions, such as surgical versus non-surgical treatment, where issues around equipoise are likely to be heightened.9

Malignant pleural mesothelioma is a rare cancer of the lining of the chest wall affecting over 2500 people each year in the UK.10 Prognosis is poor with long-term survival ranging from 4 to 18 months and a 5-year survival rate of less than 10%.11 12 While there have been advances in systemic treatments, surgery in the form of pleurectomy decortication (removal of the diseased lining of the chest and lung) or extended pleurectomy decortication (involving additional removal of the lining of the heart and/or diaphragm), remains the most commonly performed procedure worldwide in an attempt to improve survival despite no randomised evidence of its effectiveness.

The Mesothelioma and Radical Surgery 2 (MARS 2) multicentre RCT (ISRCTN 44351742) was conducted in the UK to determine whether (extended) pleurectomy decortication alongside chemotherapy is superior to chemotherapy alone with respect to overall survival for patients with pleural mesothelioma.13 The study anticipated recruitment challenges given the interventions being very different, so a QuinteT Recruitment Intervention (QRI)14 was embedded in the main phase of the study to support recruitment. The QRI is a flexible, tailored complex intervention that triangulates multiple qualitative strategies and quantitative data to identify and address recruitment difficulties as they arise in real time.14 15 Having been embedded in over 70 trials, it has led to insights into recruitment issues and the development of targeted strategies that have improved recruitment.14 16 The aim of the QRI in MARS 2 was to understand the recruitment process and how it operates in clinical centres, so that sources of difficulties could be identified, and suggestions made to optimise the process. Despite anticipated and identified challenges with recruitment, the MARS 2 study successfully recruited to target with a 4-month COVID-19 pandemic-related extension. This paper illustrates the key challenges and describes the actions undertaken to mitigate barriers to support the conduct of this, and future trials, with divergent treatment arms in a cancer setting.

Methods

The MARS 2 study

Recruitment pathway: The MARS 2 study has been detailed previously.13 Figure 1 summarises the typical study recruitment pathway in the context of usual clinical practice. Adults with a diagnosis of malignant pleural mesothelioma were mostly introduced to the study by respiratory physicians and/or oncologists alongside local research staff at one of 25 medical sites across the UK. Patients were then referred to a thoracic surgeon at one of five trial accredited UK surgical sites (often in different hospitals to the medical site) to determine eligibility and discuss the study in more detail before typically being referred back to the local medical team for study consent. Following two cycles of chemotherapy, consented patients were reassessed for eligibility and randomised to continue with chemotherapy alone or receive surgery and further chemotherapy. The study opened to recruitment in May 2015 with an initial 2-year internal pilot phase and continued through the main study phase until the recruitment target of 328 patients had been reached. The planned recruitment end date was 31 July 2020, but recruitment was paused March–June 2020 due to the COVID-19 pandemic. Once the pause was lifted, sites restarted recruitment in a staggered way, depending on capacity, and recruitment was extended until 31 December 2020. The recruitment target was achieved in November 2020.

Figure 1

MARS 2 recruitment pathway (with typical clinical pathway in red). MARS 2, Mesothelioma and Radical Surgery 2; MDT, multidisciplinary team.

Flow of participants to the point of randomisation: 1030 patients were assessed for eligibility, 645 were eligible and 335 were randomised. Of the 310 eligible patients who did not consent, most were not approached for consent (n=183), did not consent (n=74) or did not undergo two cycles of chemotherapy and repeat CT scan (n=36).

Patient and public involvement

Patient and public representatives were involved in the design of the trial, selection of the primary outcome measure and the definition of the minimally important difference in relative survival, and development of patient facing study documents. The trial steering committee also included a patient and public involvement representative.

The QRI in the MARS 2 study

The QRI in MARS 2 was only integrated within the main phase of the trial (not pilot) and entailed two core phases as detailed elsewhere.13 14 QRI phase 1 aimed to understand the recruitment process at sites and key challenges that had the potential to hinder recruitment. Methods included mapping eligibility and recruitment pathways, interviewing a purposive maximum variation sample of study/site staff and patients, audio recording study recruitment consultations and reviewing patient-facing documentation. Topic guides, adapted from previous QRI studies and refined to explore emerging findings as the study progressed, were used flexibly in the interviews. Interview and recruitment consultation recordings were transcribed verbatim, and along with recruitment screening logs, were subject to simple counts, content and thematic analyses led by NM.15 17 18 Particular attention was paid to the consultation recordings for instances of unclear, insufficient or imbalanced information provision and transferring of clinician treatment biases to patients. Preliminary analysis, drawing together data from the various sources to identify and understand common challenges, informed further data collection. NM, NF and DE, as experienced qualitative/QRI researchers who conducted the interviews, independently analysed a proportion of transcripts to assess the dependability of coding, and met regularly to review coding and descriptive findings, agree on further sampling and discuss theoretical development alongside findings from screening logs.

QRI phase 1 commenced in March 2018. Findings were fed back to the chief investigator (CI) and trial management group (TMG) as key issues arose. Effective strategies, tailored to address identified issues, were devised and implemented from October 2018 (start of QRI phase 2). Phases 1 and 2 continued cyclically until recruitment target was reached. QRI training, based on the QuinteT RCT recruitment training intervention,19 was additionally delivered prior to QRI phase 1 (November 2017 to February 2018) to tackle barriers that had emerged in the pilot phase20 and previous QRI studies.21–25

Results

QRI sample

As part of the QRI, 19/25 study sites consented to audio record recruitment discussions. We obtained 55 consultation recordings with 16 study recruiters from 12 sites lasting a mean of 49 min. Between December 2017 and March 2020, we undertook 25 interviews with 24 study staff (of 39 invited) from 18 sites lasting 40 min on average. The sample consisted of nine oncologists, six research nurses/practitioners/co-ordinators, five surgeons, three respiratory/chest physicians and one TMG member. Additionally, we conducted 21 interviews with 20 patients from 5 sites who had been invited to participate in MARS 2. Findings from patient interviews have been reported elsewhere,26 although they fed into the interpretation of findings presented herein.

Recruitment challenges

MARS 2 was described by health professionals as an important study that answers a much-needed question as to the role of pleurectomy decortication for mesothelioma with the potential to change future practice. It was recognised that surgery was currently undertaken in the UK in an ‘ad hoc’ and ‘unregulated way’ that was unsupported by high-quality evidence. Building the evidence base to address this was the main drive to be part of the study. Challenges with recruitment, however, were evident. These were apparent at all stages of the recruitment process from patient identification to receiving consent and were due largely to intellectual and emotional challenges around equipoise compounded by a complex pathway that entailed patient contact with different health professionals and conflicting treatment views.

Organisational challenges of conducting mesothelioma research

Complex pathways

The MARS 2 recruitment pathway involved additional steps to usual clinical practice (figure 1). Many site staff described recruitment challenges stemming from the complex study pathway that involved receiving and referring patients for time-sensitive investigations and treatment from different specialists and hospitals. Some patients were referred to MARS 2 sites by local centres which were not involved in the RCT, meaning their standard of care was arranged through other hospitals with additional visits related to MARS 2 being carried out at study sites. Study sites relied on colleagues from neighbouring hospitals being aware of MARS 2 and referring patients for consideration. Established regional mesothelioma multidisciplinary team (MDT) meetings were recognised as crucial for identifying potentially eligible patients, but where sites were not operating within this structure referrals were sometimes more ad hoc leading to missed patients or delayed referrals making patients ineligible (table 1, quote 1). Pressures of a busy service were noted as exacerbating the problem. Trying to fit the MARS 2 study and its complex pathway and timings into a service that was perceived as ‘already stretched’ was deemed challenging. Delays in investigations and chemotherapy meant that some patients became ineligible, or they declined the study as they were not willing to accept further treatment delays. Staff capacity issues resulted in one site having to temporarily pause receiving referrals for study consideration. As recruitment progressed, investigator fatigue was offered as an explanation for a slowdown of recruitment and a potential for ‘coasting’, if sites met what they set as their recruitment target.

Table 1

Quotes from interviews supporting identified recruitment challenges

Competing research agendas

With the ‘explosion of interest in immunotherapies’ and molecular treatment showing promise, a competing research agenda was proposed as hindering recruitment. Studies that should have been complementary and not overlapping in terms of patient selection were considered by some as competing, with a minority of clinicians stating that they either decided which study the patient would be best suited for or they presented the options for the patient to decide.

Tension between clinical versus personal equipoise

Hesitancy in referring patients for study consideration

Doubts about the effectiveness of surgery for mesothelioma were evident across specialties. These were driven by findings from previous RCTs showing other types of surgery as not improving survival27 28 and potentially causing harm,28 and a belief that the condition should not be treated with chemotherapy or surgery due to its poor prognosis. The impact of these views was recognised at all stages of the recruitment process. They were felt to account for fewer than expected study referrals from neighbouring sites and colleagues, or patients coming to discuss the study with a firm idea of their treatment plan, which often accorded with the previous specialist’s view (table 1, quotes 2, 3). This was described as making the study discussion challenging.

Bias in determining eligibility

Although study recruiters described uncertainty around the effectiveness of pleurectomy decortication across the clinical community (ie, clinical equipoise), and therefore, a need for the study, individual levels of equipoise varied. These ranged on a continuum from not believing the surgery will be effective, to being neutral as to its effectiveness, having a ‘hunch’ that it will be effective (especially regarding a subset of ‘young and fit’ patients), and in a minority of cases, having a seemingly strong belief in the effectiveness of the surgery. Personal levels of equipoise, though, could vary depending on the individual patient. This created a tension at times between appreciating the clinical equipoise versus personal feelings about what would be right for a particular patient. Recruiters shared their discomforts in deeming a patient eligible when it went against their experience and ‘gut feeling’ about what they felt would be right for that individual. Older patients, those less physically fit and those with a sarcomatoid cell-type caused the most discomfort and were less likely to be put forward for the study, even though ‘on paper’ they fulfilled the eligibility criteria (table 1, quotes 4, 5).

Recruiter bias in describing treatments

Bias was also evident at times in the description of treatments given in patient consultations. Study recruiters recognised that they may not have always been in equipoise about surgery but were keen to set any biases aside and explain the study impartially. In practice, although they articulated equipoise to patients by explaining the uncertainty as to the effectiveness of lung-sparing surgery, the equipoise was sometimes compromised in the ensuing discussion. This was often indirectly, through choice of words that created an imbalanced description of treatments, for example, referring to surgery as ‘giving an extra benefit’ as opposed to having ‘what traditionally is given for this and hoping for the best’ or describing it as ‘experimental’ and a ‘pretty horrible operation’. In a very few cases equipoise was over-ridden in the study discussion, with the recruiter making clear their treatment biases and steering patients in a particular direction that accorded with their beliefs for that individual. Unsurprisingly, patients tended to go in the direction of the clinician’s steer. A minority of clinicians also offered patients surgery off trial, bringing into question their level of equipoise (table 1, quotes 6, 7).

Discomfort approaching patients at time of diagnosis

Finally, there was an indication that some recruiters, more so research nurses/co-ordinators, were uncomfortable approaching patients about the study at the time of receiving a life-limiting diagnosis. If they sensed the patient was overwhelmed, then the conversation about MARS 2 (if raised) was sometimes couched in such a way that recognised this and offered patients a clear way out (table 1, quote 8).

Addressing identified recruitment challenges

The recruitment issues identified during phase 1 of the QRI were fed back to the CI and TMG from September 2018 onwards on a regular basis and actions agreed to address them (phase 2). Table 2 presents an outline and timelines of the main QRI-informed actions that were implemented. A mix of face-to-face, online video, telephone and written documentation was used to feedback on findings and engage with study team members at individual, site and whole study levels to discuss and address issues. Support focused on maximising the pool of eligible patients in terms of finding, assessing and approaching them by offering practical solutions, for example, sharing site-initiated ideas such as viewing and flagging potentially eligible patients from MDT lists in advance and regular contact with lung nurses to ensure patients were not missed from being assessed for eligibility. Or by raising awareness using evidence from QRI data and opening discussion of how biases and discomforts affected whether patients were considered eligible for the study and approached about it. Awareness was also raised of patients being primed towards or against treatment from colleagues prior to study consideration to indicate the value of recruiters exploring what patients had already been told about treatment options, and to promote sharing of information on MARS 2 with wider colleagues especially those encountered by the patient earlier in the pathway.

Table 2

Key QRI-informed actions with timelines in MARS 2

Support also focused on ensuring that study discussions offered full, clear and balanced information. There was a particular emphasis on issues around equipoise and good practice for conveying it. In both individual and group feedback sessions, QRI anonymised data were presented to raise awareness of how imbalances of treatment descriptions, for example, disproportionate emphasis on potential risks and benefits or language that subtly favoured or deterred a treatment, could steer patients away from the study and towards or against a particular treatment. Examples from consultation recordings were shared and discussed of more neutral ways of describing treatments and of engaging with patient treatment preferences. The recruitment tips document (online supplemental file 1) offered suggestions for structuring and discussing recruitment consultations in a way that emphasised the uncertainties around the best treatment, with specific aspects of this spotlighted in monthly newsletters using extracts of QRI data. Feedback and support were set within the recognition of site teams and continued above target achievement and encouragement to keep on track.

Supplemental material

After the COVID-19 study pause was lifted, actions focused on positive encouragement and motivation to help raise the profile of MARS 2 for the final stages of recruitment, respecting the pandemic-related pressures that sites were under and the varying capacity that they subsequently had.

Impact of QRI on optimising recruitment and informed consent

Figure 2 shows actual recruitment against target, depicting points of QRI-informed actions that were delivered at greater than an individual recruiter and single site level. Actions that were developed and delivered in response to findings from QRI phase 1 began in October 2018 (start of QRI phase 2). During QRI phase 2, there were eight QRI-informed actions delivered beyond individual and single site level, as well as monthly recruitment tips in newsletters. There were also a further 22 actions delivered at individual recruiter and site level (largely tailored feedback of screening log and/or consultation recordings) not depicted on this graph (see table 2).

Figure 2

Recruitment to MARS 2 study against recruitment target depicting points of QRI-informed actions beyond individual and single site level. MARS 2, Mesothelioma and Radical Surgery 2; QRI, QuinteT Recruitment Intervention.

The QRI was integrated throughout the main phase of MARS 2 (including set up) with several actions delivered at study-wide level, so it was difficult to evaluate the impact it had on recruitment. The timing of QRI actions in relation to the recruitment rate in figure 2 suggests that the actions may have contributed to increasing and maintaining recruitment above target prior to the pandemic. From screening log data, the average number of patients recruited per month per site was 0.27 in September 2018 (just prior to QRI phase 2 and the roll out of feedback and training), which rose to 0.65 in March 2020 (after the delivery of most of the QRI feedback and training and just before the study pause). Analysis of recruitment figures 6 months before and after recruiters received individual feedback on their study recruitment consultations suggest a dose-response effect. Numbers randomised before and after feedback were not dissimilar in the five sites where only one recruiter had received individual feedback at the time of analysis. The greatest difference was observed in the one site where feedback was given at the same time point to all three recruiters (both individually and as a group). At this site, no patients were randomised in the 17 months before feedback and six patients were randomised in the 5 months after, which represented 43% of their total recruitment over 5.5 years.

Several recruiters who received feedback on their individual recruitment discussions acknowledged the value of it, stating that it had raised awareness of certain issues and that they intended to alter their practice accordingly. An evaluation of before-after tailored feedback showed evidence of advice being implemented and improvements in terms of how the study was introduced, balancing of treatment descriptions, explanation of randomisation and avoidance of potentially problematic terminology (table 3). We also identified suggestions and strategies that were given within wider recruitment training sessions and recruitment tips/guidance documents being implemented in study recruitment discussions.

Table 3

Implementation of QRI-informed suggestions in recruitment consultations

For a very small number of sites (n=4), the recruitment challenges were elicited and discussed but were considered insurmountable. They related to a combination of political, logistical or personal factors that were beyond the scope of the QRI. This resulted in two sites closing to recruitment early, and two sites not recruiting any patients.

Discussion

This study offers important insights into the complexities of conducting research and how, with bespoke support to overcome identified issues, recruitment to a challenging RCT of surgery vs no surgery in a thoracic cancer setting is possible. The MARS 2 study had to fit within the framework of a service that was considered overstretched where patients encountered multiple healthcare specialties and treatment views along their diagnostic and treatment pathway, all of which challenged recruitment. With advances in medical therapies, the study had to compete with other research studies, draining already tight resources and reducing the pool of potential participants. Research staff had to be comfortable approaching patients about a study at a time when their survival was limited and discussing treatment that they may not have felt was appropriate for all. Specific to MARS 2 was the dependence on time-sensitive tests and investigations, and involvement of surgical specialists often at different hospitals, which further added to the complexities of conducting the research. Having identified key context and trial-specific issues, QRI-informed actions were devised and implemented to raise awareness, share good practice and offer support in a bid to safeguard informed consent and optimise recruitment. The trial achieved recruitment to target with a 4-month COVID-19 pandemic-related extension.

One of the key findings was the varying levels of individual equipoise around the surgical intervention and the impact this had on study recruitment. Despite describing treatment uncertainty within the clinical community, it was clear that not all those involved with the care of mesothelioma patients fully subscribed to this view at a personal level, or in relation to particular patients. In the absence of robust and reliable evidence for pleurectomy decortication, individual levels of equipoise were often shaped by past clinical experiences and findings from earlier trials evaluating other types of surgery for mesothelioma which did not infer survival benefits27 28 and indicated possible patient harm.28 Some appeared to struggle with referring, assessing and discussing the study with patients when it conflicted with their clinical judgement. Consequently, there were patients fulfilling the eligibility criteria who did not have the opportunity to consider participating in the study and others who did not receive the full and balanced information necessary for informed decision-making. Role conflict and challenges with setting aside personal views when determining study eligibility and conveying balance during study and treatment discussion have been identified in other RCTs set within the thoracic and broader cancer/surgical contexts and noted to adversely impact recruitment.22 23 29–34 These issues are heightened in trials comparing very different interventions.9 In such trials (including MARS 2), clinicians and patients are more likely to struggle with achieving a position of equipoise because of factors such as strong clinical specialty convictions and a priori treatment preferences which in turn may influence how information about the trial is portrayed and patients’ decision to participate.9

Introducing a randomised trial to a population of mostly older patients who have been subjected to a multitude of investigations from different clinical specialties and diagnosed with a poor-prognosis cancer can be challenging. Interviews with patients conducted in the main phase of MARS 226 concurred with findings from the pilot phase showing that participants had difficulties with the volume and complexity of study information, including understanding of equipoise and randomisation.20 Audio recordings of recruitment discussions as part of the QRI in the main trial phase offered insight into these findings, demonstrating at times biased descriptions of treatment options and unclear explanations of randomisation which would have contributed to the observed patient difficulties.

MARS 2 recruitment was further challenged by the condition under investigation being a rare cancer. The rarity of the condition makes finding and recruiting enough patients difficult. Rare disease trials tend to be smaller, longer and more prone to being terminated, withdrawn or suspended compared with those for non-rare conditions.35 Missed opportunities for referring and approaching patients, as identified in this study, become even more impactful when the pool of potentially eligible patients is limited at outset. To add to this challenge, the MARS 2 study investigated a condition that was very active in terms of research to advance medical treatment opportunities. We know from clinician interviews and screening log data that a very small number of patients being considered for MARS 2 were lost to other studies, but we do not know how many patients were lost before MARS 2 was even considered. This puts a further strain on recruiting for a trial that investigates a rare and life- limiting cancer where patients are already difficult to find and where there may be discomfort in approaching them about research at such a time. The value of employing methods to understand and address recruitment challenges in such trials, as with the QRI in this study, is heightened, as are widespread campaigns to encourage patients to proactively seek involvement in clinical studies they might be eligible for.36

A core strength of the study was the ability to analyse actual practice (audio recording of recruitment discussions), as opposed to relying on reported practice, and to triangulate findings from multiple data sources to gain an in-depth and rich understanding of the key (and often hidden emotive21 22) difficulties. This was done in a relatively short time to enable strategies to be devised and implemented to support recruiting staff while recruitment was underway. The MARS 2 study took 5 years to randomise 335 patients. This is a threefold increase in the rate of recruitment compared with the next largest surgical trial for mesothelioma—MARS—which randomised 50 patients in 3 years.28 The timing of QRI-informed actions against an increased and sustained recruitment rate is suggestive of a positive impact but we cannot rule out other factors that may have contributed to this (particularly the opening of new sites) or infer which interventions may have been more or less effective. Nor can we say if the recruitment target would have been reached without the QRI. The internal pilot phase did not integrate QRI and achieved target, although once the number of opened sites peaked recruitment started to steadily decline. Conversely, once the number of opened sites peaked in the main study phase, recruitment continued to steadily rise in time with the delivery of the QRI-informed actions. We also identified evidence of improved study information provision with clearer presentations of equipoise following individual or group-tailored consultation feedback, which is likely to have enabled better informed decision-making which may or may not translate into increased recruitment. We appreciate that over a third of the staff approached were not interviewed and we did not have audio recordings of consultation discussions from half of the sites. There may, therefore, have been further recruitment issues unique to these sites that we were unable to elucidate and address. Furthermore, we experienced difficulties in requesting to meet several recruiters to share individual consultation feedback, resulting in a written report often being sent with no confirmation it was read. Future research should focus on distilling the active components of complex recruitment interventions, defining how such interventions should be deemed successful (eg, increase in rate of recruitment or a measure of informed consent) and determining the best methods to evaluate their effectiveness.

One of the key findings from the QRI in MARS 2 was the impact that the wider clinical and research context had on views of the study and recruitment to it. Surgery for mesothelioma is controversial.37 Findings from previous trials—showing other types of surgery for mesothelioma as not being beneficial with potential for harm27 28—contributed to the views held by some clinicians within and outside of the study on the appropriateness of surgery, and therefore, appropriateness of the study. Moreover, the study was set within a clinical context for a rare, life-limiting condition that had a convoluted pathway involving cross-specialty personnel and exposure to varying views on treatment. With promising new treatments on the horizon, the study also had to compete with other research studies within a resource-stretched service. Based on these findings, we recommend understanding the wider context of research at an early stage, both in terms of the clinical setting, pathway and prior research, and the potential impact that this could have on the success of a trial. Pretrial or early trial meetings and training workshops with site staff to detail current evidence and trial rationale, ascertain usual practice and engage with treatment views could help illuminate and mitigate potential difficulties at outset. Continued exploration along with recruiter feedback and training as recruitment is underway has the potential to help address ongoing discomforts. We also recommend engaging health professionals upstream of the study recruitment discussions in such activities, recognising the impact they can have on numbers of patients put forward for study consideration and patient treatment expectations.38 39 Outside of a specific trial, broad RCT recruitment training raising awareness of common hidden challenges and strategies to overcome can offer additional opportunities to improve recruitment in future RCTs where recruitment is deemed to be challenging.24 40

Conclusions

A complex multimethod intervention to optimise recruitment revealed important insights into the challenges of conducting a surgical randomised trial within the thoracic cancer setting. Recruitment occurred in what was considered a resource strapped, research competitive and logistically complicated clinical context. The QRI provided important insights into how clinician treatment biases, which were shaped by the wider clinical and research context alongside experience, had a noticeable adverse impact on multiple aspects of the recruitment process prior to and during study participation discussions. We were able to raise awareness of identified issues and support clinicians through feedback and training to overcome challenges for effective recruitment and informed decision-making. Recruitment to an RCT with very different treatment options set within a complex recruitment pathway with multiple health professional involvement is possible with bespoke training and support to address key equipoise issues.

Data availability statement

Data are available on reasonable request. Data, in terms of deidentified consultation and interview transcripts, are available from the corresponding author on reasonable request. This is on the condition that the request fulfils the necessary approvals in place for 'controlled access' data, that participants have agreed to the optional consent to share their anonymised data, and that participant anonymity or privacy is considered not to be compromised.

Ethics statements

Patient consent for publication

Ethics approval

This study involves human participants and research ethics approval for the MARS2 study which included the integrated QRI was granted by London—Camberwell St. Giles Research Ethics Committee (reference 13/LO/1481) on 7 November 2013. Participants gave informed consent to participate in the study before taking part.

Acknowledgments

The MARS 2 study is sponsored by The Royal Brompton and Harefield NHS Foundation Trust. We would like to thank the clinical/research teams and patients at each hospital for their support with the QRI component of MARS 2. We would also like to thank Professor Jenny Donovan for comments on an earlier draft of the manuscript.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • X @NicolaMillsPhD2, @daisy__elliott

  • Contributors NM, NF and DE are members of the University of Bristol QuinteT (Qualitative research integrated within Trials) research group and formed the QRI team within MARS 2. NM and DE led the design and conduct of the QRI. NF led the patient interview aspect of the QRI as part of her doctoral research. NM conducted the QRI, including data acquisition, analysis and interpretation, in discussion with DE and NF and drafted the manuscript. EL is the chief investigator for MARS 2, KEA and BW are the former/present trial managers, RH is the statistician and CAR is the methodological lead. All authors contributed to the design of MARS 2, including the QRI component, and drafting of manuscript for intellectual input. NM is the guarantor for the QRI research within the MARS 2 RCT,

  • Funding The MARS 2 study, with integrated QRI in the main study phase, was funded by the National Institute for Health and Care Research (NIHR) Health Techonology Assessment (HTA) programme (project number 15/188/31). The main phase of the MARS 2 study was designed and delivered in collaboration with the former Bristol Trials Centre Clinical Trials and Evaluation Unit (CTEU) (now the Bristol Trials Centre—BTC), a UK Clinical Research Collaboration (UKCRC) registered clinical trials unit which was in receipt of NIHR Clinical Trials Unit (CTU) support funding. DE was supported by the NIHR Bristol Biomedical Research Centre part way through. NF’s PhD was funded by the Medical Research Council (MRC) Network of Hubs for Trials Methodology Research (HTMR) (MR/L004933/2/R9).

  • Disclaimer The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. The funder and sponsor had no direct involvement in study design; collection, management, analysis and interpretation of data; writing of the report; and the decision to submit this report for publication.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.