Skip to main content

Main menu

  • HOME
  • LATEST ARTICLES
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • RESOURCES
    • About BJGP Open
    • BJGP Open Accessibility Statement
    • Editorial Board
    • Editorial Fellowships
    • Audio Abstracts
    • eLetters
    • Alerts
    • BJGP Life
    • Research into Publication Science
    • Advertising
    • Contact
  • SPECIAL ISSUES
    • Artificial Intelligence in Primary Care: call for articles
    • Social Care Integration with Primary Care: call for articles
    • Special issue: Telehealth
    • Special issue: Race and Racism in Primary Care
    • Special issue: COVID-19 and Primary Care
    • Past research calls
    • Top 10 Research Articles of the Year
  • BJGP CONFERENCE →
  • RCGP
    • British Journal of General Practice
    • BJGP for RCGP members
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers

User menu

  • Alerts

Search

  • Advanced search
Intended for Healthcare Professionals
BJGP Open
  • RCGP
    • British Journal of General Practice
    • BJGP for RCGP members
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers
  • Subscriptions
  • Alerts
  • Log in
  • Follow BJGP Open on Instagram
  • Visit bjgp open on Bluesky
  • Blog
Intended for Healthcare Professionals
BJGP Open

Advanced Search

  • HOME
  • LATEST ARTICLES
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • RESOURCES
    • About BJGP Open
    • BJGP Open Accessibility Statement
    • Editorial Board
    • Editorial Fellowships
    • Audio Abstracts
    • eLetters
    • Alerts
    • BJGP Life
    • Research into Publication Science
    • Advertising
    • Contact
  • SPECIAL ISSUES
    • Artificial Intelligence in Primary Care: call for articles
    • Social Care Integration with Primary Care: call for articles
    • Special issue: Telehealth
    • Special issue: Race and Racism in Primary Care
    • Special issue: COVID-19 and Primary Care
    • Past research calls
    • Top 10 Research Articles of the Year
  • BJGP CONFERENCE →
Research

Discontinuation of a randomised controlled trial in general practice due to unsuccessful patient recruitment

Wendelien H van der Gaag, Roxanne van den Berg, Bart W Koes, Arthur M Bohnen, Lonny MG Hazen, Wilco C Peul, Leen Voogt, Arianne P Verhagen, Sita MA Bierma-Zeinstra and Pim AJ Luijsterburg
BJGP Open 2017; 1 (3): bjgpopen17X101085. DOI: https://doi.org/10.3399/bjgpopen17X101085
Wendelien H van der Gaag
1 GP trainee and PhD student, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: w.vandergaag@erasmusmc.nl
Roxanne van den Berg
2 GP trainee and PhD student, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bart W Koes
3 Professor of General Practice, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Arthur M Bohnen
4 GP, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lonny MG Hazen
5 GP, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wilco C Peul
6 Professor of Neurosurgery, Department of Neurosurgery, Leiden University Medical Center, , The Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leen Voogt
7 Patient and Board Member of 'De Wervelkolom', Dutch Association for Back Pain Patients, , The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Arianne P Verhagen
8 Associate Professor, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sita MA Bierma-Zeinstra
9 Professor of Osteoarthritis and Related Disorders, Departments of General Practice and Orthopedics, Erasmus MC, University Medical Center, , The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pim AJ Luijsterburg
10 Assistant Professor, Department of General Practice, Erasmus MC, University Medical Center, , The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF
Loading

Abstract

Background A randomised controlled trial (RCT) in general practice, recruiting incident patients with (sub)acute sciatica, was discontinued because of insufficient recruitment.

Aim To describe factors that influenced the recruitment process and ultimately led to discontinuation of this trial, and to enable others to learn from this experience.

Design & setting A pragmatic RCT was designed to compare two pain medication prescription strategies for treatment of (sub)acute sciatica in general practice. After 1 year of patient recruitment, the trial was prematurely terminated.

Method To analyse the underperforming recruitment, patient information systems of 20 general practices were screened twice a month to search for eligible patients and identify reasons for non-eligibility. Secondly, after study termination, an open question was distributed to the participating GPs for their views on the recruitment process.

Results A total of 116 GPs from 37 general practices collaborated in the trial. Only eight of 234 patients were included after 12 months. The 22 GPs who offered their opinion on the main reasons for unsuccessful recruitment considered that these were the low incidence rate and strict eligibility criteria, a strong patient and/or GP preference, and time constraints.

Conclusion For this RCT, multiple factors were related to recruitment problems but it remains unknown which determinants prevailed. As the research question is unanswered but remains relevant, it is recommended that GPs’ daily practice is taken into account when designing an RCT, a pilot study should be performed for feasibility of recruitment, and GP assistants should be involved at an early stage.

  • primary health care
  • general practice
  • randomized controlled trial
  • patient recruitment
  • early termination of clinical trials
  • study design

How this fits in

Research in the field of general practice is essential to expand evidence for guidelines in the diagnosis and treatment of diseases within primary care. However, in practice, study protocols are not always congruent with the reality in general practice. This article describes the rationale behind a randomised controlled trial that was prematurely discontinued due to insufficient patient recruitment. The following recommendations for future research are to design convenient protocols that facilitate referral to research as a routine task for GPs, with the least possible interference with daily regular practice, to perform a pilot study, and to outsource eligibility screening to trained GP assistants or dedicated research nurses.

Introduction

General practice has changed rapidly in recent decades. Ageing populations and increasing care for patients with chronic diseases and (complex) multimorbidity demand expanding service profiles.1 These changing health needs have shaped the developments in general practice in the Netherlands and elsewhere. For example, both patient list size per GP and the average patient contact rate with the general practice have increased.2–4 Dutch GPs spend (on average) more time on non-patient bound activities (such as administration, management, and continuing vocational training) than their European counterparts.1,5 Task delegation to practice assistants or nurses is inevitable and has become regular practice. The question then arises whether conducting clinical research is more difficult in today’s general practices, due to changes in priority setting; that is, changes that might now be inevitable to keep the workload manageable.

For evidence-based decision making in general practice, clinical research is essential and most GPs are aware of this.6,7 Researchers, on the other hand, have to translate their research questions and ideas into concrete trial designs that are feasible in general practice. The design needs methodological soundness and adequate power to answer the research questions.8,9 A complicating factor is that the protocol must have minor interference with daily practice to be feasible.10 Thus, a delicate balance is required between patients and GPs’ needs, and research aims that will ultimately benefit the patient.

The authors developed and received funding for a pragmatic design of an RCT on sciatica, the most prevalent specific type of low back disorders seen by GPs. Current treatment of sciatica in general practice aims to enable patients to stay active and return to daily activities as soon as possible.11 Therefore, pain relief through adequate analgesic(s) prescription is an important condition; however, the best approach for prescription of pain medication in sciatica remains unclear.12 This RCT, the STEP-UP trial, aimed to assess the clinical and cost-effectiveness of immediate opioid pain medication (followed by step-down) versus stepped-up pain medication according to the current clinical GP guidelines, in patients with (sub)acute sciatica in general practice over a period of 12 weeks.13

During 12 months of recruiting in general practices, 23 patients were assessed for eligibility by the research team, of which only eight (3.4% of the target 234 patients) could be included in the trial. Because the inclusion rate was too slow to recruit a sufficient number of patients in the remaining time available, the study was prematurely terminated after 1 year.

The aim of this study was to describe determinants in the recruitment process that ultimately led to discontinuation of this trial.

Method

Trial design and setting

The STEP-UP trial was a pragmatic, multicentre, open-label, superiority RCT with a parallel group design, in general practices, with a 3-month follow-up, as shown in Box 1 and Figure 1. 13 Patients consulting their GP with (sub)acute sciatica were randomly allocated to receive stepped-up medication (step 1: paracetamol; step 2: non-steroidal anti-inflammatory drug [NSAID]; step 3: tramadol; step 4: morphine) or receive immediate morphine; followed by a taper period (step-down).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1. Flow diagram of the STEP-UP trial (pragmatic design RCT).
View this table:
  • View inline
  • View popup
Box 1. STEP-UP trial design

Selection and recruitment of GP practices

It was calculated that the cooperation of at least 91 GPs was needed to recruit 234 patients with (sub)acute sciatica within 21 months.14 GP practices were identified in the southwestern area of the Netherlands — selected by zip code — and recruited by mail, followed by a phone call to make an appointment (practice visit or by phone with the choice up to GP) to explain more about the trial. The search area was expanded every month until the numbers were reached; and GP recruitment was continued when it was discovered that patient recruitment from the 91 GPs was behind schedule. A monthly newsletter was sent to update the GPs about the trial, and on request an e-mail reminder was sent every 2 weeks, containing information on eligibility criteria, how to invite patients to join and the consent procedure. Furthermore most general practices were visited regularly to remind GPs and practice nurses about the trial.

Patient recruitment process

Patients were identified in two ways:

  1. during GP consultations (1 April 201–30 March 2016), and

  2. screening of GP information systems (29 September 2015–4 January 2016).

During the consultations

The GP performed physical examination, briefly informed eligible patients about the trial, invited them to participate and then notified the research team. The researcher contacted the patient to further assess eligibility, explain the informed consent procedure, and elaborate on any questions. Patients could consider participation in the study for as long as they wished, unless they were not using stronger medication than NSAIDs. After enrolment and randomisation by the research team, both patients and GPs were informed promptly by phone: the GP prescribed medication accordingly and patients could collect the medication the same day. Using this strategy, by September 2015 (after 6 months of recruiting) only one patient was included in the trial.

Screening of GP information systems

The GP information systems of 20 of the participating general practices (a total of 72 GPs) were screened systematically every 2 weeks during 3.5 months for patients that visited the general practice with International Classification of Primary Care (ICPC) code L86 (sciatica). The GP practices decided for themselves if they would participate in this screening option. If so, every 2 weeks they could assess the patients on the list for eligibility and send letters to invite them for study participation. After a week a reminder letter was sent. Both letters contained the patient information form, a response form, and a stamped return envelope. If patients returned the response form, they were called by the research team to further inform them about the trial, re-assess eligibility and for the informed consent procedure. After enrolment and randomisation by the research team, both patients and GPs were informed promptly by phone: the GP prescribed medication accordingly and patients could collect the medication the same day.

Delayed inclusion and discontinuation of the study

When inclusion was clearly delayed, the problems were discussed during a GP network meeting in September 2015, with about 11 representatives of the participating general practices. Ten GPs were interviewed at their workplace and a research team meeting was scheduled to discuss the main reasons for delay and possible steps to be taken. A STEP-UP month was organised, where all participating GPs and practice nurses were visited to motivate them, strengthen their involvement, and enhance recruitment. A weekly newsletter was sent out to activate GPs and there was a voucher reward for every new patient admitted by a general practice.

Nevertheless, the study was terminated as the measures taken showed insufficient effect. After discontinuation (30 March 2016), each participating GP was sent a written survey, asking: Why do you think we were unable to include a sufficient number of patients in the STEP-UP trial?

Results

GP recruitment

GP recruitment started in January 2015 and patient recruitment in April 2015 with the cooperation of eight general practices and 36 GPs. The research question was considered relevant by the GPs that wanted to participate. For the negative responders, the main reasons for declining participation were lack of time, participation in other trials, or lack of interest in the topic. When patient recruitment was discontinued in March 2016, more than 450 general practices and GPs had been invited to join the trial; of these, 37 general practices with 116 GPs were participating in the study.

Patient recruitment

Figure 2 shows the results of the systematic screening of the GP information systems in 20 general practices. Of the 582 patients screened during the 3.5-month time frame, 71 (12%) were potentially eligible. GPs sent invitations to 41 of these patients (58%) of whom 10 (24%) returned the registration form. Finally, of these, two patients were included and eight were either excluded or declined to participate.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2. Systematic screening of GP information systems during a 3.5-month period. LRS = lumbosacral radicular syndrome.

Reasons for insufficient recruitment

Following the project group meetings and interviews with GPs, factors that could have contributed to the low inclusion were identified.

  1. Strict eligibility criteria: based on data from an earlier completed RCT (135 patients with [sub]acute sciatica recruited from 61 GPs over 18 months; May 2003–November 2004),14 an estimation was made of the number of GPs needed to recruit 234 patients within 21 months. However, for the present trial the earlier inclusion/exclusion criteria were adapted (that is, they were stricter). For example, in this study, a pain score (visual analogue scale) of ≥7 instead of ≥4 was required to participate, and criteria to prevent adverse events or abuse were added because this study involved NSAIDs and morphine. The effect of these adaptations on recruitment was greater than expected. In retrospect, a more conservative estimation of the speed of recruitment was needed.

  2. Incident case study: the trial was designed to enrol patients consulting their GP with (sub)acute sciatica. Inclusion estimates were based on the incidence of sciatica in the Netherlands, which is estimated at 5 per 1000 persons/year in general practice.15 In addition, the incidence (all ages) of ICPC code L86 (sciatica) in general practice was 15.2 per 1000 patients/year in 2014, according to the NIVEL Primary Care Database.16 However, in fact, due to the restrictive eligibility criteria, only 12% of the patients with ICPC code L86 were eligible for participation, which results in approximately four eligible patients/year per full-time GP.

Of the 116 GPs, 22 (19%) responded to the written survey (that is one question about the reasons for recruitment failure) sent to each GP after discontinuation of the study. Their answers are presented in Box 2: 11 (50%) mentioned a strong patient preference and/or GP preference for either the step-up or step-down approach; six GPs (27%) mentioned the low incidence rate; and six (27%) the strict eligibility criteria. Other constraints included time and priority constraints, forgetfulness, and prevention of (further) treatment delay for their patients. A summary of reasons is shown in Table 1.

View this table:
  • View inline
  • View popup
Table 1. Summary of responses of 22/116 (19%) GPs
View this table:
  • View inline
  • View popup
Box 2. Responses of 22/116 (19%) GPs suggested reasons for insufficient recruitment

In (unstructured) interviews GPs mentioned a few trends in general practice that also may have influenced the course of this trial:

  1. Changes in patient populations and prescription habits: epidemiological research shows a tendency of increased production and utilisation of prescription opioid analgesics for the treatment of non-cancer pain in industrialised countries; this might also apply to our targeted study population.17–21 Furthermore, with increasing comorbidity and an ageing population, the use of NSAIDs and/or tramadol is contraindicated more often, which could accelerate the process from step 1 to 4, by skipping steps 2/3.

  2. Process of shared decision making and patient-centred care: the decision-making process in modern general practice has become more patient-centred. The doctor–patient relationship is increasingly based on shared decision making, with respect for patients’ autonomy, instead of paternalism. The chosen approach largely depends on patient characteristics and their preference and expectations;22,23 for example, for pain medication, personal preferences can be strong. Some GPs mentioned that patients prefer drugs other than morphine, because morphine is considered to be too strong (for example, for fear of adverse events, or wanting to keep driving). Other patients, in contrast, request stronger pain medication and/or diagnostics. Thus, their GPs already have to negotiate to prevent unnecessary diagnostics. Consequently, patients on both sides of the spectrum did not want to be randomised.

  3. Priority setting: the changes in both healthcare system and healthcare include societal developments, the transition of several disease treatments and general psychological care from secondary to primary care, decentralisation of youth and elderly care, implementation of new laws, and organising safe digital working systems; GPs spend a considerable amount of time on managing these processes. This may have (indirectly) influenced the present research process; both the willingness and/or time available to participate in research may decrease subsequently.

Discussion

Summary

This study described the rationale behind a prematurely discontinued RCT and identified several barriers that could have contributed to the low inclusion rate. The main study-related factors were the strict eligibility criteria and the trial design, aiming to enrol incident cases with an acute condition. The main external factors were societal developments and changes in patient populations, prescription habits, and the doctor–patient relationship. Research is needed to expand evidence for guidelines in the diagnosis and treatment of diseases within primary care. This article describes a trial that was not successful, to enable other researchers and GPs to learn from this experience. 

Strengths and limitations

This study's main limitation was that the protocol seemed too complex to fit well into the daily clinic, for example resulting in a problem for patients with an acute need for pain medication due to the informed consent procedure. It was not possible to determine further strengths and limitations as the trial was prematurely discontinued.

Comparison with existing literature

This experience is not new: achieving sufficient patient recruitment in clinical trials in general practice is an ongoing problem.24–26 Many prospective studies depend on GPs to recruit patients. However, for various understandable reasons, there is a discrepancy between the number of GPs that agree to participate and the number that actually recruit patients, even though they thought it was feasible in practice.27,28 This is why training of clinical staff — such as GPs, GP assistants, research nurses — is vital to improve patient recruitment, as mentioned by Donovan et al.29,30 Their research shows increases in trial participants after staff training programmes and individual tailored feedback and support. Bower et al suggests to increase public and professional engagement with research to improve participation by both clinicians and patients.31

Literature research in this field suggests that, in general, the recruitment rate (even in successful trials) is lower than anticipated.32 Apparently researchers are often too optimistic about the number of eligible patients, and the GPs’ time and ability to recruit patients.33 According to Lasagna’s Law, they overestimate the incidence of patient availability.24 This addresses the difficulty of predicting numbers by researchers, especially in studies with complex eligibility criteria and in studies that require incident cases of acute conditions.34 For future research, a pilot study should be performed (if financially feasible) in which the inclusion/exclusion criteria are tested before going full scale.24,35 Alternatively, as suggested by Haidich et al, patient enrolment patterns during the first 2 months can be analysed and will often predict the eventual ability of a trial to attain its target sample size.36

Some determinants are associated with a higher risk of recruitment failure; for example, restrictive eligibility criteria which is often a result of the difficult balance between diminishing risks for individual patients and maintaining the generalisability of trial results, and studies interfering with the GP’s decision-making process; that is, when recruiting patients has a direct impact on usual care after the randomisation process.33 A systematic review highlights the same main barriers for clinicians and patients experienced in the current study, including time constraints, potential impact on the doctor–patient relationship, concern for the patient, loss of professional autonomy, patient preferences, and/or difficulty with the consent procedure.37 Treweek et al suggests that a financial incentive for patients could have been a promising strategy to increase patient recruitment, next to an open trial design and the telephone reminders already used in this trial.38 The PRECIS wheel is a tool developed by Thorpe et al that can be used by researchers to help them designing a trial that is consistent with their purpose.39 Reflecting on this, because of the nature of the disease (sciatica) and the strength of the medication this trial was testing (morphine), the in- and exclusion criteria of the current trial were rather narrow, while the trial design itself was pragmatic. Comorbidities that were sometimes common, where reasons for exclusion in this trial. From that perspective, this trial appeared to be less pragmatic than orginally aimed for.

Implications for research and practice

From the GPs’ viewpoint there was a contradiction between practising research or practicing medicine in the consultation room. As researchers, we should aim to close this gap by designing simple and convenient protocols that facilitate participation in research during busy consultation schedules. Training and support should be offered when needed.40 If possible, researchers should prevent too much interference in regular practice and create a format that fits in the daily routine tasks of GPs. Referring a patient to research should be as easy as referring someone to a specialist or paramedical discipline: preferably, one ‘click’ away, no paperwork involved, and using existing digital referral systems.

The introduction of practice nurses for both somatic and psychological care paved the way for task delegation in chronic care and psychosocial support. Regarding evidence-based medicine in primary care, it is worthwhile to investigate the possibilities of involving research nurses in general practice to make research a part of daily practice. However, the applicability of dedicated research nurses in general practice might be limited, both for logistic reasons (wide variation in staffing models worldwide), financial (who pays) and practical reasons (for example, access to patient information might be limited for research nurses because of privacy laws). Aiming for more involvement of GP assistants in the recruitment process is a more pragmatic and achievable solution. Compensation for the practice for the additional time and expenses related to the research in that case will be a point of discussion. Another possibility is to combine care and research into an integrated service/research clinic, as is more often seen in the UK.31,41,42

In summary, several recommendations can be made in the aim to try and avoid/prevent recruitment problems:

  • if financially possible, perform a pilot study to investigate the feasibility of recruitment and examine potential threats before going full scale; and 

  • use of dedicated research staff in larger general practices, or involving trained GP assistants in an early stage of the research in smaller practices, might be an effective way to support GPs to outsource eligibility screening and study entry.

For future research, recommended topics are:

  • to address important research questions with clear clinical relevance and of daily interest for GPs and their patients.31 The protocol and data collection should be straightforward, to have the least disruptive impact on regular care and doctor–patient interaction;43 and

  •  to have no or restricted impact on usual care delivery during consultations and only register how care is delivered, to minimise the demands made on GPs and their patients.

To conclude, although multiple factors played a role in the unsuccessful recruitment for this trial, it remains unknown which of the determinants played the most important role.

Notes

Funding

This study was funded by the Netherlands Organization for Health Research and Development (reference 80-83600-98-20013) and a programme grant from the Dutch Arthritis Foundation.

Ethical approval

The study protocol was approved by the Medical Ethical Committee of Erasmus MC (NL49507.078.14). The trial is registered at the Dutch Trial Registry (NTR5120, 26 March 2015. Protocol version: 3 January, 2015).

Trial registration

Dutch Trial Registry, Trials NTR5120.

Acknowledgements

The authors thank the participating patients and GPs for their cooperation; and Dr MA Koopmanschap, Department of Health Policy and Management/iMTA, for his contribution during the drafting of the research protocol.

Provenance

Freely submitted; externally peer reviewed.

Competing interests

The authors declare that no competing interests exist.

  • Received December 23, 2016.
  • Accepted March 27, 2017.
  • Copyright © The Authors 2017

This article is Open Access: CC BY license (https://creativecommons.org/licenses/by/4.0/)

References

  1. 1.↵
    1. Schäfer WL,
    2. Boerma WG,
    3. Spreeuwenberg P,
    4. et al.
    (2016) Two decades of change in European general practice service profiles: conditions associated with the developments in 28 countries between 1993 and 2012. Scand J Prim Health Care 34(1):97–110, doi:10.3109/02813432.2015.1132887.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Groenewegen PP,
    2. Hutten JB,
    3. van der Velden K
    (1992) List size, composition of practice and general practitioners' workload in The Netherlands. Soc Sci Med 34(3):263–270, doi:10.1016/0277-9536(92)90268-U.
    OpenUrlCrossRefPubMed
  3. 3.
    1. Westert GP J L,
    2. Schellevis FG
    1. van den Berg MKE,
    2. De Bakker D,
    3. Van der Zee J
    (2006) in Morbidity, performance and quality in primary care. Dutch general practice on stage, eds Westert GP J L, Schellevis FG (Radcliffe Publishing, Oxford) eds. The workload of general practitioners in the Netherlands: 1987 and 2001.
  4. 4.
    1. Schäfer WGP,
    2. van den Berg M
    (2016) The workload of general practitioners; the Netherlands in an international perspective. [In Dutch] (NIVEL, Utrecht).
  5. 5.↵
    (2016) Schäfer WLA vdBM, Groenewegen PP. The workload of GPs in international perspective. [In Dutch]. Huisarts en Wetenschap 59(3):94–101.
    OpenUrl
  6. 6.↵
    1. Brænd AM,
    2. Jensen KB,
    3. Klovning A,
    4. et al.
    (2013) Clinical drug trials in general practice: a 10-year overview of protocols. Trials 14:162–162, doi:10.1186/1745-6215-14-162.
    OpenUrlCrossRef
  7. 7.↵
    1. Hummers-Pradier E,
    2. Bleidorn J,
    3. Schmiemann G,
    4. et al.
    (2012) General practice-based clinical trials in Germany — a problem analysis. Trials 13:205–205, doi:10.1186/1745-6215-13-205.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Fransen GA,
    2. van Marrewijk CJ,
    3. Mujakovic S,
    4. et al.
    (2007) Pragmatic trials in primary care. Methodological challenges and solutions demonstrated by the DIAMOND-study. BMC Med Res Methodol 7(1):1–11, doi:10.1186/1471-2288-7-16.
    OpenUrlCrossRefPubMed
  9. 9.↵
    1. Sully BG,
    2. Julious SA,
    3. Nicholl J
    (2013) A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials 14:14, doi:10.1186/1745-6215-14-166.
    OpenUrlCrossRef
  10. 10.↵
    1. Gágyor I,
    2. Bleidorn J,
    3. Wegscheider K,
    4. et al.
    (2011) Practices, patients and (im)perfect data--feasibility of a randomised controlled clinical drug trial in German general practices. Trials 12:91–91, doi:10.1186/1745-6215-12-91.
    OpenUrlCrossRefPubMed
  11. 11.↵
    1. Schaafstra ASW,
    2. Bons SCS,
    3. Borg M,
    4. et al.
    (2015) Dutch College of General Practitioners’ guideline: lumbosacral radicular syndrome [In Dutch]. Huisarts en Wetenschap 58(6):308–320.
    OpenUrl
  12. 12.↵
    1. Pinto RZ,
    2. Maher CG,
    3. Ferreira ML,
    4. et al.
    (2012) Drugs for relief of pain in patients with sciatica: systematic review and meta-analysis. BMJ 344:e497, doi:10.1136/bmj.e497.
    OpenUrlAbstract/FREE Full Text
  13. 13.↵
    1. Register DT
    Step-down versus step-up analgesics in patients with (sub)acute sciatica in primary care (NTR5120). http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=5120. accessed 11 Jul 2017 .
  14. 14.↵
    1. Luijsterburg PA,
    2. Verhagen AP,
    3. Ostelo RW,
    4. et al.
    (2008) Physical therapy plus general practitioners' care versus general practitioners' care alone for sciatica: a randomised clinical trial with a 12-month follow-up. Eur Spine J 17(4):509–517, doi:10.1007/s00586-007-0569-6.
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Health Council of the Netherlands
    (2000) Reports 1999. A2000/01. . https://www.gezondheidsraad.nl/sites/default/files/A0001E.pdf. accessed 27 Jul 2017 .
  16. 16.↵
    1. NIVEL Primary Care Database
    Incidence and prevalence numbers in general practice. https://www.nivel.nl/nl/NZR/incidenties-en-prevalenties. accessed 28 Jul 2017 .
  17. 17.↵
    1. International Narcotics Control Board
    (2013) Narcotic Drugs Technical Report: estimated world requirements for 2013 — statistics for 2011 (United Nations, New York, NY).
  18. 18.
    1. Fischer B,
    2. Jones W,
    3. Rehm J
    (2014) Trends and changes in prescription opioid analgesic dispensing in Canada 2005-2012: an update with a focus on recent interventions. BMC Health Serv Res 14:90, doi:10.1186/1472-6963-14-90.
    OpenUrlCrossRefPubMed
  19. 19.
    1. Manchikanti L,
    2. Helm S,
    3. Fellows B,
    4. et al.
    (2012) Opioid epidemic in the United States. Pain Physician 15(3 Suppl )ES9-38.
    OpenUrlPubMed
  20. 20.
    1. Smolina K,
    2. Gladstone E,
    3. Morgan SG
    (2016) Determinants of trends in prescription opioid use in British Columbia, Canada, 2005-2013. Pharmacoepidemiol Drug Saf 25(5):553–559, doi:10.1002/pds.3989.
    OpenUrlCrossRef
  21. 21.↵
    1. Karanges EA,
    2. Blanch B,
    3. Buckley NA,
    4. et al.
    (2016) Twenty-five years of prescription opioid use in Australia: a whole-of-population analysis using pharmaceutical claims. Br J Clin Pharmacol 82(1):255–267, doi:10.1111/bcp.12937.
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Berger JT
    (2011) Redefining the domains of decision making by physician and patient. Int J Clin Pract 65(8):828–830, doi:10.1111/j.1742-1241.2011.02708.x.
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Barry MJ,
    2. Edgman-Levitan S
    (2012) Shared decision making--pinnacle of patient-centered care. N Engl J Med 366(9):780–781, doi:10.1056/NEJMp1109283.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. van der Wouden JC,
    2. Blankenstein AH,
    3. Huibers MJ,
    4. et al.
    (2007) Survey among 78 studies showed that Lasagna's law holds in Dutch primary care research. J Clin Epidemiol 60(8):819–824, doi:10.1016/j.jclinepi.2006.11.010.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. van der Windt DA,
    2. Koes BW,
    3. van Aarst M,
    4. et al.
    (2000) Practical aspects of conducting a pragmatic randomised trial in primary care: patient recruitment and outcome assessment. Br J Gen Pract 50(454):371–374.
    OpenUrlAbstract/FREE Full Text
  26. 26.↵
    1. Montfoort I,
    2. Frens MA,
    3. Koes BW,
    4. et al.
    (2008) Tragedy of conducting a clinical trial; generic alert system needed. J Clin Epidemiol 61(5):415–418, doi:10.1016/j.jclinepi.2007.06.004.
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Tognoni G,
    2. Alli C,
    3. Avanzini F,
    4. et al.
    (1991) Randomised clinical trials in general practice: lessons from a failure. BMJ 303(6808):969–971, doi:10.1136/bmj.303.6808.969.
    OpenUrlFREE Full Text
  28. 28.↵
    1. Peto V,
    2. Coulter A,
    3. Bond A
    (1993) Factors affecting general practitioners' recruitment of patients into a prospective study. Fam Pract 10(2):207–211, doi:10.1093/fampra/10.2.207.
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. Donovan JL,
    2. Lane JA,
    3. Peters TJ,
    4. et al.
    (2009) Development of a complex intervention improved randomization and informed consent in a randomized controlled trial. J Clin Epidemiol 62(1):29–36, doi:10.1016/j.jclinepi.2008.02.010.
    OpenUrlCrossRefPubMed
  30. 30.↵
    1. Donovan JL,
    2. de Salis I,
    3. Toerien M,
    4. et al.
    (2014) The intellectual challenges and emotional consequences of equipoise contributed to the fragility of recruitment in six randomized controlled trials. J Clin Epidemiol 67(8):912–920, doi:10.1016/j.jclinepi.2014.03.010.
    OpenUrlCrossRefPubMed
  31. 31.↵
    1. Bower P,
    2. Wallace P,
    3. Ward E,
    4. et al.
    (2009) Improving recruitment to health research in primary care. Fam Pract 26(5):391–397, doi:10.1093/fampra/cmp037.
    OpenUrlCrossRefPubMed
  32. 32.↵
    1. Bower P,
    2. Wilson S,
    3. Mathers N
    (2007) Short report: how often do UK primary care trials face recruitment delays? Family Practice 24(6):601–603, doi:10.1093/fampra/cmm051.
    OpenUrlCrossRefPubMed
  33. 33.↵
    1. Foy R,
    2. Parry J,
    3. Duggan A,
    4. et al.
    (2003) How evidence based are recruitment strategies to randomized controlled trials in primary care? Experience from seven studies. Fam Pract 20(1):83–92, doi:10.1093/fampra/20.1.83.
    OpenUrlCrossRefPubMed
  34. 34.↵
    1. White D,
    2. Hind D
    (2015) Projection of participant recruitment to primary care research: a qualitative study. Trials 16:473, doi:10.1186/s13063-015-1002-9.
    OpenUrlCrossRef
  35. 35.↵
    1. Stein MA,
    2. Shaffer M,
    3. Echo-Hawk A,
    4. et al.
    (2015) Research START: a multimethod study of barriers and accelerators of recruiting research participants. Clin Transl Sci 8(6):647–654, doi:10.1111/cts.12351.
    OpenUrlCrossRef
  36. 36.↵
    1. Haidich AB,
    2. Ioannidis JP
    (2001) Patterns of patient enrollment in randomized controlled trials. J Clin Epidemiol 54(9):877–883, doi:10.1016/S0895-4356(01)00353-5.
    OpenUrlCrossRefPubMed
  37. 37.↵
    1. Ross S,
    2. Grant A,
    3. Counsell C,
    4. et al.
    (1999) Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol 52(12):1143–1156.
    OpenUrlCrossRefPubMed
  38. 38.↵
    1. Treweek S,
    2. Lockhart P,
    3. Pitkethly M,
    4. et al.
    (2013) Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis. BMJ Open 3(2):e002360, doi:10.1136/bmjopen-2012-002360.
    OpenUrlAbstract/FREE Full Text
  39. 39.↵
    1. Thorpe KE,
    2. Zwarenstein M,
    3. Oxman AD,
    4. et al.
    (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol 62(5):464–475, doi:10.1016/j.jclinepi.2008.12.011.
    OpenUrlCrossRefPubMed
  40. 40.↵
    1. Donovan JL,
    2. Paramasivan S,
    3. de Salis I,
    4. et al.
    (2014) Clear obstacles and hidden challenges: understanding recruiter perspectives in six pragmatic randomised controlled trials. Trials 15:5–5, doi:10.1186/1745-6215-15-5.
    OpenUrlCrossRefPubMed
  41. 41.↵
    1. Konstantinou K,
    2. Beardmore R,
    3. Dunn KM,
    4. et al.
    (2012) Clinical course, characteristics and prognostic indicators in patients presenting with back and leg pain in primary care. The ATLAS study protocol. BMC Musculoskelet Disord 13:4–4, doi:10.1186/1471-2474-13-4.
    OpenUrlCrossRefPubMed
  42. 42.↵
    1. Shaw S,
    2. Macfarlane F,
    3. Greaves C,
    4. et al.
    (2004) Developing research management and governance capacity in primary care organizations: transferable learning from a qualitative evaluation of UK pilot sites. Fam Pract 21(1):92–98, doi:10.1093/fampra/cmh120.
    OpenUrlCrossRefPubMed
  43. 43.↵
    1. Pringle M,
    2. Churchill R
    (1995) Randomised controlled trials in general practice. BMJ 311(7017):1382–1383, doi:10.1136/bmj.311.7017.1382.
    OpenUrlFREE Full Text
Back to top
Previous ArticleNext Article

In this issue

BJGP Open
Vol. 1, Issue 3
October 2017
  • Table of Contents
  • Index by author
Download PDF
Download PowerPoint
Email Article

Thank you for recommending BJGP Open.

NOTE: We only request your email address so that the person to whom you are recommending the page knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Discontinuation of a randomised controlled trial in general practice due to unsuccessful patient recruitment
(Your Name) has forwarded a page to you from BJGP Open
(Your Name) thought you would like to see this page from BJGP Open.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Discontinuation of a randomised controlled trial in general practice due to unsuccessful patient recruitment
Wendelien H van der Gaag, Roxanne van den Berg, Bart W Koes, Arthur M Bohnen, Lonny MG Hazen, Wilco C Peul, Leen Voogt, Arianne P Verhagen, Sita MA Bierma-Zeinstra, Pim AJ Luijsterburg
BJGP Open 2017; 1 (3): bjgpopen17X101085. DOI: 10.3399/bjgpopen17X101085

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Discontinuation of a randomised controlled trial in general practice due to unsuccessful patient recruitment
Wendelien H van der Gaag, Roxanne van den Berg, Bart W Koes, Arthur M Bohnen, Lonny MG Hazen, Wilco C Peul, Leen Voogt, Arianne P Verhagen, Sita MA Bierma-Zeinstra, Pim AJ Luijsterburg
BJGP Open 2017; 1 (3): bjgpopen17X101085. DOI: 10.3399/bjgpopen17X101085
del.icio.us logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Mendeley logo Mendeley

Jump to section

  • Top
  • Article
    • Abstract
    • How this fits in
    • Introduction
    • Method
    • Results
    • Discussion
    • Notes
    • References
  • Figures & Data
  • Info
  • eLetters
  • PDF

Keywords

  • primary health care
  • General Practice
  • Randomized Controlled Trial
  • patient recruitment
  • early termination of clinical trials
  • study design

More in this TOC Section

  • Low-density lipoprotein cholesterol levels and treatment intensity in secondary prevention of patients with ischaemic heart disease in the primary care setting: a real-world data registry study
  • “We’re all in the same boat… some of us just have more holes in their boat”: a qualitative interview study primary care staff views of Deep End Cymru
  • General practitioner characteristics and video use in out-of-hours primary care: a register-based study
Show more Research

Related Articles

Cited By...

Intended for Healthcare Professionals

 
 

British Journal of General Practice

NAVIGATE

  • Home
  • Latest articles
  • Authors & reviewers
  • Accessibility statement

RCGP

  • British Journal of General Practice
  • BJGP for RCGP members
  • RCGP eLearning
  • InnovAiT Journal
  • Jobs and careers

MY ACCOUNT

  • RCGP members' login
  • Terms and conditions

NEWS AND UPDATES

  • About BJGP Open
  • Alerts
  • RSS feeds
  • Facebook
  • Twitter

AUTHORS & REVIEWERS

  • Submit an article
  • Writing for BJGP Open: research
  • Writing for BJGP Open: practice & policy
  • BJGP Open editorial process & policies
  • BJGP Open ethical guidelines
  • Peer review for BJGP Open

CUSTOMER SERVICES

  • Advertising
  • Open access licence

CONTRIBUTE

  • BJGP Life
  • eLetters
  • Feedback

CONTACT US

BJGP Open Journal Office
RCGP
30 Euston Square
London NW1 2FB
Tel: +44 (0)20 3188 7400
Email: bjgpopen@rcgp.org.uk

BJGP Open is an editorially-independent publication of the Royal College of General Practitioners

© 2025 BJGP Open

Online ISSN: 2398-3795