Skip to main content

Main menu

  • HOME
  • LATEST ARTICLES
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • RESOURCES
    • About BJGP Open
    • BJGP Open Accessibility Statement
    • Editorial Board
    • Editorial Fellowships
    • Audio Abstracts
    • eLetters
    • Alerts
    • Outreach
    • BJGP Life
    • Research into Publication Science
    • Advertising
    • Contact
    • Top 10 Research Articles of the Year
  • SPECIAL ISSUES
    • Special issue: Telehealth
    • Special issue: Race and Racism in Primary Care
    • Special issue: COVID-19 and Primary Care
    • Past research calls
  • CONFERENCE
  • RCGP
    • British Journal of General Practice
    • BJGP for RCGP members
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers

User menu

  • Alerts

Search

  • Advanced search
Intended for Healthcare Professionals
BJGP Open
  • RCGP
    • British Journal of General Practice
    • BJGP for RCGP members
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers
  • Subscriptions
  • Alerts
  • Log in
  • Follow bjgp on Twitter
  • Visit bjgp on Facebook
  • Blog
BJGP Open
Intended for Healthcare Professionals

Advanced Search

  • HOME
  • LATEST ARTICLES
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • RESOURCES
    • About BJGP Open
    • BJGP Open Accessibility Statement
    • Editorial Board
    • Editorial Fellowships
    • Audio Abstracts
    • eLetters
    • Alerts
    • Outreach
    • BJGP Life
    • Research into Publication Science
    • Advertising
    • Contact
    • Top 10 Research Articles of the Year
  • SPECIAL ISSUES
    • Special issue: Telehealth
    • Special issue: Race and Racism in Primary Care
    • Special issue: COVID-19 and Primary Care
    • Past research calls
  • CONFERENCE
Research

Effectiveness of professional and patient-oriented strategies in reducing vitamin D and B12 test ordering in primary care: a cluster randomised intervention study

Saskia van Vugt, Evelien de Schepper, Sanne van Delft, Nicolaas Zuithoff, Niek de Wit and Patrick Bindels
BJGP Open 2021; 5 (6): BJGPO.2021.0113. DOI: https://doi.org/10.3399/BJGPO.2021.0113
Saskia van Vugt
1 Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Saskia van Vugt
  • For correspondence: saskiavvugt@gmail.com
Evelien de Schepper
2 Department of General Practice, Erasmus Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sanne van Delft
3 Saltro, Diagnostic Center for Primary Care, Utrecht, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicolaas Zuithoff
1 Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Niek de Wit
1 Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Patrick Bindels
2 Department of General Practice, Erasmus Medical Center, Rotterdam, The Netherlands
2 Department of General Practice, Erasmus Medical Center, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF
Loading

Abstract

Background Vitamin tests are increasingly ordered by GPs, but a clinical and evidence-based indication is often lacking. Harnessing technology (that is, decision support tools and redesigning request forms) have been shown to reduce vitamin requests.

Aim To investigate whether the number of vitamin tests may be reduced by providing a multi-level intervention programme based on training, monitoring, and feedback.

Design & setting This was a cluster randomised intervention study performed in 26 primary care health centres (>195 000 patients) in the Netherlands. The relative reduction in ordered vitamin D and B12 tests was determined after introduction of two de-implementation strategies (1 May 2017 to 30 April 2018).

Method Health centres randomised to de-implementation strategy 1 received education and benchmarking of their own vitamin test ordering behaviour every 3 months. Health centres in de-implementation strategy 2 received the same education and benchmarking, but supplemented with educational material for patients.

Results The number of vitamin D tests decreased by 23% compared to the 1-year pre-intervention period (1 May 2016 to 30 April 2017). For vitamin B12 tests an overall reduction of 20% was found. Provision of patient educational information showed additional value over training and benchmarking of GPs alone for vitamin D test ordering (10% extra reduction, odds ratio [OR] 0.88, 95% confidence interval [CI] = 0.83 to 0.92), but not for vitamin B12 ordering (4% extra reduction, OR 0.96, 95% CI = 0.91 to 1.02). Nationwide, this would result in over €3 200 000 in savings on healthcare expenditure a year.

Conclusion A structured intervention programme, including training and benchmarking of GPs regarding their diagnostic test ordering, resulted in a significant reduction in ordered vitamin tests. Additional information provision to patients resulted in a small but still relevant additional reduction. If implemented on a national level, a substantial cost saving could be achieved.

  • overdiagnosis
  • primary care
  • vitamins
  • diagnostic tests, routine
  • Netherlands
  • vitamin B12
  • vitamin D

How this fits in

Vitamin tests are increasingly ordered by GPs, but a clinical and evidence-based indication is often lacking. This cluster randomised intervention study showed that with a structured time-limited intervention programme, including training and benchmarking of GPs, a significant reduction in the number of vitamin tests in primary care can be achieved with substantial cost saving.

Introduction

Medical overuse, including both overdiagnosis and overtreatment, is a growing problem in health care.1 Overuse is increasingly recognised around the world, but quantifying it is often challenging. Estimates of costs related to overuse vary widely, but overuse of individual services may occur in as many as 80% of cases.2

Despite the growing awareness and recommendations from the Choosing Wisely campaign (https://www.choosingwisely.org), several studies illustrate how difficult it is to achieve substantial reduction in unnecessary testing.3–5 A recent UK study showed that diagnostic testing in primary care substantially increased in the period from 2000–2015.5 Testing for vitamin D increased exponentially, with an average annual increase of 54%. Also, a linear increase pattern emerged for vitamin B12, with an annual increase of 17%.5 Although recommended for specific patient populations,6,7 laboratory tests for vitamins D and B12 are mainly used for patients with non-specific symptoms.8,9

Although many consider vitamin testing to be ‘harmless’, it may lead to medicalisation (owing to untargeted testing in response to [irrational] health perceptions of patients) or overdiagnosis (‘iatrogenic illness’),10 and thereby to an unnecessary increase of healthcare expenditure.5,11 This highlights the need to rationalise vitamin test ordering — especially vitamins D and B12, the most frequently ordered vitamin tests in clinical practice — through influencing both medical professionals and patients.12

A systematic review showed how involving patients through patient-targeted educational materials is effective in decreasing the use of low-value care.12,13 Furthermore, previous studies showed how redesign of the electronic request form14 and three clinical decision support tools (guideline development, a ‘stop alert’ shown to the ordering clinician, and removal from the laboratory ordering preference list)15 reduced vitamin D testing by 36% and 30%, respectively. However, the individual impact of these tools could not be assessed, the follow-up period was limited to 6 months, and implementation is only possible in a setting where decision support tools can be integrated into electronic health records.13–15 Therefore, this study focused on other simple intervention strategies that can be implemented in every primary care system and be evaluated separately. In this study, therefore, the effect of a GP-targeted intervention programme based on training, monitoring, and feedback to rationalise vitamin D and B12 test ordering in primary care was assessed, as was the added value of practice-based patient information about vitamins and health.

Method

Design

A cluster randomised intervention study comparing two de-implementation strategies.

Setting

Health centres from two regional academic primary care networks in the Netherlands were invited to participate in a 1-year intervention study. All vitamin D and B12 tests requested by GPs working in the 26 health centres during the intervention year (1 May 2017 to 30 April 2018) and the pre-intervention year (1 May 2016 to 30 April 2017) were extracted.

Participants

All 59 health centres from the Julius General Practitioners’ Network (JGPN) Utrecht,16 two health centres of the Academic Primeur network, and eight other health centres in the Rotterdam area were invited to participate.

Criteria for inclusion were willingness to attend two obligatory educational sessions by at least one GP of the participating centre, and permission to extract data from the regional diagnostic laboratory on their vitamin D and B12 test ordering. There were no exclusion criteria.

Interventions

The participating health centres were randomised to either de-implementation strategy 1 (‘GP only’) or strategy 2 (‘GP and patient’) (Figure 1).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1. Flow diagram of the study and its participating health centres

Strategy 1 included two training sessions of 1.5 hours, the first session addressed the evidence and indications for vitamin D and B12 testing, the second covered communication strategies regarding (withstanding) patients’ requests for testing. At least one GP from each centre had to attend the plenary meeting. All other GPs were allowed to follow the e-learning of this educational session. GPs received emails every 3 months containing the number of ordered vitamin tests, benchmarked to the numbers of the other participating health centres.

In strategy 2, the health centres received the same training, monitoring, and feedback as in strategy 1, but in addition, these centres were equipped with educational material for patients through video screens in the waiting room, as well as leaflets in the Dutch, Turkish, and Arabic languages about the health effects of vitamins.

Outcomes and measurements

The primary outcome was the difference in the number of vitamin D and B12 blood tests ordered by GPs during the intervention year controlled for the number in the pre-intervention year.

Secondary outcomes were the number of abnormal test results and the direct cost savings.

Data on pre-intervention and intervention vitamin testing were collected through the primary care laboratory organisations in Utrecht (Saltro) and Rotterdam (Star-shl). Both organisations have very long-standing relations with their regional GPs, handling >90% of the laboratory tests ordered by GPs in their region. GP and health-centre identity (code), age and sex of patient, date, test (for example, vitamin D or B12), and test result were extracted anonymously from existing registries.

Randomisation

Randomisation was performed by the Data Management Department of the Julius Centre for Health Sciences and Primary Care Utrecht and controlled for region (Utrecht/Rotterdam) and health-centre size to ensure proper distribution over both intervention arms. The intervention allocation within this cluster randomised intervention study could not be blinded.

Sample size calculation

Based on a two-sample Wilcoxon sample size calculation with data on the achieved absolute reduction in vitamin D tests in an earlier performed ‘practice improving project’ in the Rotterdam region (that is, Poisson means of 850 tests before and 638 after intervention), an alpha of 0.05, power of 0.90, and a minimum number of 36 individual GPs (with a mean of 2095 patients each) were required to achieve significance. When taking an expected cluster correlation of 0.15 into account, the number of individual GPs required increased to 66. Allowing for drop-outs, this study aimed to include 75 individual GPs, with a resulting patient population of approximately 157 125.

Data analysis

The primary outcome (difference in the number of requested tests [divided by the number of patients] in pre- and post-intervention year per health centre) was analysed with a generalised linear mixed model for binomial outcomes. A random intercept was included to correct for clustering (owing to the repeated measurement in each centre). The comparison between strategy 1 and 2 during the intervention year was included separately. In an additional step, predefined confounders were included; that is, the number and sex of GPs per health centre, and (to correct for composition of the patient population)17 the average socioeconomic status (SES) of patients in each centre. SES data were retrieved from the Social and Cultural Planning Office (SCP), which calculates SES scores based on information regarding education, income, and position in the labour market.18

The effects of the intervention strategies were reported in ORs with 95% CIs and P-values.

To externally validate the results, comparison with the number of ordered vitamin tests in the same period by non-participating health centres was performed. These (anonymous) data were retrieved from Saltro’s laboratory registry, which contains routine data of all tests requested by primary care health centres in the Utrecht region.

Presuming that the average test result is an adequate proxy for the quality of the indication of a performed test, the number of tests indicating a vitamin deficiency was determined (based on reference values from the Dutch GP guidelines on vitamin D19 and B1220).

Finally, direct cost savings were determined by calculating savings from the reduction in the number of vitamin D and B12 tests. Standard national tariffs for vitamin D and B12 laboratory tests were used;21 that is, €7.62 to €8.38 (£6.54 to £7.20) (average €8.00 [£6.87]) for vitamin D, and €5.81 to €6.39 (£4.99 to £5.49) (average €6.10 [£5.24]) for vitamin B12. Other (indirect) cost savings (for example, number of GP consultations) cannot be calculated from this study.

All analysis was performed using IBM SPSS Statistics (version 25) and SAS (version 9.4).

Results

Baseline characteristics

Twenty-two health centres with 117 GPs in the Utrecht region and four health centres with 41 GPs in the Rotterdam region participated in the study, with a corresponding total population of 195 394 patients (134 305 in the Utrecht region and 61 089 in the Rotterdam region) (Table 1). No significant differences in baseline characteristics were seen between health centres undergoing de-implementation strategy 1 and 2. None of the participating centres discontinued the intervention or were lost to follow up.

View this table:
  • View inline
  • View popup
Table 1. Baseline characteristics of participating GPs, including pre-intervention numbers of vitamin testing

Number of vitamin D and B12 tests

The total number of vitamin D tests ordered by GPs in strategy 1 and 2 decreased from 17 527 to 13 447 (–23%, OR 0.73, 95% CI = 0.71 to 0.75) with a range of –70% to +9%.

The mean number of vitamin D tests ordered in the pre-intervention year was 88/1000 patients (standard deviation [SD] 57), ranging per centre from 12 to 262/1000 patients. During the intervention year this was 66 vitamin D tests per 1000 patients (SD 51), resulting in a decrease of 22/1000 (95% CI = –32 to –13, P<0.001).

The total number of ordered vitamin D tests in non-participating health centres remained stable during the intervention year (–0.4%).

For vitamin B12 the total number of tests reduced from 12 304 (pre-intervention) to 9891 (–20%, OR 0.79, 95% CI = 0.76 to 0.81) with a range of –63% to +19%. Overall, a mean of 59 vitamin B12 tests/1000 patients (SD 43), was ordered during the pre-intervention year, compared to 47/1000 patients (SD 32) during the intervention year, resulting in a mean difference of 12/1000 (95% CI = –20 to –5, P = 0.003). The number of ordered vitamin B12 tests per 1000 patients per centre varied from 7 to 198/1000 patients during the pre-intervention year. A marked difference between the pre-intervention numbers for Utrecht (n = 46/1000 patients, SD 26) and Rotterdam (n = 106/1000 patients, SD 62) was found, which decreased to 38/1000 (SD 22) and 79/1000 (SD 43), respectively.

In non-participating health centres the number of tests decreased by 4.3%.

All health centres were divided into quartiles according to the pre-intervention test ordering rates. For each category the mean reduction in ordered vitamin tests was calculated (Figure 2), which increased with higher pre-intervention test rates.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2. Number of ordered vitamin tests in pre-intervention period (in quartiles) related to reduction in number of ordered tests during intervention period. pts = patients.

Comparison between de-implementation strategy 1 and 2

In centres randomised to de-implementation strategy 1 (GP only) there was a 19% reduction in total number of vitamin D tests, compared with a reduction of 29% in centres randomised to de-implementation strategy 2 (GP and patient) (OR 0.88, 95% CI = 0.83 to 0.92) (Table 2).

View this table:
  • View inline
  • View popup
Table 2. Reduction in number of vitamin D and B12 tests

For vitamin B12 a reduction of 18% was found in centres of strategy 1 compared with a reduction of 22% in strategy 2 (OR 0.96, 95% CI = 0.91 to 1.02, non-significant) (Table 2).

Vitamin test results

The mean test result of vitamin D tests did not differ before and during the intervention (56 nmol/L versus 55 nmol/L), neither for vitamin B12 (304 pmol/L). Also the proportion of test results below the reference values for vitamin D and B12 did not differ (around 17%, Table 3).

View this table:
  • View inline
  • View popup
Table 3. Results of ordered vitamin D and B12 tests

Cost–benefit analysis

With an observed reduction of 4080 vitamin D and 2413 vitamin B12 tests, a saving of €32 640 and €14 719, respectively, can be calculated. Total savings were €47 359, compared with €20 340 related to development and implementation of the intervention (that is, development of patient education material [videos €12 566, booklets €1266, and posters €787], organisation of GP training sessions [€1096], and development of e-learning [€4625]). In case of an endurable implementation, only expenses for printing patient education material (€972), organisation of GP training sessions (€1096), and laboratory costs (€3000) for regular collection and (secured) communication of the number of test requests will continue, which is 11% of the total savings.

With an observed average reduction of 22 vitamin D and 12 vitamin B12 tests per 1000 patients, a cost reduction of €361 and €375, respectively, per standard primary care practice (2095 patients) per year can be calculated. In the Dutch context (with a total of around 5000 primary care practices) this would mean a total cost reduction of €3 681 701 per year; applying the 11% intervention costs results in total savings of €3 276 714 per year. This estimate is likely lower than the true savings because exact data on indirect cost reduction (for example, GP consultations) were not available for this analysis.

Discussion

Summary

This study demonstrates that with relatively simple and little time-consuming interventions the number of vitamin tests ordered in primary care can be reduced substantially. A 23% reduction in vitamin D tests and 20% in vitamin B12 tests ordered after 1 year was found, resulting in substantial cost savings.

Additional provision of patient information resulted in a 10% extra reduction of vitamin D tests on top of training and benchmarking of GPs, and a non-significant 4% additional reduction for vitamin B12 tests. The decrease was most prominent in centres that already had a high test ordering rate before the intervention.

Strengths and limitations

A major strength of this study is the inclusion of a relatively high number of GPs. Furthermore, a simple and non-time-consuming intervention was used, which is easy to implement in daily practice.

However, some limitations need to be considered. First, primary care assistants were not included in the intervention although they sometimes issue laboratory forms on a patient request. Including primary care assistants might improve test reduction even more.

Second, benchmarking was provided at centre level, whereas provision of individual feedback could possibly result in further reduction of test ordering.

Furthermore, presence of at least one GP per centre was obligatory for participation in this study. It was not possible to check whether the lessons learned during the training sessions were actually shared with fellow GPs. However, an e-learning recording of the training sessions was available and 80% of all 158 GPs from the participating centres was reached via either the training session (32%) or e-learning (48%). Besides, participating GPs could have been influenced by other training programmes on the same topic during the intervention period, although no notifications of such programmes were received.

Selection bias may have occurred, because the GPs joining this study may have been more motivated compared with non-participating GPs. Also, regional differences were observed: Rotterdam region showed a much higher pre-intervention test rate and reduction in test ordering for vitamin B12. When interviewing participating GPs at the end of the intervention year, several Utrecht GPs mentioned that they experienced how the provided patient information raised awareness for vitamin testing, encouraging patients to ask for a vitamin B12 blood test.8 Reviewing the patient education material would therefore be required before further use.

Finally, reasons for testing were not studied during this project. It would have been interesting to know whether the GP training sessions helped to improve evidence-based testing behaviour. Presuming that the average test result is an adequate proxy for the quality of the indication of a performed test, the number of tests indicating a vitamin deficiency was determined, which did not differ during the intervention period.

Comparison with existing literature

Several medical specialty societies have identified unnecessary laboratory testing as a target for overuse reduction in campaigns aimed at avoiding low-value care.22,23 Several studies focusing on vitamin D request reduction have been performed. Harnessing technology, such as redesigning electronic request forms,14 decision support tools,15 and obligatory addition of test indication on request forms4 showed reductions in vitamin D test requests of 36%, 67%, and 92%, respectively. Systematic reviews have also showed how performance feedback and clinician education,24,25 as well as patient education,12,13 are useful strategies with a solid evidence base for reducing use of low-value health services.

In the present study, the proportion of tests with a result below the reference values remained stable, suggesting that even in the intervention period many vitamin tests were still done without a valid indication. Several recent studies confirmed that a large proportion of vitamin D tests in primary care lack a valid clinical indication.14,26,27

Implications for research and practice

In order to gain understanding of the sustainability of the present intervention, the authors looked at the number of vitamin D tests ordered in the 2 years following the pilot ‘practice improvement project’ performed in 11 primary care health centres (patient population 120 000) in Rotterdam. One year after the intervention the numbers remained stable; in the second year the number of vitamin D tests was only slightly higher (+0.3%, unpublished data). Because these results are based on a small project, further studies with a longer follow-up are necessary.

This study demonstrated that an intervention requiring limited time, consisting of training of GPs and benchmarking their diagnostic test ordering, can achieve a significant reduction in ordered laboratory vitamin tests. This strategy is most successful among GPs who frequently order vitamin tests and who are willing to improve their testing behaviour.

The low number of abnormal test results illustrates the need for training on evidence-based indications for vitamin test ordering. Training programmes and individual monitoring and feedback should be implemented on a national level to achieve a further reduction of the number of vitamin tests in primary care with substantial cost savings.

Notes

Funding

The study was funded by the Citrien Fund, a national programme of the Dutch government initiated in 2015 ('do or don’t' programme) to reduce lower-value services. The funding source was not involved in the design, conduct, analysis, or interpretation of the data, nor in the writing and decision to submit the article.

Ethical approval

The Medical Ethics Committee of the University Medical Centre Utrecht assessed this study’s design and procedures, and in accordance with the local regulatory guidelines and standards for human subjects protection in the Netherlands (Medical Research Involving Human Subjects Act 2005), this study proved to be exempt from further medical ethical review.

Provenance

Freely submitted; externally peer reviewed.

Acknowledgements

The authors would like to thank Sacha de Lathouder from STAR-shl Diagnostic Center for Primary Care, and Lara Harmans and Sanne van Delft from Saltro Diagnostic Center for Primary Care for their participation in the data collection. They would also like to thank Dr Alike van der Velden, from the Julius Center for Health Sciences and Primary Care of University Medical Center Utrecht, for her help with the study design, recruitment and ethical approval. The authors would also like to thank all included GPs for their enthusiastic participation during the intervention year.

Competing interests

The authors declare that no competing interests exist.

The authors report no conflicts of interest in this work

  • Received June 17, 2021.
  • Accepted July 5, 2021.
  • Copyright © 2021, The Authors

This article is Open Access: CC BY license (https://creativecommons.org/licenses/by/4.0/)

References

  1. 1.↵
    1. Morgan DJ,
    2. Dhruva SS,
    3. Coon ER,
    4. et al.
    (2019) 2019 update on medical overuse: a review. JAMA Intern Med 179(11):1568–1574, doi:10.1001/jamainternmed.2019.3842, pmid:31498374.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Brownlee S,
    2. Chalkidou K,
    3. Doust J,
    4. et al.
    (2017) Evidence for overuse of medical services around the world. Lancet 390(10090):156–168, doi:10.1016/S0140-6736(16)32585-5, pmid:28077234.
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Rosenberg A,
    2. Agiro A,
    3. Gottlieb M,
    4. et al.
    (2015) Early trends among seven recommendations from the choosing wisely campaign. JAMA Intern Med 175(12):1913–1920, doi:10.1001/jamainternmed.2015.5441, pmid:26457643.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Ferrari R,
    2. Prosser C
    (2016) Testing vitamin D levels and choosing wisely. JAMA Intern Med 176(7):1019–1020, doi:10.1001/jamainternmed.2016.1929, pmid:27214530.
    OpenUrlCrossRefPubMed
  5. 5.↵
    1. O'Sullivan JW,
    2. Stevens S,
    3. Hobbs FDR,
    4. et al.
    (2018) Temporal trends in use of tests in UK primary care, 2000-15: retrospective analysis of 250 million tests. BMJ 363:k4666, doi:10.1136/bmj.k4666, pmid:30487169.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    1. Holick MF,
    2. Binkley NC,
    3. Bischoff-Ferrari HA,
    4. et al.
    (2011) Evaluation, treatment, and prevention of vitamin D deficiency: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab 96(7):1911–1930, doi:10.1210/jc.2011-0385, pmid:21646368.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Hunt A,
    2. Harrington D,
    3. Robinson S
    (2014) Vitamin B12 deficiency. BMJ 349, doi:10.1136/bmj.g5226, pmid:25189324. g5226.
    OpenUrlFREE Full Text
  8. 8.↵
    1. Hofstede H,
    2. van der Burg HAM,
    3. Mulder BC,
    4. et al.
    (2019) Reducing unnecessary vitamin testing in general practice: barriers and facilitators according to general practitioners and patients. BMJ Open 9(10), doi:10.1136/bmjopen-2019-029760, pmid:31594878. e029760.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Koch H,
    2. van Bokhoven MA,
    3. ter Riet G,
    4. et al.
    (2009) What makes general practitioners order blood tests for patients with unexplained complaints? A cross-sectional study. Eur J Gen Pract 15(1):22–28, doi:10.1080/13814780902855762, pmid:19363746.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Kahwati LC,
    2. Weber RP,
    3. Pan H,
    4. et al.
    (2018) Vitamin D, calcium, or combined supplementation for the primary prevention of fractures in community-dwelling adults: evidence report and systematic review for the US Preventive Services Task Force. JAMA 319(15):1600–1612, doi:10.1001/jama.2017.21640, pmid:29677308.
    OpenUrlCrossRefPubMed
  11. 11.↵
    1. Sattar N,
    2. Welsh P,
    3. Panarelli M,
    4. Forouhi NG
    (2012) Increasing requests for vitamin D measurement: costly, confusing, and without credibility. Lancet 379(9811):95–96, doi:10.1016/S0140-6736(11)61816-3, pmid:22243814.
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Légaré F,
    2. Stacey D,
    3. Turcotte S,
    4. et al.
    (2014) Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev 9, doi:10.1002/14651858.CD006732.pub3, pmid:25222632. CD006732.
    OpenUrlCrossRefPubMed
  13. 13.↵
    1. Sypes EE,
    2. de Grood C,
    3. Whalen-Browne L,
    4. et al.
    (2020) Engaging patients in de-implementation interventions to reduce low-value clinical care: a systematic review and meta-analysis. BMC Med 18(1), doi:10.1186/s12916-020-01567-0, pmid:32381001. 116.
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Patel V,
    2. Gillies C,
    3. Patel P,
    4. et al.
    (2020) Reducing vitamin D requests in a primary care cohort: a quality improvement study. BJGP Open 4(5):bjgpopen20X101090, doi:10.3399/bjgpopen20X101090, pmid:33144362.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    1. Felcher AH,
    2. Gold R,
    3. Mosen DM,
    4. Stoneburner AB
    (2017) Decrease in unnecessary vitamin D testing using clinical decision support tools: making it harder to do the wrong thing. J Am Med Inform Assoc 24(4):776–780, doi:10.1093/jamia/ocw182, pmid:28339692.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Grobbee DE,
    2. Hoes AW,
    3. Verheij TJM,
    4. et al.
    (2005) The Utrecht Health Project: optimization of routine healthcare data for research. Eur J Epidemiol 20(3):285–287, doi:10.1007/s10654-004-5689-2, pmid:15921047.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Sociaal Cultureel Planbureau
    [Socio-economic status by postcode area]. [Article in Dutch]. https://bronnen.zorggegevens.nl/Bron?naam=Sociaal-Economische-Status-per-postcodegebied. 29 Sep 2021.
  18. 18.↵
    1. Knol FA
    (1998) [From high to low; from low to high]. [Article in Dutch] (Sociaal en Cultureel Planbureau, Den Haag).
  19. 19.↵
    1. Nederlands Huisartsen Genootschap
    [Laboratory diagnostics Vitamin D deficiency]. [Article in Dutch]. https://www.nhg.org/themas/publicaties/laboratoriumdiagnostiek-vitamine-d--deficientie-volledige-tekst. 9 Sep 2021.
  20. 20.↵
    1. Nederlands Huisartsen Genootschap
    [Laboratory diagnostics Vitamin B12 deficiency]. [Article in Dutch]. https://www.nhg.org/themas/publicaties/laboratoriumdiagnostiek-vitamine-b12-volledige-tekst. 9 Sep 2021.
  21. 21.↵
    1. Nederlandse Zorg Autoriteit
    [Key figures and statistics (Appendix 1 to Assessment report package 2017)]. [Article in Dutch]. https://puc.overheid.nl/nza/doc/PUC_13003_22. 9 Sep 2021.
  22. 22.↵
    1. Levinson W,
    2. Kallewaard M,
    3. Bhatia RS,
    4. et al.
    (2015) 'Choosing Wisely': a growing international campaign. BMJ Qual Saf 24(2):167–174, doi:10.1136/bmjqs-2014-003821, pmid:25552584.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    1. Venkatesh AK,
    2. Hajdasz D,
    3. Rothenberg C,
    4. et al.
    (2018) Reducing unnecessary blood chemistry testing in the emergency department: implementation of choosing wisely. Am J Med Qual 33(1):81–85, doi:10.1177/1062860617691842, pmid:28693330.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Colla CH,
    2. Mainor AJ,
    3. Hargreaves C,
    4. et al.
    (2017) Interventions aimed at reducing use of low-value health services: a systematic review. Med Care Res Rev 74(5):507–550, doi:10.1177/1077558716656970, pmid:27402662.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Cadogan SL,
    2. Browne JP,
    3. Bradley CP,
    4. Cahill MR
    (2015) The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review. Implement Sci 10:167, doi:10.1186/s13012-015-0356-4, pmid:26637335.
    OpenUrlCrossRefPubMed
  26. 26.↵
    1. Crowe FL,
    2. Jolly K,
    3. MacArthur C,
    4. et al.
    (2019) Trends in the incidence of testing for vitamin D deficiency in primary care in the UK: a retrospective analysis of The Health Improvement Network (THIN), 2005-2015. BMJ Open 9(6), doi:10.1136/bmjopen-2018-028355, pmid:31167871. e028355.
    OpenUrlAbstract/FREE Full Text
  27. 27.↵
    1. Woodford HJ,
    2. Barrett S,
    3. Pattman S
    (2018) Vitamin D: too much testing and treating? Clin Med 18(3):196–200, doi:10.7861/clinmedicine.18-3-196, pmid:29858427.
    OpenUrlAbstract/FREE Full Text
Back to top
Previous ArticleNext Article

In this issue

BJGP Open
Vol. 5, Issue 6
January 2021
  • Table of Contents
  • Index by author
Download PDF
Download PowerPoint
Article Alerts
Or,
sign in or create an account with your email address
Email Article

Thank you for recommending BJGP Open.

NOTE: We only request your email address so that the person to whom you are recommending the page knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Effectiveness of professional and patient-oriented strategies in reducing vitamin D and B12 test ordering in primary care: a cluster randomised intervention study
(Your Name) has forwarded a page to you from BJGP Open
(Your Name) thought you would like to see this page from BJGP Open.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Effectiveness of professional and patient-oriented strategies in reducing vitamin D and B12 test ordering in primary care: a cluster randomised intervention study
Saskia van Vugt, Evelien de Schepper, Sanne van Delft, Nicolaas Zuithoff, Niek de Wit, Patrick Bindels
BJGP Open 2021; 5 (6): BJGPO.2021.0113. DOI: 10.3399/BJGPO.2021.0113

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Effectiveness of professional and patient-oriented strategies in reducing vitamin D and B12 test ordering in primary care: a cluster randomised intervention study
Saskia van Vugt, Evelien de Schepper, Sanne van Delft, Nicolaas Zuithoff, Niek de Wit, Patrick Bindels
BJGP Open 2021; 5 (6): BJGPO.2021.0113. DOI: 10.3399/BJGPO.2021.0113
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Mendeley logo Mendeley

Jump to section

  • Top
  • Article
    • Abstract
    • How this fits in
    • Introduction
    • Method
    • Results
    • Discussion
    • Notes
    • References
  • Figures & Data
  • Info
  • eLetters
  • PDF

Keywords

  • overdiagnosis
  • Primary care
  • vitamins
  • diagnostic tests, routine
  • Netherlands
  • vitamin B12
  • vitamin D

More in this TOC Section

  • Translating primary care to telehealth: analysis of in-person consultations on diabetes and cardiovascular disease
  • Primary care physicians’ perceptions of social determinants of health recommendations: a qualitative study
  • Variation in laboratory testing for patients with long-term conditions: a longitudinal cohort study in UK primary care
Show more Research

Related Articles

Cited By...

Intended for Healthcare Professionals

@BJGPOpen's Likes on Twitter

 
 

British Journal of General Practice

NAVIGATE

  • Home
  • Latest articles
  • Authors & reviewers
  • Accessibility statement

RCGP

  • British Journal of General Practice
  • BJGP for RCGP members
  • RCGP eLearning
  • InnovAiT Journal
  • Jobs and careers

MY ACCOUNT

  • RCGP members' login
  • Terms and conditions

NEWS AND UPDATES

  • About BJGP Open
  • Alerts
  • RSS feeds
  • Facebook
  • Twitter

AUTHORS & REVIEWERS

  • Submit an article
  • Writing for BJGP Open: research
  • Writing for BJGP Open: practice & policy
  • BJGP Open editorial process & policies
  • BJGP Open ethical guidelines
  • Peer review for BJGP Open

CUSTOMER SERVICES

  • Advertising
  • Open access licence

CONTRIBUTE

  • BJGP Life
  • eLetters
  • Feedback

CONTACT US

BJGP Open Journal Office
RCGP
30 Euston Square
London NW1 2FB
Tel: +44 (0)20 3188 7400
Email: bjgpopen@rcgp.org.uk

BJGP Open is an editorially-independent publication of the Royal College of General Practitioners

© 2023 BJGP Open

Online ISSN: 2398-3795