http://orcid.org/0000-0001-6485-7415
Figures
Abstract
Background
Atrial fibrillation (AF) is the most common type of cardiac arrhythmia and is associated with increased risk of stroke and congestive heart failure. Lead-I electrocardiogram (ECG) devices are handheld instruments that can detect AF at a single-time point.
Purpose
To assess the diagnostic test accuracy, clinical impact and cost effectiveness of single-time point lead-I ECG devices compared with manual pulse palpation (MPP) followed by a 12-lead ECG for the detection of AF in symptomatic primary care patients with an irregular pulse.
Methods
Electronic databases (MEDLINE, MEDLINE Epub Ahead of Print and MEDLINE In-Process, EMBASE, PubMed and Cochrane Databases of Systematic Reviews, Cochrane Central Database of Controlled Trials, Database of Abstracts of Reviews of Effects, Health Technology Assessment Database) were searched to March 2018. Two reviewers screened the search results, extracted data and assessed study quality. Summary estimates of diagnostic accuracy were calculated using bivariate models. Cost-effectiveness was evaluated using an economic model consisting of a decision tree and two cohort Markov models.
Results
Diagnostic accuracy
The diagnostic accuracy (13 publications reporting on nine studies) and clinical impact (24 publications reporting on 19 studies) results are derived from an asymptomatic population (used as a proxy for people with signs or symptoms of AF). The summary sensitivity of lead-I ECG devices was 93.9% (95% confidence interval [CI]: 86.2% to 97.4%) and summary specificity was 96.5% (95% CI: 90.4% to 98.8%).
Cost effectiveness
The de novo economic model yielded incremental cost effectiveness ratios (ICERs) per quality adjusted life year (QALY) gained. The results of the pairwise analysis show that all lead-I ECG devices generate ICERs per QALY gained below the £20,000-£30,000 threshold. Kardia Mobile is the most cost effective option in a full incremental analysis. Lead-I ECG tests may identify more AF cases than the standard diagnostic pathway. This comes at a higher cost but with greater patient benefit in terms of mortality and quality of life.
Limitations
No published data evaluating the diagnostic accuracy, clinical impact or cost effectiveness of lead-I ECG devices for the target population are available.
Conclusions
The use of single-time point lead-I ECG devices in primary care for the detection of AF in people with signs or symptoms of AF and an irregular pulse appears to be a cost effective use of NHS resources compared with MPP followed by a 12-lead ECG, given the assumptions used in the base case model.
Citation: Duarte R, Stainthorpe A, Mahon J, Greenhalgh J, Richardson M, Nevitt S, et al. (2019) Lead-I ECG for detecting atrial fibrillation in patients attending primary care with an irregular pulse using single-time point testing: A systematic review and economic evaluation. PLoS ONE 14(12): e0226671. https://doi.org/10.1371/journal.pone.0226671
Editor: Jennifer A. Hirst, University of Oxford, UNITED KINGDOM
Received: June 20, 2019; Accepted: December 2, 2019; Published: December 23, 2019
Copyright: © 2019 Duarte et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was commissioned by the NIHR HTA Programme on behalf of the National Institute for Health and Care Excellence as project number 16/30/05. Rui Duarte, Angela Stainthorpe, Janette Greenhalgh, Marty Richardson, Sarah Nevitt and Angela Boland are supported by NIHR TAR grant 14/25/10. James Mahon is Director of Coldingham Analytical Services. Howard Thom was supported by NIHR HTA grant 14/141/01 and the UK Medical Research Council ConDuCT-II Hub for Trials Methodology Research (MR/K025643/1). Yemisi Takwoingi is supported by the NIHR Birmingham Biomedical Research Centre. The views expressed in this report are those of the authors and not necessarily those of the NIHR, MRC or the Department of Health and Social Care. The funder provided support in the form of salaries for authors RD, AS, JG, MR, SN, AB, HT and YT, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section. Any errors are the responsibility of the authors.
Competing interests: Howard Thom reports personal fees from Novartis Pharma, Pfizer Inc, Hoffman La Roche, Bayer, and Janssen, all unrelated to the submitted work. James Mahon is Director of Coldingham Analytical Services. This commercial affiliation does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Atrial fibrillation (AF) is a disturbance in heart rhythm (arrhythmia) caused by abnormal electrical activity in the upper chambers of the heart (atria).[1] AF is the most common type of arrhythmia. Estimates from 2010 suggest that 20.9 million men and 12.6 million women worldwide are living with AF.[2] The median age of diagnosis is 75 years with the highest number of cases between the ages of 75 to 79 years in males and 80 to 84 years in females.[3]
AF can be paroxysmal (intermittent episodes lasting less than 7 days that stop without treatment), persistent (episodes lasting longer than 7 days and do not terminate without treatment) or permanent (present all the time). AF can be categorised as valvular or non-valvular depending on the underlying cause (i.e. whether valve disease is present or not). Both valvular and non-valvular AF can be paroxysmal, persistent or permanent.[4] Patients diagnosed with paroxysmal AF may develop persistent or permanent AF.[2] It is possible, but unusual, for some people with persistent AF to revert to normal sinus rhythm.[2]
Patients with AF may experience palpitations, dizziness, shortness of breath and tiredness. However, AF can be asymptomatic and may only be identified when people attend medical appointments for other conditions. Due to its intermittent nature, many cases of paroxysmal AF remain undiagnosed.[2] Cases of paroxysmal AF may only be detected with prolonged monitoring, rather than by a single examination.[2]
The National Institute for Health and Care Excellence (NICE)[5] recommends that, after positive manual pulse palpation (MPP), an AF diagnosis should be confirmed with an electrocardiogram (ECG). People who present to primary care with signs or symptoms of AF and an irregular pulse should be referred for a 12-lead ECG in the days following their primary care appointment if a 12-lead ECG is not available in the practice. Treatment (where indicated) begins following the results of the 12-lead ECG test. Lead-I ECG devices are handheld instruments that can be used to detect AF. Lead-I ECGs are so-called because of the 12-lead ECG that they simulate (i.e. Lead-I) rather than the fact that they record "one lead" only. They could be used to detect AF during a primary care appointment in people who present with signs or symptoms and have an irregular pulse, which may reduce the time to initiating anticoagulation therapy.
Objectives
The aim of this study was to assess the diagnostic test accuracy, the clinical impact and the cost effectiveness of single-time point lead-I ECG devices for the detection of AF in people presenting to primary care with signs or symptoms of AF and who have an irregular pulse, compared with MPP followed by a 12-lead ECG in primary or secondary care (prior to initiation of anticoagulation therapy). To achieve this aim we:
- conducted systematic reviews of the diagnostic accuracy and clinical impact of lead-I ECG devices for (1) detecting AF in people presenting to primary care with signs or symptoms of AF, or, if evidence was not available for this population/setting, for (2) detecting AF in an asymptomatic population defined as people presenting to any setting without symptoms of AF, with or without a previous diagnosis of AF
- developed an economic model to assess the cost effectiveness of single-time point lead-I ECG devices compared with MPP followed by a 12-lead ECG in primary or secondary care in people presenting to primary care with signs or symptoms of AF who have an irregular pulse.
Methods: Assessment of clinical impact and diagnostic test accuracy
The systematic review methods followed the general principles outlined in the Centre for Reviews and Dissemination (CRD) guidance for conducting reviews in health care,[6] the NICE Diagnostics Assessment Programme manual[7] and the Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy.[8] The systematic review was conducted according to a prespecified protocol[4] and is registered on PROSPERO as CRD42018090375. The systematic review is reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) for diagnostic test accuracy (DTA) studies.[9] The PRISMA-DTA checklist and PRISMA-DTA for abstracts checklist are presented in S1 and S2 Tables respectively.
Data sources and searches
Electronic databases (MEDLINE, MEDLINE Epub Ahead of Print and MEDLINE In-Process, EMBASE, PubMed and Cochrane Databases of Systematic Reviews, Cochrane Central Database of Controlled Trials, Database of Abstracts of Reviews of Effects, Health Technology Assessment Database) were searched up to 9th March 2018. The search strategy used for the MEDLINE database is presented in S1 Text. The MEDLINE search strategy was adapted to enable similar searches of the other relevant electronic databases.
The search results were managed using EndNote X8 software. The reference lists of relevant systematic reviews and eligible studies were hand-searched to identify further potentially relevant studies.
Study selection
The citations identified were assessed for inclusion in the review using a two-stage process. First, two reviewers independently screened all titles and abstracts identified by the electronic searches to identify potentially relevant articles to be retrieved. Second, full-text copies of these studies were obtained and assessed independently by two reviewers for inclusion using the eligibility criteria outlined in S3 Table. Any disagreements were resolved through discussion at each stage, and, if necessary, in consultation with a third reviewer. Studies that assessed the diagnostic accuracy of lead-I ECG devices used at a single-time point to detect AF in an asymptomatic population were considered for inclusion due to the absence of studies in symptomatic populations. We considered an asymptomatic population to comprise people not presenting with symptoms of AF, with or without a previous diagnosis of AF.
Data extraction
Data were extracted relating to the information described in S3 Table. Data extraction was carried out by one reviewer and checked for accuracy by a second reviewer. Any disagreements were resolved through discussion, and, if necessary, in consultation with a third reviewer.
Quality assessment
The methodological quality of the included diagnostic accuracy studies was assessed using the QUality Assessment of Diagnostic Accuracy Studies—2 (QUADAS-2) tool tailored to the review question.[10] The methodological quality of cross-sectional and case-controlled studies evaluating the clinical impact of lead-I ECG devices was assessed using the Newcastle-Ottawa quality assessment scale.[11, 12]
Quality assessment of the included studies was undertaken by one reviewer and checked by a second reviewer. Any disagreements were resolved by discussion, and, if necessary, in consultation with a third reviewer.
Data synthesis and analysis
The sensitivity and specificity of each index test were summarised in forest plots and plotted in receiver operating characteristic (ROC) space. Pooled estimates of sensitivity and specificity with 95% confidence intervals (CIs) were obtained using bivariate models.[13] The bivariate model was fitted using the metandi and xtmelogit commands in Stata version 14. Summary receiver operating characteristic (SROC) plots were produced using RevMan 5.3. When there were few studies, the bivariate model was reduced to two univariate random effect logistic regression models by assuming no correlation between sensitivity and specificity across studies.[14] When little or no heterogeneity was observed on forest plots and SROC plots, the models were further simplified into fixed effect models by eliminating the random effects parameters for sensitivity and/or specificity.[14] Judgement of heterogeneity was based on the visual appearance of forest plots and SROC plots in addition to clinical judgement regarding potential sources of heterogeneity.
The analyses were stratified by whether diagnosis of AF was made by a trained healthcare professional interpreting the lead-I ECG trace, or by the lead-I ECG algorithm. For both sets of analyses, the reference standard was interpretation of the 12-lead ECG trace by a trained healthcare professional. When studies reported data for two types of lead-I ECG device and two different interpreters, one dataset was chosen and sensitivity analyses were performed using the alternative datasets. Clinical impact outcomes were synthesised narratively.
Methods: Assessment of cost effectiveness
A de novo economic analysis was undertaken following the diagnostic pathway for patients presenting to primary care with signs or symptoms of AF and an irregular pulse. Results were presented over a time horizon of 30 years with patients entering the model at age 70. The economic evaluation took a NHS/Personal Social Services (PSS) perspective. The economic evaluation is only relevant to primary care practices where patients have to wait at least 48 hours between an initial consultation with the GP and having a 12-lead ECG; this allows the benefit of early anticoagulation and rate control treatment for those patients who receive a positive lead-I ECG to be considered. The base case model assumptions are presented in S5 Table.
Model structure
A decision tree and two cohort Markov models were built in Microsoft Excel® (Microsoft Corporation, Redmond, WA, USA). The decision tree describes the pathway that a patient presenting to primary care with signs or symptoms of AF and an irregular pulse follows in the initial GP consultation (S1–S3 Figs). The first Markov model captured the differences in the costs and benefits of treatment (standard diagnostic pathway outlined in NICE CG180 versus lead-I ECG pathway) during the first 3 months after the initial appointment (S4 Fig). During this period, some patients will be diagnosed with AF and start treatment whilst other patients will have further tests to diagnose or rule out AF (where ‘rule out’ means no diagnosis of AF is recorded and no treatment for AF is started). The second Markov model captured the differences in lifetime costs and benefits after patients have either received a diagnosis of AF or have had AF ruled out (S5 Fig). Patients remained in the second Markov model until death. The cycle length was 3 months in the second Markov model. Costs and benefits were discounted at 3.5% per year.
Patient population
The modelled population was people with signs or symptoms of AF plus an irregular pulse. This population includes patients with AF and patients without AF who are similarly symptomatic. Estimates of the prevalence of AF by age and sex were taken from a paper by Adderley;[15] these age-sex specific prevalence estimates are based on the results of a study carried out using primary care records from UK general practice in 2016.
The proportion of patients with AF who are symptomatic was taken from an observational cohort study of data from the US Outcomes Registry for Better Informed Treatment of Atrial Fibrillation (ORBIT-AF registry) by Piccini;[16] the study reports that women with AF were more likely to be symptomatic than men (67.9% versus 57.5%).
The proportion of patients with symptomatic undiagnosed AF who have paroxysmal AF could not be found in the literature. A fixed-effects meta-analysis published by Welton[17] reported that the proportion of patients with paroxysmal AF (not explicitly symptomatic) varied substantially between the studies[18–20] included in the meta-analysis (from 0.059 to 0.835). Given the wide range reported by Welton[17] and the lack of evidence specifically on incidence rates for symptomatic paroxysmal AF, it was assumed in our base case that 50% of patients in the model with AF would have paroxysmal AF.
Tests and treatments
Cost per lead-I ECG test was calculated as the annual cost per device divided by the number of patients in the eligible population per year plus any extra costs associated with each use of the device (S5A and S5B Table). Costs for the 12-lead ECG tests were estimated using a microcosting approach for 12-lead ECG tests carried out in primary care and using NHS Reference Costs for tests carried out in secondary care (S6 Table). The proportion of patients receiving anticoagulation for AF was estimated using data from the Quality and Outcomes Framework 2016/2017 (AF007).[21] Apixaban was used as the basis for modelling costs and outcomes for all patients receiving anticoagulant therapy.
Mortality, cardiovascular events and adverse events
Age- and sex-adjusted mortality rates were estimated for patients with and without AF who were and were not receiving anticoagulant therapy, and who had not experienced a previous cardiovascular event (CVE) (S7 Table). Mortality risk for patients who experienced a subsequent CVE was assumed to be 2.6 times greater than mortality risk for patients with no history of CVEs, based on the results of a study of stroke survivors in Norway.[22] The CVEs included in the model were: ischaemic stroke, transient ischaemic attack and haemorrhagic stroke. Clinically relevant bleeds were considered to be adverse events (AEs). Rates for CVEs depended on AF- and treatment status, and whether a patient had experienced a previous CVE. Rates for AEs depended on AF- and treatment status but did not take account of the history of previous events (S8A–S8E Table).
Utilities
Utility values for the symptomatic and asymptomatic AF-positive population were based on a study by Berg.[23] Berg provides the coefficients of regression models fitted to the results of the EQ-5D-3L[24] questionnaire completed as part of a large European survey of patients with AF. Mean age-specific utility values for symptomatic patients with AF were calculated using the coefficients from the study by Berg[23] and adjusted for model age, sex ratio and symptom proportions.
Analysis of uncertainty
Probabilistic sensitivity analysis (PSA) results were presented to reflect uncertainty in the model inputs; extensive deterministic sensitivity analysis and scenario analysis were also carried out to assess the impact of uncertainty in model assumptions. We report the total costs of the annual number of symptomatic patients with positive MPP seen by a single GP, total quality adjusted life years (QALYs) for these patients, incremental costs and QALYs, and incremental cost effectiveness ratios (ICERs).
Results
The electronic database searches identified 1151 citations (915 unique records). No studies were identified for the population of interest (i.e. people with signs or symptoms of AF and who have an irregular pulse). Therefore, all the studies included in the systematic reviews assessed the diagnostic accuracy and clinical impact of lead-I ECG devices used at a single-time point to detect AF were performed in an asymptomatic population. The PRISMA[25] flow chart detailing the screening process for the review is shown in Fig 1. Studies excluded at the full-text paper screening stage with reasons for exclusion are presented in S2 Text.
Diagnostic test accuracy
We identified 13 publications[26–38] reporting on nine studies. In these studies, the index test (lead-I ECG device) was interpreted by the device algorithm or by a trained healthcare professional, including cardiologists, electrophysiologists and general practitioners. All studies used a 12-lead ECG device interpreted by a trained healthcare professional as the reference standard. The characteristics of the nine included diagnostic test accuracy studies are summarised in Table 1. All studies were assessed for risk of bias and applicability using the QUADAS-2 tool[10] and a summary of the results is presented in S9 Table.
Interpreter of lead-I ECG: Trained healthcare professional
Data from four studies[28, 29, 31, 36] contributed to the meta-analyses (two studies of Kardia Mobile,[31, 36] one study of Zenicor-ECG[29] and one study of MyDiagnostick and Kardia Mobile).[28] The main meta-analysis (number of AF cases = 118, total N = 580), indicated that the pooled sensitivity of lead-I ECG devices was 93.9% (95% CI: 86.2% to 97.4%) and pooled specificity was 96.5% (95% CI: 90.4% to 98.8%) (Fig 2). The SROC plot which shows the individual study results as well as the meta-analysis result is presented in S6A Fig. Across the sensitivity analyses, numerical results were similar; pooled sensitivity values ranged from 89.8% to 94.3% and pooled specificity values ranged from 95.6% to 97.4%.
CI = confidence interval; EP1 = electrophysiologist 1; FN = false negative; FP = false positive; TN = true negative; TP = true positive.
Interpreter of lead-I ECG: Algorithm
Data from four studies[28, 33–35] were included in the meta-analyses (two studies of MyDiagnostick,[34, 35] one study of Kardia Mobile,[33] and one study MyDiagnostick and Kardia Mobile).[28] Meta-analysis (number of AF cases = 219, total N = 842) showed a pooled sensitivity of 96.2% (95% CI: 86.0% to 99.0%) and pooled specificity was 95.2% (95% CI: 92.9% to 96.8%). SROC plot is presented in S6B Fig. Numerical results were similar across the sensitivity analyses; pooled sensitivity values ranged from 88.0% to 96.2% and pooled specificity values ranged from 94.4% to 97.2%.
A summary of the results from the meta-analyses are presented in Table 2.
Clinical impact
We identified 24 publications[26–34, 38–52] reporting on 19 studies with a total of 33,993 participants. The index tests evaluated included ImPulse (one study),[50] Kardia Mobile (12 studies), [31, 33, 38, 40, 41, 43, 44, 46, 48, 49, 51, 52] MyDiagnostick (four studies),[34, 39, 45, 47] Zenicor ECG (one study)[29] and MyDiagnostick and Kardia Mobile (one study).[28] Test failure rate was reported in nine studies[28, 31, 39, 43, 44, 47–50] and ranged from 0.1% to 9%. Results for test failure rate included both failure of the lead-I ECG algorithm to produce a result and poor quality of the lead-I ECG trace. Diagnostic yield was reported in 13 studies.[28, 34, 39, 41, 43–49, 51, 52] The percentage of new patients diagnosed with AF ranged from 0.4% to 5.8%. Data for this outcome were considered too heterogeneous for a pooled estimate to be clinically meaningful. Only one study[28] reported the concordance between lead-I ECG devices (Kardia Mobile and MyDiagnostick) observing no difference in agreement between the devices. Two studies[46, 48] reported a change in treatment management following the use of the Kardia Mobile lead-I ECG in new patients diagnosed with AF. Acceptability of lead-I ECG devices was reported in four studies,[41, 45, 46, 49] with generally positive views from patients and healthcare staff. Full clinical impact results and quality assessment of studies included is presented in the study monograph.[53]
Cost effectiveness
Four base case scenarios were investigated to estimate cost effectiveness depending on the waiting times for a 12-lead ECG test (2 days or 14 days) and the location of the 12-lead ECG test (primary or secondary care). Pairwise cost effectiveness results assuming the 12-lead ECG was carried out in primary care and 2 days to 12-lead ECG (Base Case 1) for each index test versus the standard diagnostic pathway are presented in Table 3 and incremental analysis results are shown in Table 4. Costs and QALYs generated in Base Case 1 are shown in S10A and S10B Table. Results for the other three base case scenarios are presented in S11A–S11L Table.
The results of the pairwise analysis show that all lead-I ECG tests generated ICERs per QALY gained below the £20,000-£30,000 threshold usually considered to be cost effective by NICE. Kardia Mobile was the most cost effective option out of all the lead-I ECG tests included in the analysis, as it cost less and generated more benefits than each of the other devices. Scenario analyses were undertaken to investigate the impact on the ICER per QALY gained of varying some of the base case assumptions. Scenario analyses are presented in S1 Scenarios.
Each lead-I ECG test identified more AF cases than the standard diagnostic pathway. This came at a higher cost but with greater overall patient benefit in terms of mortality and quality of life. More patients were diagnosed following a lead-I ECG test due to the assumption that patients with paroxysmal AF would be in AF at the time of the initial consultation and that this would be captured by the lead-I ECG test. Some patients with paroxysmal AF would not be in AF at the time of a 12-lead ECG in the standard diagnostic pathway and so would remain undiagnosed. The extra cost of the lead-I pathway was primarily due to more patients receiving anticoagulant treatment, which was offset substantially but not entirely by a decrease in CVE rate (due to more patients with AF receiving treatment) and the associated lower cost of treating CVEs, particularly strokes. Lead-I ECGs were also associated with greater patient benefit in terms of lower mortality and higher quality of life as a result of experiencing fewer CVEs. This benefit may be reduced marginally by increased risk of clinically relevant bleeds due to more people receiving anticoagulant therapy. There was some extra cost and benefit associated with diagnosing patients more quickly than in the standard diagnostic pathway, but these were minimal.
Discussion
No studies were identified that evaluated the diagnostic accuracy or the clinical impact of lead-I ECG devices in people presenting to primary care with signs or symptoms of AF and an irregular pulse. Consequently, the review focused on an asymptomatic population as pre-specified in the protocol.[4] We considered an asymptomatic population to comprise people not presenting with symptoms of AF, with or without a previous diagnosis of AF. These patients could have had co-existing cardiovascular conditions or could have been attending a cardiovascular clinic but did not present with signs or symptoms of AF. It is plausible that, if the population in the review had been people with signs or symptoms of AF and an irregular pulse, the sensitivity of lead-I ECG devices where the trace was interpreted by a trained healthcare professional would have been higher. However, it is also plausible that, in such a population, the specificity of lead-I ECG devices where the trace was interpreted by a trained healthcare professional would have been lower.
In the included studies, the sensitivity of lead-I ECG devices ranged from 80% to 100% and specificity ranged from 76% to 99% when the lead-I ECG trace was interpreted by a trained healthcare professional. The sensitivity results from the meta-analyses of lead-I ECG traces interpreted by a trained healthcare professional or lead-I ECG device algorithm (92%; 95% CI: 85% to 96%)[54] were similar to the sensitivity results reported for MPP in systematic reviews (91.6%; 95% CI: 75% to 98.6%).[17] The specificity values for lead-I ECG traces interpreted by a trained healthcare professional or lead-I ECG device algorithm were relatively higher (82%; 95% CI: 76% to 88%)[54] than those reported for MPP (78.8%; 95% CI: 51% to 94.5%).[17]
Lead-I ECG devices were more cost effective when there was a longer wait to 12-lead ECG and if the 12-lead ECG is performed in hospital. The majority of the patient benefit, however, comes after diagnosis due to a greater proportion of patients being correctly diagnosed with and treated for AF when compared to the standard diagnostic pathway, even if this benefit is slightly offset by an increased number of patients incorrectly diagnosed with AF with a lead-I ECG device. The proportion of patients with paroxysmal AF is uncertain in this population. If the proportion of patients with paroxysmal AF is lower than we assumed, lead-I ECG devices would be less cost effective compared with the standard diagnostic pathway.
In line with our findings, the results of recently published economic evaluations[17, 55] suggest that lead-I ECG devices may represent a cost effective use of resources for systematic, opportunistic screening of people aged 65 years and over during a routine GP appointment. Lead-I ECG devices may be cost effective for an asymptomatic population because only people that have a positive lead-I ECG test will have a subsequent 12-lead ECG test carried out. If a lead-I ECG test or an alternative screening test were not used, people with asymptomatic AF would remain undiagnosed until the time of an event (e.g., stroke). People with asymptomatic AF who are diagnosed early and receive appropriate treatment gain health benefits in comparison to people whose AF remains undiagnosed and who do not receive treatment for AF.
Currently, NICE recommends (CG180)[5] that an ECG is performed in all people (whether symptomatic or not) in whom AF is suspected because an irregular pulse has been detected. In updates to CG180[5] novel technologies to assist in the diagnosis of AF, such as lead-I ECG devices, need to be clearly distinguished from 12-lead ECG devices.
The main limitation of our study is that there are no published data evaluating the diagnostic accuracy, clinical impact or cost effectiveness of lead-I ECG devices for people presenting to primary care with signs or symptoms of AF and an irregular pulse. However, using diagnostic accuracy and clinical impact data from asymptomatic patients as a proxy, we present the results of the first economic evaluation of lead-I ECG devices for people presenting to primary care with signs or symptoms of AF and an irregular pulse; the economic evaluation considers the pathways for patients with signs or symptoms of AF and an irregular pulse presenting to the GP for an initial consultation.
Conclusions
There is no evidence available for the use of single-time point lead-I ECG devices for the detection of AF in people with signs or symptoms of AF and an irregular pulse. The results of this assessment, using diagnostic accuracy data from asymptomatic patients as a proxy, suggest that lead-I ECG devices represent a cost effective use of NHS resources compared with MPP followed by a 12-lead ECG in primary or secondary care. The current standard pathway for the diagnosis of AF shows that patients with signs or symptoms of AF and an irregular pulse are advised to have a 12-lead ECG test. Given the assumptions in our model, the use of single-time point lead-I ECG devices in primary care for the detection of AF in people with signs or symptoms of AF and an irregular pulse appears to be a cost effective use of NHS resources compared with MPP followed by a 12-lead ECG.
Supporting information
S1 Fig. Diagnostic phase—Decision tree: Standard diagnostic pathway.
https://doi.org/10.1371/journal.pone.0226671.s001
(DOCX)
S2 Fig. Diagnostic phase—Decision tree: Lead-I ECG diagnostic pathway (positive result).
https://doi.org/10.1371/journal.pone.0226671.s002
(DOCX)
S3 Fig. Diagnostic phase—Decision tree: Lead-I ECG diagnostic pathway (negative result).
https://doi.org/10.1371/journal.pone.0226671.s003
(DOCX)
S6 Fig. Summary receiver operating characteristic plots.
https://doi.org/10.1371/journal.pone.0226671.s006
(DOCX)
S2 Table. PRISMA-DTA for abstracts checklist.
https://doi.org/10.1371/journal.pone.0226671.s008
(DOCX)
S6 Table. Healthcare practitioner costs per 12-lead ECG test (primary and secondary care).
https://doi.org/10.1371/journal.pone.0226671.s012
(DOCX)
S7 Table. Mortality rates and risk ratios (no previous CVEs) used in the economic model.
https://doi.org/10.1371/journal.pone.0226671.s013
(DOCX)
S8 Table. Cardiovascular and adverse event rates.
https://doi.org/10.1371/journal.pone.0226671.s014
(DOCX)
S9 Table. QUADAS-2 assessment of diagnostic test accuracy studies.
https://doi.org/10.1371/journal.pone.0226671.s015
(DOCX)
S10 Table. Base case 1 costs, QALYs and patient outcomes.
https://doi.org/10.1371/journal.pone.0226671.s016
(DOCX)
S3 Text. References that appear only in Supplementary Information.
https://doi.org/10.1371/journal.pone.0226671.s020
(DOCX)
Acknowledgments
The authors would like to thank Sophie Beale (Research Associate, LRiG, University of Liverpool) for her feedback on a draft version of the NIHR report.
References
- 1.
National Institute for Health and Care Excellence (NICE). Clinical knowledge summaries: atrial fibrillation. 2015. Available from: https://cks.nice.org.uk/atrial-fibrillation#!topicsummary [accessed January 2018].
- 2. Kirchhof P, Benussi S, Kotecha D, Ahlsson A, Atar D, Casadei B, et al. 2016 ESC guidelines for the management of atrial fibrillation developed in collaboration with EACTS. Eur Heart J. 2016;37:2893–62. pmid:27567408
- 3.
Public Health England. Atrial fibrillation prevalence estimates in England: application of recent population estimates of AF in Sweden. 2017. Available from: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/644869/atrial_fibrillation_AF_briefing.pdf [accessed January 2018].
- 4. Duarte R, Stainthorpe A, Greenhalgh J, Richardson M, Marshall T, Hall M, et al. The clinical and cost effectiveness of lead-I electrocardiogram (ECG) devices for detecting atrial fibrillation using single-time point testing in primary care—Protocol 2018. Available from: https://www.nice.org.uk/guidance/dg35/documents/final-protocol.
- 5.
National Institute for Health and Care Excellence (NICE). Atrial fibrillation: management. clinical guideline CG180. 2014. Available from: https://www.nice.org.uk/guidance/cg180/chapter/Introduction [accessed January 2018].
- 6.
Centre for Reviews and Dissemination. Systematic reviews: CRD's guidance for undertaking systematic reviews in health care. 2009. Available from: http://www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3.htm [accessed January 2018].
- 7.
National Institute for Health and Care Excellence (NICE). Diagnostic assessment programme manual [Internet] 2011. Available from: http://www.nice.org.uk/media/A0B/97/DAPManualFINAL.pdf [accessed January 2018].
- 8.
Cochrane Diagnostic Test Accuracy Working Group. Handbook for DTA reviews. 2009. Available from: http://srdta.cochrane.org/handbook-dta-reviews [accessed January 2018].
- 9. McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. Jama. 2018;319(4):388–96. Epub 2018/01/25. pmid:29362800.
- 10. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine. 2011;155:529–36. pmid:22007046
- 11. Herzog R, Alvarez-Pasquin MJ, Diaz C, Del Barrio JL, Estrada JM, Gil A. Are healthcare workers' intentions to vaccinate related to their knowledge, beliefs and attitudes? A systematic review. BMC public health. 2013;13:154. Epub 2013/02/21. pmid:23421987; PubMed Central PMCID: PMC3602084.
- 12.
Wells G, Shea B, O'Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Ottawa Hospital Research Institute: 2012.
- 13. Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59 (12):1331–2; author reply 2–3. Epub 2006/11/14. pmid:17098577.
- 14. Takwoingi Y, Guo B, Riley RD, Deeks JJ. Performance of methods for meta-analysis of diagnostic test accuracy with few studies or sparse data. Stat Methods Med Res. 2017;26(4):1896–911. Epub 2015/06/28. pmid:26116616; PubMed Central PMCID: PMC5564999.
- 15. Adderley NJ, Ryan R, Nirantharakumar K, Marshall T. Prevalence and treatment of atrial fibrillation in UK general practice from 2000 to 2016. Heart. 2018.
- 16. Piccini JP, Simon DN, Steinberg BA, et al. Differences in clinical and functional outcomes of atrial fibrillation in women and men: two-year results from the orbit-af registry. JAMA Cardiology. 2016;1(3):282–91. pmid:27438106
- 17. Welton NJ, McAleenan A, Thom HH, Davies P, Hollingworth W, Higgins JP, et al. Screening strategies for atrial fibrillation: a systematic review and cost-effectiveness analysis. Health Technol Assess. 2017;21(29):1–236. Epub 2017/06/21. pmid:28629510.
- 18. Engdahl J, Andersson L, Mirskaya M, Rosenqvist M. Stepwise screening of atrial fibrillation in a 75-year-old population: implications for stroke prevention. Circulation. 2013;127(8):930–7. Epub 2013/01/25. pmid:23343564.
- 19. Aronsson M, Svennberg E, Rosenqvist M, Engdahl J, Al-Khalili F, Friberg L, et al. Cost-effectiveness of mass screening for untreated atrial fibrillation using intermittent ECG recording. Europace. 2015;17(7):1023–9. Epub 2015/04/15. pmid:25868469.
- 20. Svennberg E, Engdahl J, Al-Khalili F, Friberg L, Frykman V, Rosenqvist M. Mass Screening for Untreated Atrial Fibrillation: The STROKESTOP Study. Circulation. 2015;131(25):2176–84. Epub 2015/04/26. pmid:25910800.
- 21.
NHS Digital. Quality and outcomes framework (QOF) - 2016–2017. 2017. Available from: https://digital.nhs.uk/catalogue/PUB30124 [accessed January 2018].
- 22. Mathisen SM, Dalen I, Larsen JP, Kurz M. Long-Term Mortality and Its Risk Factors in Stroke Survivors. Journal of stroke and cerebrovascular diseases: the official journal of National Stroke Association. 2016;25(3):635–41. Epub 2016/01/08. pmid:26738815.
- 23. Berg J, Lindgren P, Nieuwlaat R, Bouin O, Crijns H. Factors determining utility measured with the EQ-5D in patients with atrial fibrillation. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2010;19(3):381–90. Epub 2010/01/29. pmid:20108048.
- 24. The EuroQol Group. EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990; 16(3):199–208. Epub 1990/11/05. pmid:10109801.
- 25. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339.
- 26. Desteghe L, Raymaekers Z, Vijgen J, Dilling-Boer D, Koopman P, Schurmans J, et al. Accuracy and cost-effectiveness of two handheld electrocardiogram recorders to screen for atrial fibrillation in a hospital setting. Eur Heart J. 2016;37 (Supplement 1):1265. http://dx.doi.org/10.1093/eurheartj/ehw434. pmid:612285808.
- 27. Desteghe L, Raymaekers Z, Vijgen J, Dilling-Boer D, Koopman P, Schurmans J, et al. Accuracy and usability of handheld electrocardiogram recorders to detectatrial fibrillation in hospitalised patients. Europace. 2016;18 (Supplement 1):i177. http://dx.doi.org/10.1093/europace/euw158. pmid:617786028.
- 28. Desteghe L, Raymaekers Z, Lutin M, Vijgen J, Dilling-Boer D, Koopman P, et al. Performance of handheld electrocardiogram devices to detect atrial fibrillation in a cardiology and geriatric ward setting. Europace. 2017;19(1):29–39. pmid:26893496.
- 29. Doliwa PS, Frykman V, Rosenqvist M. Short-term ECG for out of hospital detection of silent atrial fibrillation episodes. Scand Cardiovasc J. 2009;43(3):163–8. Epub 2008/12/20. pmid:19096977.
- 30. Haberman ZC, Jahn RT, Bose R, Tun H, Shinbane JS, Doshi RN, et al. Wireless smart phone equipped ECG enables large scale screening in diverse populations. Heart Rhythm. 2014;1):S312. http://dx.doi.org/10.1016/j.hrthm.2014.03.031. pmid:71427925.
- 31. Haberman ZC, Jahn RT, Bose R, Tun H, Shinbane JS, Doshi RN, et al. Wireless smartphone ECG enables large-scale screening in diverse populations. J Cardiovasc Electrophysiol. 2015;26(5):520–6. pmid:25651872.
- 32. Lau J, Lowres N, Neubeck L, Brieger DB, Sy RW, Galloway C, et al. Validation of an iphone ECG application suitable for community screening for silent atrial fibrillation: a novel way to prevent stroke. Circulation Conference: American Heart Association. 2012;126(21 SUPPL. 1). pmid:70955633.
- 33. Lau JK, Lowres N, Neubeck L, Brieger DB, Sy RW, Galloway CD, et al. iPhone ECG application for community screening to detect silent atrial fibrillation: a novel technology to prevent stroke. Int J Cardiol. 2013;165(1):193–4. Epub 2013/03/08. pmid:23465249.
- 34. Tieleman RG, Plantinga Y, Rinkes D, Bartels GL, Posma JL, Cator R, et al. Validation and clinical use of a novel diagnostic device for screening of atrial fibrillation. Europace. 2014;16(9):1291–5. pmid:24825766.
- 35. Vaes B, Stalpaert S, Tavernier K, Thaels B, Lapeire D, Mullens W, et al. The diagnostic accuracy of the MyDiagnostick to detect atrial fibrillation in primary care. BMC family practice. 2014;15:113. pmid:24913608.
- 36. Williams J, Pearce K, Benett I. The effectiveness of a mobile ECG device in identifying AF: sensitivity, specificity and predictive value. Br J Cardiol. 2015;22:70–2.
- 37. Crockford CJ, Ahmed O, Kaba R, Berry R. An analysis of the applicability of lead1 screening for cardiac arrhythmia in primary care settings using novel sensing technology & multiple commercial algorithms for automating detection to increase PPV of referrals for further investigation. Europace. 2013; 4):iv20. http://dx.doi.org/10.1093/europace/eut317. pmid:71254381.
- 38. Koltowski L, Balsam P, Glowczynska R, Peller M, Maksym J, Blicharz L, et al. Comparison of kardia mobile (one lead ECGs records) with 12-lead ECGs in 100 consecutive patients with various cardiovascular disorders. Europace. 2017;19 (Supplement 3):iii353. pmid:618768329.
- 39. Battipaglia I, Gilbert K, Hogarth AJ, Tayebjee MH. Screening for atrial fibrillation in the community using a novel ECG recorder. J Atr Fibrillation. 2016;9(2):1433. Epub 2016/12/03. pmid:27909536; PubMed Central PMCID: PMC5129689.
- 40. Orchard J, Freedman SB, Lowres N, Peiris D, Neubeck L. iPhone ECG screening by practice nurses and receptionists for atrial fibrillation in general practice: the GP-SEARCH qualitative pilot study. Australian family physician. 2014;43(5):315–9. pmid:24791776
- 41. Chan LL, Chan SC, Yan BP. Feasibility and acceptability of atrial fibrillation screening using a hand-held ECG device in general practice setting in Hong Kong. Value in Health. 2017;20 (9):A599. http://dx.doi.org/10.1016/j.jval.2017.08.1136. pmid:619024614.
- 42. Chan NY, Choy CC. Community screening for atrial fibrillation in a Chinese population using a smartphone-based wireless single-lead ECG. J Am Coll Cardiol. 2015;1:A467. pmid:71833524.
- 43. Chan NY, Choy CC. Screening for atrial fibrillation in 13 122 Hong Kong citizens with smartphone electrocardiogram. Heart. 2016a;12. http://dx.doi.org/10.1136/heartjnl-2016-309993. pmid:613158288.
- 44. Chan PH, Wong CK, Poh YC, Pun L, Leung WW, Wong YF, et al. Diagnostic performance of a smartphone-based photoplethysmographic application for atrial fibrillation screening in a primary care setting. J Am Heart Assoc. 2016b;5(7). Epub 2016/07/23. pmid:27444506; PubMed Central PMCID: PMC5015379.
- 45. Gibson J, Hanjari M, Watkins C, Chauhan U. Opportunistic detection of atrial fibrillation in primary care: a mixed methods evaluation of the introduction of new healthcare technology. Eur Stroke J. 2017;2 (1 Supplement 1):112. http://dx.doi.org/10.1177/2396987317705242. pmid:616966470.
- 46. Hussain W, Thakrar D. The use of a handheld device in identifying atrial fibrillation patients during flu vaccination clinics. Europace. 2016;18 (Supplement 2):ii19. http://dx.doi.org/10.1093/europace/euw268. pmid:617764330.
- 47. Kaasenbrood F, Hollander M, Rutten FH, Gerhards LJ, Hoes AW, Tieleman RG. Yield of screening for atrial fibrillation in primary care with a hand-held, single-lead electrocardiogram device during influenza vaccination. Europace. 2016;18(10):1514–20. pmid:26851813.
- 48. Lowres N, Neubeck L, Salkeld G, Krass I, McLachlan AJ, Redfern J, et al. Feasibility and cost-effectiveness of stroke prevention through community screening for atrial fibrillation using iPhone ECG in pharmacies. the SEARCH-AF study. Thromb Haemost. 2014;111(6):1167–76. Epub 2014/04/02. pmid:24687081.
- 49. Orchard J, Lowres N, Freedman SB, Ladak L, Lee W, Zwar N, et al. Screening for atrial fibrillation during influenza vaccinations by primary care nurses using a smartphone electrocardiograph (iECG): a feasibility study. Eur J Prev Cardiol. 2016;23(2_suppl):13–20. http://dx.doi.org/10.1177/2047487316670255. pmid:613012263.
- 50.
Reeves B. Preliminary evaluation of the viewing function of the imPulse ECG monitor. NR.
- 51.
Waring O, Davidson N, Stout M, Pearce K. Detection of atrial fibrillation in community locations using novel technology's as a method of stroke prevention in the over 65's asymptomatic population—should it become standard practise? Europace Conference: heart rhythm congress 2016 United kingdom [Internet]. 2016; 18:[ii39 p.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/744/CN-01406744/frame.html [Accessed June 2018].
- 52. Yan BPY, Chan LLY, Lee VWY, Freedman B. Medical outpatient clinics an ideal setting for atrial fibrillation screening using a handheld single-lead ECG with automated diagnosis. Eur Heart J. 2016;37 (Supplement 1):888. http://dx.doi.org/10.1093/eurheartj/ehw433. pmid:612283606.
- 53. Duarte R, Stainthorpe A, Greenhalgh J, Richardson M, Nevitt S, Mahon J, et al. Lead-I ECG for detecting atrial fibrillation in patients with an irregular pulse using single time point testing: a systematic review and economic evaluation. Health Technol Assess. [in press].
- 54. Taggar JS, Coleman T, Lewis S, Heneghan C, Jones M. Accuracy of methods for detecting an irregular pulse and suspected atrial fibrillation: A systematic review and meta-analysis. Eur J Prev Cardiol. 2016;23(12):1330–8. Epub 2015/10/16. pmid:26464292; PubMed Central PMCID: PMC4952027.
- 55. Jacobs MS, Kaasenbrood F, Postma MJ, Van Hulst M, Tieleman RG. Cost-effectiveness of screening for atrial fibrillation in primary care with a handheld, single-lead electrocardiogram device in the Netherlands. Europace. 2018;20(1):12–8. pmid:27733465.