Correction
26 Oct 2012: Cresswell K, Morrison Z, Kalra D, Sheikh A (2012) Correction: “There Are Too Many, but Never Enough": Qualitative Case Study Investigating Routine Coding of Clinical Information in Depression. PLOS ONE 7(10): 10.1371/annotation/48c1ae80-d961-4c30-b966-243f010a0a1b. https://doi.org/10.1371/annotation/48c1ae80-d961-4c30-b966-243f010a0a1b View correction
Figures
Abstract
Background
We sought to understand how clinical information relating to the management of depression is routinely coded in different clinical settings and the perspectives of and implications for different stakeholders with a view to understanding how these may be aligned.
Materials and Methods
Qualitative investigation exploring the views of a purposefully selected range of healthcare professionals, managers, and clinical coders spanning primary and secondary care.
Results
Our dataset comprised 28 semi-structured interviews, a focus group, documents relating to clinical coding standards and participant observation of clinical coding activities. We identified a range of approaches to coding clinical information including templates and order entry systems. The challenges inherent in clearly establishing a diagnosis, identifying appropriate clinical codes and possible implications of diagnoses for patients were particularly prominent in primary care. Although a range of managerial and research benefits were identified, there were no direct benefits from coded clinical data for patients or professionals. Secondary care staff emphasized the role of clinical coders in ensuring data quality, which was at odds with the policy drive to increase real-time clinical coding.
Conclusions
There was overall no evidence of clear-cut direct patient care benefits to inform immediate care decisions, even in primary care where data on patients with depression were more extensively coded. A number of important secondary uses were recognized by healthcare staff, but the coding of clinical data to serve these ends was often poorly aligned with clinical practice and patient-centered considerations. The current international drive to encourage clinical coding by healthcare professionals during the clinical encounter may need to be critically examined.
Citation: Cresswell K, Morrison Z, Sheikh A, Kalra D (2012) “There Are Too Many, but Never Enough": Qualitative Case Study Investigating Routine Coding of Clinical Information in Depression. PLoS ONE 7(8): e43831. https://doi.org/10.1371/journal.pone.0043831
Editor: James Coyne, University of Pennsylvania, United States of America
Received: April 27, 2012; Accepted: July 30, 2012; Published: August 24, 2012
Copyright: © Cresswell et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This report is independent research commissioned by the National Health Service (NHS) Connecting for Health Evaluation Programme. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NHS Connecting for Health Evaluation Programme, or the Department of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Information technology is increasingly used to facilitate the safety and efficiency of healthcare [1]. Systems rely upon real-time structured electronic data capture, often using coding (the activity of assigning a code to information in order to classify it), to process information in relation to, for example, performance measures, resource allocation, medical research, and billing [2]–[4]. In doing so, clinical statements (these may include medical diagnoses) within a classification system are assigned numerical values or clinical codes. There is therefore currently an increasing drive to achieve clinical coding by healthcare professionals at the point of care [5]. However, structured data entry systems also need to satisfy the clinical needs of users (often referred to as ‘clinical utility’) [6]–[9] and facilitate information exchange between different care settings in increasingly fragmented healthcare systems [4], [7], [10], [11].
Although in many countries coding of clinical information is used primarily for billing purposes (e.g. Canada and the United States of America (USA)), this is less common in the United Kingdom (UK) which has a publicly-funded national health service. Here, the coding of clinical information is focused on demographic details, diagnoses, reasons for encounters, numeric results, prescriptions, assessment scales and chronic disease monitoring datasets. The primary aims are to support care management, clinical decision making, adherence to guidelines, contributions to reimbursement, and less commonly, research. UK secondary care depression services use the ICD-10 (International Classification of Diseases 10th Revision) classification system for coding diagnoses, whilst GPs use Read Codes (a clinical coding system purchased by the UK government and used in primary care). Across countries, clinical coding is often carried out at the end of the consultation, after the healthcare professional has collected and recorded all relevant historical and examination data and there is an increasing drive towards adopting national terminologies that are drawn on across electronic systems facilitating data exchange between settings [12]. This poses significant new challenges for coding of clinical information when compared to paper-based record systems.
Mental health offers important insights into the challenges associated with electronic clinical coding and with classification systems: complex information is predominantly recorded as free-text narrative and diagnoses tend to be formulated over lengthy periods of time, which makes clinical coding of diagnoses extremely challenging. However, existing mental disorders classification systems may lack clinical utility [6], [7]. They are often perceived to fail to accommodate existing clinical practices as well as communication needs between care settings, resulting in a lack of immediate patient care benefits [6], [7]. This shortcoming is also recognized by the World Health Organization (WHO), which advocates that “a mental health information system is a system for action: it should exist not simply for the purpose of gathering data, but also for enabling well-informed decision-making" [4].
So why do coding and classification systems for mental disorders frequently fall short of clinical utility? Although there is a dearth of empirical work in this area, many have argued that existing systems do not appropriately reflect the reality and specific characteristics of mental healthcare [6], [13], [14]. They are often based on more physical diagnoses and are not well suited to accounting for multi-disciplinary, multi-agency care pathways [8], [13]. Concerns have also been expressed that diagnostic systems may mask the complexity of disorders and may lead clinicians to focus on symptoms present in a classification system, whilst potentially neglecting other significant factors such as contextual dynamics (e.g. social circumstances) [14]–[16].
Whilst clinical utility is clearly essential, it is also very important that managerial needs are met. We sought to explore how a balance in this respect may be achieved and if and how mental health information systems contribute to clinical decision-making. In doing so, we explored how clinical information relating to depression is structured and/or coded in primary and secondary care settings and the viewpoints of, and implications for, different stakeholders.
Materials and Methods
As mental health is a large area, we focused on the area of depression as one of the most common mental disorders with numbers steadily increasing worldwide [16], [17]. Internationally, depression is usually diagnosed and treated in primary care [18]. Clinical codes across care settings are most commonly mapped onto the ICD-10 (developed by the WHO) and the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition published by the American Psychiatric Association [19]–[21].
Design
We conceptualized the disorder depression as a case in order to focus our data collection activities. This case study design allowed us to explore the phenomenon of interest (i.e. routine coding of clinical information in depression) within context, drawing on multiple sources of evidence.[22]–[26] We collected qualitative data from a range of stakeholders and geographical locations, spanning primary and secondary care settings in the UK over a period of four months. Exploring a range of NHS information structures within the UK (i.e. primary and secondary care settings) and obtaining data from a variety of qualitative data sources, allowed us to gain an insight into context-specific and cross-cutting issues relating to clinical coding in depression within one political setting.
Our data collection and analysis strategy was theoretically informed drawing on sociotechnical principles [25], [26]. In essence, this approach emphasizes the interrelated nature of social and technical dimensions and we therefore sampled individual participants on the basis of their relationship with coding of clinical computerized information relating to depression, exploring how individual behaviors shaped technical outputs and vice versa.
Ethical and Site-specific Approvals
We obtained ethical approval from the Brighton West Ethics Committee (Reference: 10/H1111/25). Site-specific approvals, advanced disclosures and honorary contracts were obtained for the lead researcher (KC). Written informed consent was obtained from all participants and data obtained were anonymised.
Recruitment of Participants
We initially purposefully sampled a range of academic General Practitioners (GPs) with an interest in clinical coding and/or depression through personal contacts [27]. Interviews with academic GPs helped to provide an insight into secondary uses of data for research purposes and a preliminary overview of clinical coding practice as well as tensions in the primary care setting. Participants were asked to recommend other potential informants, which helped us to snowball sample additional primary care stakeholders including those with no particular interest in clinical coding as well as clinical coders.
We also recruited secondary care staff at a mental health Trust (our main secondary care research site) identified through the UK Clinical Research Network [28], purposefully sampling diverse stakeholders with an insight into depression and/or clinical coding practices, including healthcare professionals (i.e. nurses, doctors, allied health professionals), managers and clinical coders [27]. This allowed exploring the dynamics of everyday clinical depression coding from a variety of perspectives. Participant characteristics and their involvement in data collection activities are summarized in Table 1.
Data Generation and Handling
Our work was informed by a review of the existing literature and involved a combination of 28 semi-structured face-to-face and telephone interviews (our main data source), a focus group with clinical coders, a two-hour period of participant observation of selected clinical coding activities in primary care, and collection of documents to aid understanding of context (e.g. information on clinical coding standards). We gathered data from a variety of data sources to facilitate the credibility of our findings (triangulation). Our overall dataset is summarized in Table 2.
Key issues explored included attitudes towards clinical coding in relation to depression; perceived benefits, barriers and facilitators; and recommendations for improvement (Table 3).
Topic guides were tailored to the roles of individual participants and refined throughout the research, with emerging issues being recorded as field notes and used to inform subsequent rounds of data collection. Interviews were informal and centered on issues that interviewees perceived to be important.
A focus group with clinical coders working in secondary care and participant observation of clinical coding in primary care were undertaken to complement interviews and provide greater understanding of the context in which coding decisions are made [29]. The observation involved the researcher practicing clinical coding on dummy patients (i.e. coding diagnoses and symptoms on fictional patients that were used for training system users locally) whilst discussing activities with the relevant healthcare professional. This exercise helped to provide insights into the experiential aspects of clinical coding activity and facilitated the credibility of our findings. Data collection continued until no new themes emerged. Transcribed interview and focus group data, as well as observation and field notes were uploaded into NVivo8 software [30].
Analysis
Data collection and analysis took place concurrently to allow emerging issues to be fed back into future data collection. A coding framework was developed and refined based on the topic guide and literature review to include the following themes: background and context (relating to systems, interviewees and settings); existing practices; definitions and diagnoses; facilitators and barriers to structuring and/or coding of clinical information in depression; perceived benefits; and recommendations for improvement. In addition to this deductive approach, inductive approaches were employed to allow new themes to emerge from the data [31]. The lead researcher (KC, a psychologist with experience in qualitative health services research, particularly in relation to the use of IT in healthcare) coded the data, combining different data sources within the coding framework in order to look for patterns of convergence, maintaining a field journal throughout the process in order to capture key analytical processes. Existing and emerging findings were discussed in designated analysis workshops with the extended research team exploring inconsistencies and unexpected findings seeking novel and potentially unexplored evidence [32]. Analytic themes were extracted based on frequency of occurrence and relevance.
Results
Three main themes emerged from the analysis (Table 4). These themes are examined in detail below, illustrated with quotes from the data.
Varying Contexts and Practices Surrounding the Coding of Clinical Information in Depression
Most participants stated that contexts and conditions in depression were distinct from other “more biomedical" areas of care: disorders were felt to be difficult to define, care occurred over periods of time with often changing pathways, and wide variations in responsiveness to treatment. Consequently, there were often no prescribed care pathways once a diagnosis of a mental disorder had been made.
Although certain information would be coded (e.g. symptoms and diagnoses), this was almost always accompanied by free text (e.g. investigation findings and treatment plans) to reflect the subtleties of a patient’s situation and the thoughts and feelings of the practitioner.
“…actually often a mental health consultation will just exist in history, and in that history chunk will be…feeling more depressed this time, what’s been going on…and even my thoughts and formulation may all just sit in that box [of free text] because actually it comes out of my head in one chunk that is…three or four lines of text."
(Interview 1, Academic GP).
GPs coded clinical information relating to symptoms, diagnoses, history, and investigations. In the UK, depression is included in a centrally-led payment incentive scheme, the Quality and Outcomes Framework [33], which requires GP practices to submit activity levels in relation to certain conditions to commissioners in order to get paid.
Secondary care clinical coding included:
- •Interventions/activities (e.g. assessment of mental state, cognitive testing) – nurses and allied health professions;
- •Admission diagnoses/review and discharge diagnoses - doctors for inpatients only;
- •Clustering adult mental health users to diagnostic pathways – nurses and allied health professions.
We found the use of computer systems and associated clinical coding practices to be well established in UK primary, but regarded as a relatively recent development in secondary care. Perhaps as a result of this, GPs did some clinical coding during the clinical encounter, whilst in our secondary care site doctors’ diagnoses were coded by a designated clinical coding team (although some clinical intervention and cluster coding was done by other healthcare professionals). The fact that secondary care depression services and GPs used different coding and classification systems, was attributed to differing patient needs. Whilst the majority of depression is diagnosed and treated in primary care, secondary care tends to manage the more severe spectrum of depressive disorders and may therefore need more granular diagnostic classification:
“I mean psychiatrists have always had lots of codes…the fine grained detail in my opinion of diagnosis at that level is more relevant than it is in primary care."
(Interview 1, Academic GP).
Differences in systems and associated clinical coding practices were apparent in both primary and secondary care settings. Such systems variations made it more difficult to obtain comparable data sets for research purposes:
“…that’s another problem that we’re encountering with our research cos we’re getting information from…sort of twenty odd GP surgeries in South London and there’s striking differences between [name of a primary care computer system] which is by far and away the best and these other systems which are chaotic in terms of how they organize…information."
(Interview 7, Academic GP).
In some systems, users could ignore requests to code clinical information and focus only on free text. This was commonly the case in primary care, facilitating greater user autonomy. Our main secondary care research site had implemented a “home-grown" computer system which mandated some clinical coding by nurses and allied health professions preventing the user progressing to a different screen unless a clinical code had been picked. The “home-grown" nature was in many ways perceived to be an advantage, as it was relatively easy to tailor associated clinical codes.
“…we can develop the system to capture what we need very quickly, it’s quite responsive and that’s kind of put us streets ahead of the other Trusts in that respect."
(Interview 19, Research Nurse, Secondary Care).
At the time of data collection, there was no unified clinical coding system between primary and secondary care and no software to map between clinical codes. Upon transfer between care settings, patient information had to be re-coded, which was viewed as a duplication of effort.
“They [GPs] all use different [clinical codes] and their computer system doesn’t link up with ours so none of the codes match across primary and secondary…"
(Interview 24, Cognitive Behavioral Therapist, Secondary Care).
Lack of Direct Patient Care Benefits and a Number of Risks Surrounding the Coding Clinical Data in Depression
The perceived benefits of coding clinical information were mainly noted as the opportunity to readily access information for management and research purposes. Coded clinical information was also suggested as being useful for clinical audits (performed as an internal peer review activity), not only for organizations, but also for individual teams as it allowed an insight into activity levels, helped to monitor patient populations, and to prioritize the allocation of resources.
“It’s about teams understanding their own activities…admission rates, discharge rates, average patient stay, average age of patients…which from a team point of view is very helpful for us to understand what’s going on in any given month really…"
(Interview 20, Ward Manager with nursing background, Secondary Care).
Despite these indirect benefits to patients, most clinically practicing interviewees stated that clinical coding was designed to achieve organizational targets and offered very little value for direct patient care.
“Clinically it feels like you’re doing it really for the organization rather than for any benefits for the patients… it’s just time out that’s not helpful, it feels like you’re feeding information back…for commissioning purposes so that you get paid basically rather than it being a clinically useful tool."
(Interview 24, Cognitive Behavioral Therapist, Secondary Care).
Many clinical users therefore felt detached from the development of clinical codes, stating that coded clinical data input was a time-consuming administrative activity, which often detracted from the focus of delivering patient care. This was exacerbated by many clinical users, particularly those in secondary care, being unsure as to why they needed to record coded clinical information and what data were used for.
On a practical level, clinical users struggled to juggle the demands of data input with delivering adequate patient care for the complex demands of depressive patients in the limited time available. This was particularly pronounced in primary care, where consultations were shorter than in secondary care. Clinical coding was often viewed as a bureaucratic exercise with no particular purpose in itself and a lack of meaningful representation of clinical activity.
“… you try and talk to your patient and then quickly enter everything on to the template. But you have ten minutes. Before somebody comes in and interrupts you, will you just sign this prescription, then the phone rings and somebody says oh doctor there’s somebody in treatment room, I think they’ve got cellulitis, will you just run across and see if they need antibiotics. So you do that, so you’ve then got six minutes. For a psychiatric patient, to assess them and make all the notes. It’s not actually possible."
(Interview 13, GP).
Consequently, notes were often taken on paper and coded after the clinical encounter. This was felt to be necessary in depressed patients as there was often a significant amount of counseling involved in encounters and coding clinical information was viewed as disrupting communication flows.
“We just remember it and then at the end of the day put it in the computer who you saw and what you did, perhaps do a scribbly note to yourself of who you saw."
(Interview 26, Occupational Therapist, Secondary Care).
“… when we are seeing patients we have to talk the patient we can’t be actually sitting in front of the computer and typing…, you need to communicate with the patient you can’t just do the typing while you are taking to patients."
(Interview 30, Consultant Psychiatrist, Secondary Care).
Other underlying reasons for negative attitudes towards clinical coding amongst healthcare professionals were related to the perceived particularities of mental health disorders. For example, many interviewees raised the difficulty of fitting complex mental health conditions into coded clinical categories as they felt that context was often lost. Information reflected in free text was therefore valued, whilst clinical coding was perceived to facilitate labeling and force-fitting patients into boxes.
“Sometimes people just don’t fit the coding…and you’re actually trying to fit them into the ICD-10 rather than the ICD-10 being created to match the general public really… sometimes you are putting a square peg in a round hole."
(Interview 29, Nurse Practitioner, Secondary Care).
Clinicians found it hard to choose an appropriate clinical coding category, often picking the closest match as opposed to what they felt to be an accurate description.
As a result of perceived issues surrounding the rigidity of applying labels to complex mental health conditions, clinicians (particularly in primary care) were often hesitant to apply diagnostic codes due to the uncertainty surrounding the persistence of symptoms and the potentially contestable nature of diagnoses.
This reluctance was further exacerbated by the potential ramifications of diagnoses beyond the clinical care setting, such as social stigma, inclusion in the mental health register, implications for insurance reports and occupational health screening.
Diagnostic coding was further complicated by perceived issues surrounding the definition of depression, due to its multi-dimensional nature and the absence of biomarkers. For example, GPs highlighted the need to be cautious in applying diagnostic labels as some individuals presenting with depressive symptoms may be merely experiencing a normal reaction to adverse life events.
“… you have to be careful with labeling people. And yes it might be you know is it a depressive episode because their serotonin levels are low? …is it because actually their partner’s just lost their job and finances are tight and actually it’s stress and worry about that which isn’t depression."
(Interview 11, GP).
Participants across care settings further expressed a tension relating to the number of clinical codes IT systems offered. On one hand, existing clinical code lists were felt to be too detailed resulting in a large number of irrelevant items, whilst, on the other hand, available clinical codes often did not accurately reflect diagnoses or interventions.
“…there’s anxiety with depression, there’s recurrent depression, there’s depressed mood, there’s loads of them, ok? So you have to select a suitable code and…they’re never exactly right …there’s either too many of them so you don’t know which one to choose or there’s not enough because the one circumstance that you’ve got sitting in front of you isn’t the one that’s got a code."
(Interview 5, Academic GP).
Strategies Employed to Align Clinical Value with Managerial Demands
Despite these difficulties and the overall perceived lack of direct patient care benefits resulting from clinical coding, when prompted, some participants valued the ability to obtain an overview of clinical information on the summary screen, the ability for different healthcare professionals to share patient information, the ability to use of coded clinical information for clinical decision support systems, and the potential of facilitating medication reviews (e.g. allowing to link problems to medications). Despite these perceived benefits, across care settings, the main incentives for clinical coding information were financial.
“I don’t see any value in encoding any specific bits of that other than a particular depression score which I get paid for recording and why else would I do it?"
(Interview 1, Academic GP).
“I think people will probably be more likely to code better. If people realize that they’re not going to get paid unless they’ve actually done things for the patient they’re more likely to put correct stuff in…"
(Interview 25, Physiotherapist, Secondary Care).
In addition, across care settings the potential of clinical coding to facilitate adherence to quality indicators was valued in the context of using templates, which were perceived to be able to guide clinical decision making by ensuring that appropriate aspects were considered. Templates, devised by individual organizations relating to various conditions and/or for different practitioners, were also perceived to address the tension between tailoring of systems to suit individual practices and the need for some degree of standardization to ensure the usefulness of coded clinical data for management and research.
“I would say that [GPs] are not interested in inputting codes…I think I’ve got more chance of them using the templates, clicking the hot spots and it automatically coding it than actually inputting the coding themselves."
(Interview 16, Quality and Outcome Framework Manager).
Moreover, and mainly in secondary care settings, clinical coders were employed to take over the responsibility for the coding of clinical information. Most clinicians stated that they would prefer clinical coders to input information for them as they were busy with providing patient care. This was seen as an acceptable compromise on quality (as their clinical coding may not be as precise as that of clinicians) and utility (as the benefit from real-time clinical coding may be lost). Others stated that clinical coding by clinicians at the point of care provided a more timely and up-to-date patient record than retrospective clinical coding by clinical coders. Increasing clinical coding by clinicians at the point of care was felt to have the potential of addressing inaccurate retrospective clinical coding by non-clinical staff.
Some participants, notably those that worked with coded clinical data outputs, also argued that clinical coders were particularly valuable in ensuring consistency. Clinical coders were viewed as experts in the field of allocating clinical codes, which was not the expertise of healthcare professionals.
“I’m sure there’s a whole host of problems, you know, without us directly inputting the information but I do know when we were inputting things into the system we were getting it wrong which meant that it was causing more problems hence it being taken back off us for the clinical information team to do."
(Interview 20, Ward Manager with nursing background, Secondary Care).
Similarly, clinical coders were often highly valued by clinicians as an expert resource and safety-net:
“…generally it [referring to clinical coders checking diagnoses with clinicians] also acts for the clinicians to avoid that mistake happening again so it becomes educational and then reduces further errors."
(Interview 30, Consultant Psychiatrist, Secondary Care).
Discussion
Summary of Main Findings
This work has revealed the range of approaches to coding clinical data on patients with depression and how these are shaped by varying contexts, information systems and practices. We have outlined how, despite the value of coding clinical information relating to depression for management and research purposes, there is a perceived lack of direct patient care benefits and a number of risks associated with clinical coding practices in this area. In exploring strategies employed to align clinical value with managerial demands, we have discussed the underlying clinical motivations to code clinical information relating to depression, as well as the potential value of employing templates and clinical coders.
Strengths and Limitations
As far as we are aware, this work is the first in-depth empirical study of the approaches to coding clinical information in depression and our findings are we believe likely to be transferable to other mental health conditions and international settings. The likely transferability of this work is further reinforced by the existing empirical literature surrounding clinical coding in other conditions, which has pointed to related concerns and issues [34]–[38]. Drawing and building on sociotechnical approaches to technology implementation employed in previous work [25], [26], has allowed a theoretically informed basis for sampling and analysis. For the period of time we spent in the field we have, we believe, reached saturation as we continued data collection until no new themes emerged.
Nevertheless, there are also some limitations including a lack of insight into system developers’ perspectives due to commercial sensitivities and our initial focus on interviewing academic GPs, which was based on pragmatic considerations, may have biased our focus towards issues that are not immediately visible to non-academic practicing clinicians (e.g. they might have attached greater value to the benefits associated with the secondary uses of data for research purposes). Our exploratory focus in an area that lacked empirical insights meant that interviews were appropriate in the context of our study. However, exploring how best to integrate different systems within complex individual user workflows and derive maximum benefits for all concerned, warrants the need for some more targeted in-depth observational work in individual settings.
Considering our Findings in the Light of the Existing Literature
We have investigated the often neglected perspectives of clinical coders and considered potential trade-offs between clinical coding by healthcare professionals during the clinical encounter and retrospectively by clinical coders. Although there is an international drive to increase clinical coding at the point of care to improve data quality [5], our results suggest that this may in practice reduce data quality by increasing inconsistencies in clinical coding. The intuitive assumption that clinical coding at the point of care is preferable should therefore be questioned.
Our results confirm the potential value of coded clinical data for managerial and research purposes, but direct patient care benefits are currently lacking as existing systems (e.g. ICD) are often designed primarily for reimbursement [3], [39]. This is despite most clinical coding efforts being invested by healthcare professionals, associated risks such as a perceived reduction in the quality of patient contact due to increased administrative activity, and concerns regarding the implications of coding patient diagnoses of often stigmatizing mental health conditions. Other systems, using clinical vocabularies (e.g. Systematized Nomenclature of Medicine-Clinical Terms, SNOMED-CT) to document,[19], [37] can be more valuable for clinical users as the clinical codes are often captured by the system as a largely background activity, later drawn upon by clinical coding professionals for other purposes. The question is therefore, whether and how clinical coding activity can be optimized by giving different sets of professionals the right tool for their respective purposes.
Different mental disorders may have diverse and overlapping biological and experiential causes [8], [16]. Despite an increasing recognition that classification and clinical coding systems need to take this complexity into account, existing systems are often viewed as inadequate resulting in inaccurate and/or unrepresentative clinical coding [3], [7], [8], [15]–[17], [40]–[42]. These tensions illustrate the need to balance classification systems without masking the unique complexity of mood disorders. These discussions are particularly relevant in the primary care setting as diagnostic decisions more contestable at the less severe end of the depressive spectrum.
Tailoring systems to individual needs, be it countries, care settings, organizations, or individual users, has frequently been proposed in the literature as a way to facilitate adoption [6], [8], [43]. This may entail giving users and/or organizations the authority to priorities categories in line with perceived need and increased involvement in the development of clinical codes [4], [43]. Our findings highlight the need to achieve a balance between tailoring of systems to promote clinical utility and a degree of standardization to allow meaningful analysis of data on a larger scale. One solution may be the combination of coded clinical data entry with free text, which has been found to improve categorization rates amongst users [44].
We have further illustrated the importance of financial incentives in promoting clinical coding activity across care settings [45], [46]. In the literature, there is some evidence that linking healthcare professional performance to payment can improve the quality of care [47]–[49], but there remains a need to explore alternative incentives, such as feedback on user performance – otherwise conditions not included in payment schemes may suffer [47]–[49].
Tensions between the need to standardize systems whilst maintaining clinical utility were also illustrated by debates surrounding the number of categories in existing mental disorders coding and classification systems. Participants felt that subcategories were becoming increasingly specific as this was desirable for research and management purposes. However, this meant that clinical users were faced with rising numbers of terms, which they often found time-consuming to browse and difficult to remember. Consequently, and in line with our work, existing studies have found that many diagnostic categories in psychiatric settings are not used at all and there is a high incidence of unspecified diagnoses [6], [7], [50]. A potential solution, frequently mentioned in the literature and also by our participants, could be to reduce the number of diagnostic categories [7], [35], [38], [51], [52], which may be achieved by grouping these together around meaningful clusters [7], [14], [41]. However, the ultimate decision will not only depend on clinical utility, but will also need to be decided on the basis of, amongst other issues, public health utility, which generally requires more granularity [8], [41].
Potential Ways Forward
Based on our work, we have a range of recommendations, which policy makers may wish to consider when deliberating strategic directions in relation to clinical coding of information in the UK mental health setting and beyond (Table 5).
In terms of overall strategy, there is a need to agree centrally determined clinical coding standards and align systems between care settings to facilitate information exchange. This will require some degree of tailoring of systems to local needs to allow effective integration within work practices. National and international quality improvement initiatives have an important potential role to play to ensure clinical coding in line with evidence-based practice.
The option of free text information capture in mental health settings is likely to be of continuing importance, but there may be value in considering a balance of coded clinical data entry and free text based on severity and type of diagnoses. For instance, whilst mild depression may need an increased amount of free text as life circumstances are often important, severe depression may be more amenable to clinical coding as patients are most likely to benefit from standardized treatments. Systems which facilitate coding of symptoms initially, followed by coding of diagnoses, would help to address the evolving nature of mental health conditions.
Finally, organizations themselves may wish to consider drawing more explicitly on the expertise of local clinical coding teams, who can advise on how best to derive clinical value from systems. Throughout, recognition of professional differences in clinical coding practices is necessary as some professions and their associated nature of work may be more amenable to clinical coding than others.
Conclusions
Our work has highlighted important aspects relating to coding clinical information in the mental health setting. In line with the existing literature, we found that this area differs in important ways from the more biomedical conditions with issues surrounding definitions, cut-off points and the evolving nature of mental disorders. We have also raised some questions relating principally to the implicitly assumed benefits of coding and classification systems. We found these to be lacking in the immediate clinical context and in relation to the drive to encourage clinical coding by healthcare professionals during the clinical encounter. Based on our findings, we have made a number of suggestions that may be considered to address existing issues and explored these from a range of strategic, technical, and organizational angles.
Overall, we feel that it is important to now take a step back and re-consider our own implicit assumptions about effectiveness and benefits, recognizing that these may be associated with significant trade-offs. This should involve deliberating why and for what purpose information is gathered on different levels including large-scale (e.g. epidemiological), organizational (e.g. management), and micro-environmental (e.g. the clinical encounter). The first step to achieving this, will involve formulating a challenge and then develop technical solutions to address this. Otherwise there is a danger that clinicians are asked to spend valuable clinical time on coding clinical information which may never be used.
Acknowledgments
We are very grateful to all interviewees who kindly gave their time and to the wider project team including Bernard Fernando, Ann Robertson, Akiko Hemmi and Rosemary Porteous. Throughout the process of undertaking this work we have had helpful support from colleagues at the NHS Connecting for Health Evaluation Programme led by Professor Richard Lilford and supported by Lee Priest, Nathalie Maillard and Jo Foster. Lee Priest kindly also represented the funders on our Independent Project Steering Committee, which was chaired by Professor Simon De Lusignan. We acknowledge the support of the National Institute for Health Research, through the Comprehensive Clinical Research Network and the Primary Care Research Network; and would like to thank the two expert reviewers who have given valuable comments on an earlier draft of this manuscript.
Author Contributions
Conceived and designed the experiments: AS DK. Performed the experiments: KC. Analyzed the data: AS KC ZM DK. Contributed reagents/materials/analysis tools: AS KC ZM DK. Wrote the paper: AS KC. Conceived this work: AS DK and BF. Led recruitment and undertook data generation and analysis: KC ZM. Led the drafting of the manuscript: KC AS. Commented on drafts: KC ZM DK AS. Guarantors: KC AS..
References
- 1. Mort M, Smith A (2009) Beyond information: Intimate relations in sociotechnical practice. Sociology 43: 215–231.
- 2. Walker J, Pan E, Johnston D, Adler-Milstein J, Bates DW, et al. (2005) The value of health care information exchange and interoperability. Health Aff W5: 10–18.
- 3. O’Malley KJ, Cook KF, Price MD, Raiford Wildes K, Hurdle JF, et al. (2005) Measuring diagnoses: ICD code accuracy. Health Serv Res 40: 1620–1639.
- 4.
World Health Organization (2005) Mental Health Policy and Service Guidance Package: Mental Health Information Systems. Switzerland: WHO.
- 5.
The Information Centre for Health and Social Care (2010) National Renal Dataset: Human Behavioural, Organisational and Technical Guidance. National Datasets Service.
- 6. Reed GM (2010) Toward ICD-11: Improving the clinical utility of WHO’s international classification of mental disorders. Professional Psychology: Research and Practice 41: 457–464.
- 7. Andrews G, Anderson TM, Slade T, Sunderland M (2008) Classification of anxiety and depressive disorders: problems and solutions. Depress Anxiety 25: 274–281.
- 8. Sartorius N (2010) Revision of the classification of mental disorders in ICD-11 and DSM-V: work in progress. Adv Psychiatr Treat 16: 2–9.
- 9. Poznyak V, Reed GM, Clark N (2011) Applying an international public health perspective to proposed changes for DSM-V. Addiction 106: 868–870.
- 10. Elphick M (2000) New mental health information strategy Psychiatric Bulletin. 24: 426–428.
- 11. McClelland R, Thomas V (2002) Confidentiality and security of clinical information in mental health practice. Adv Psychiatr Treat 8: 291–296.
- 12.
Morrison Z, Fernando B, Kalra D, Cresswell K, Robertson A, et al.. (2012). An evaluation of different levels of structuring within the clinical record. Available: http://www.birmingham.ac.uk/Documents/college-mds/haps/projects/cfhep/projects/009/NHSCFHEP009FinalReport8thFeb2012.pdf. Accessed 2012 July 12.
- 13. Rigby M, Lindmark J, Furlan PM (1998) The importance of developing an informatics framework for mental health. Health Policy 45: 57–67.
- 14. Andrews G, Goldberg DP, Krueger RF, Carpenter WT, Hyman SE, et al. (2009) Exploring the feasibility of a meta-structure for DSM-V and ICD-11: could it improve utility and validity? Psychol Med 39: 1993–2000.
- 15. Gask L, Klinkman M, Fortes S, Dowrick C (2008) Capturing complexity: The case for a new classification system for mental disorders in primary care. European Psychiatry 23: 469–476.
- 16. Joyce PR (2008) Classification of mood disorders in DSM-V and DSM-VI. Aust NZ J Psychiatry 42: 851–862.
- 17.
Office for National Statistics. Mental Health. Available: http://www.statistics.gov.uk/cci/nugget.asp?id=1333. Accessed 2012 July 12.
- 18.
NHS Information Centre. Number of people using NHS mental health services. Available: http://www.mhmdsonline.ic.nhs.uk/statistics/?report_ID=1&results_type=national&sha_ID=&provider_ID=&natyear=&n=&remember=report_ID%3D1%26results_type%3Dnational. Accessed 2012 July 12.
- 19. Brouch K (2003) AHIMA project offers insights into SNOMED, ICD-9-CM mapping process. J AHIMA 74: 52–55.
- 20.
Index of Psychiatric Disorders. Available: http://allpsych.com/disorders/disorders_alpha.html. Accessed 2012 July 12.
- 21.
Major depressive disorder. Available: http://www.allaboutdepression.com/dia_03.html. Accessed 2012 July 12.
- 22.
Stake RE (1995) The Art of Case Study Research. London: Sage Publications.
- 23.
Yin R (2009) Case Study Research, Design and Methods. London: Sage Publications.
- 24. Crowe S, Cresswell K, Robertson A, Huby G, Avery A, et al. (2011) The case study approach. BMC Med Res Methodol 11: 100.
- 25. Sheikh A, Cornford T, Barber N, Avery A, Takian, et al (2011) Implementation and adoption of nationwide electronic health records in secondary care in England: final qualitative results from a prospective national evaluation in “early adopter" hospitals. BMJ 343: d6054.
- 26. Cresswell K, Worth A, Sheikh A (2010) Actor-Network Theory and its role in understanding the implementation of information technology developments in healthcare. BMC Med Inform Decis Mak 10: 67.
- 27.
Silverman D (1985) Qualitative Methodology and Sociology. Aldershot: Gower Publishing Company Limited.
- 28.
UK Clinical Research Network. Available: http://www.ukcrc.org/infrastructure/networks/ukcrn/. Accessed 2012 July 12.
- 29. Kitzinger J (1994) The methodology of focus groups: the importance of interaction between research participants. Sociol Health Illness 16: 103–121.
- 30.
QSR International Pty Ltd (2008) NVivo qualitative data analysis software Version 9.
- 31.
Mason J (2002) Qualitative Researching. London: Sage.
- 32.
Miles MB, Huberman AM (1994) Qualitative Data Analysis. Thousand Oaks, CA: Sage.
- 33.
Clay S. QOF Mental Health and Depression Toolkit. Available: www.sheffieldiapt.shsc.nhs.uk/_documentbank/QOF_Toolkit_working.doc. Accessed 2012 July 12.
- 34. Patel VL, Kushniruk AW, Yang S, Yale JF (2000) Impact of a Computer-based Patient Record System on Data Collection, Knowledge Organization, and Reasoning. JAMIA 7: 569–585.
- 35. Rector A (1999) Clinical Terminology: Why Is it so Hard? Method Inform Med 38: 239–52.
- 36. De Lusignan (2005) The barriers to clinical coding in general practice: a literature review. Med Inform Internet Med 30: 89–97.
- 37. Herbert I (2007) CLICSIG report: Issues around compositional terminologies, SNOMED-CT in particular. Inform Prim Care 15: 193–7.
- 38. Blois MS (1980) Clinical Judgment and Computer. New Engl J Med 303: 192–197.
- 39. Stausberg J, Lehmann N, Kaczmarek D, Stein M (2008) Reliability of diagnoses coding with ICD-10. Int J Medical Inform 77: 50–57.
- 40. Sakashita C, Slade T, Andrews G (2007) Empirical investigation of two assumptions in the diagnosis of DSM-IV major depressive episode. Aust NZ J Psychiatry 41: 17–23.
- 41. Goldberg D (2010) The classification of mental disorder: a simpler system for DSM-V and ICD-11. Adv Psychiatr Treat 16: 14–19.
- 42.
Begg S, Vos T, Barker B, Stevenson C, Stanley L, et al.. (2007) The Burden of Disease and Injury in Australia. Canberra, Australia: Australian Institute of Health and Welfare.
- 43. Modai I, Valevski A (1993) Computerized patient information system in a psychiatric unit: Five-year experience. J Med Syst 17: 309–316.
- 44.
Zelingher J, Rind DM, Caraballo E, Tuttle MS, Olson NE, et al.. (1995) Categorization of free-text problem lists: an effective method of capturing clinical data. Proc Annu Symp Comput Appl Med Care: 416–420.
- 45. Garis RI, Farmer KC (2002) Examining costs of chronic conditions in a Medicaid population. Manag Care 11: 43–50.
- 46. Dixon J (2004) Payment by results: new financial flows in the NHS. BMJ 328: 969–970.
- 47. Roland M (2004) Linking physicians’ pay to the quality of care: A major experiment in the United Kingdom. N Engl J Med 351: 1448–1454.
- 48. Campbell S, Reeves D, Kontopantelis E, Middleton E, Sibbald B, et al. (2007) Quality of primary care in England with the introduction of pay for performance. N Engl J Med 357: 181–190.
- 49. Steel N, Maisey S, Clark A, Fleetcroft R, Howe A (2007) Quality of clinical primary care and targeted incentive payments: an observational study. Br J Gen Pract 57: 449–454.
- 50. Müssigbrodt H, Michels R, Malchow CP, Dilling H, Munk-Jørgensen P, et al. (2000) Use of the ICD-10 classification in psychiatry: an international survey. Psychopathology 33: 94–99.
- 51. Zimmerman M, Galione JN, Chelminski I, Young D, Dalrymple K, et al. (2010) Validity of a simpler definition of major depressive disorder. Depress Anxiety 27: 977–981.
- 52. Sytema S, Giel R, Horn GH, Balestrieri M, Davies N (1989) The reliability of diagnostic coding in psychiatric case registers. Psychol Med 19: 999–1006.