Hostname: page-component-7c8c6479df-8mjnm Total loading time: 0 Render date: 2024-03-28T16:26:35.770Z Has data issue: false hasContentIssue false

Improving treatment of depression in primary health care: a case study of obstacles to perform a clinical trial designed to implement practice guidelines

Published online by Cambridge University Press:  27 June 2014

Linda Richter-Sundberg*
Affiliation:
PhD Student, Department of Public Health and Clinical Medicine, Unit for Epidemiology and Global Health, Umeå University, Umeå, Sweden Department of Clinical Sciences, Child and Adolescent Psychiatry, Umeå University, Umeå, Sweden
Monica Elisabeth Nyström
Affiliation:
Senior Lecturer, Department of Learning, Informatics, Management and Ethics, Medical Management Center, Karolinska Institutet, Stockholm, Sweden Senior Lecturer, Department of Public Health and Clinical Medicine, Epidemiology and Global Health, Umeå University, Umeå, Sweden
Ingvar Krakau
Affiliation:
Associate Professor/District Physician, Center for Family and Community Stockholm County Council, Karolinska Institutet, Stockholm, Sweden
Christer Sandahl
Affiliation:
Professor of Social and Behavioral Sciences, Department of Learning, Informatics, Management and Ethics, Medical Management Center, KarolinskaInstitutet, Stockholm, Sweden
*
Correspondence to: Linda R. Sundberg, Epidemiology and Global Health, Umeå University, SE-901 85 Umeå, Sweden. Email: linda.sundberg@epiph.umu.se
Rights & Permissions [Opens in a new window]

Abstract

Aim

The aim of this study is to investigate factors contributing to the failure of a randomized clinical trial designed to implement and test clinical practice guidelines for the treatment of depression in primary health care (PHC).

Background

Although the occurrence of depression is increasing globally, many patients with depression do not receive optimal treatment. Clinical practice guidelines for the treatment of depression, which aim to establish evidence-based clinical practice in health care, are often underused and in need of operationalization in and adaptation to clinical praxis. This study explores a failed clinical trial designed to implement and test treatment of depression in PHC in Sweden.

Method

Qualitative case study methodology was used. Semi-structured interviews were conducted with eight participants from the clinical trial researcher group and 11 health care professionals at five PHC units. Additionally, archival data (ie, documents, email correspondence, reports on the clinical trial) from the years 2007–2010 were analysed.

Findings

The study identified barriers to the implementation of the clinical trial in the project characteristics, the medical professionals, the patients, and the social network, as well as in the organizational, economic and political context. The project increased staff workload and created tension as the PHC culture and the research activities clashed (eg, because of the systematic use of questionnaires and changes in scheduling and planning of patient visits). Furthermore, there was a perception that the PHC units’ management did not sufficiently support the project and that the project lacked basic incentives for reaching a sustainable resolution. Despite efforts by the project managers to enhance and support implementation of the innovation, they were unable to overcome these barriers. The study illustrates the complexity and barriers of performing clinical trials in the PHC.

Type
Research
Creative Commons
Creative Common License - CCCreative Common License - BY
The online version of this article is published within an Open Access environment subject to the conditions of the Creative Commons Attribution licence http://creativecommons.org/licenses/by/3.0/
Copyright
© Cambridge University Press 2014

Introduction

The incidence and prevalence of depression is increasing in Sweden as well as in other western countries [World Health Organization (WHO), 2004; National Board of Health and Welfare (NBHW), 2013]. The burden of depression for individuals and their families is substantial. Depression is associated with morbidity and mortality (ie, suicide and cardio- and cerebro-vascular diseases) (Lépine and Briley, Reference Lépine and Briley2011). At some point in their lives, about one-third of the women and one-fourth of the men in Sweden experience depression severe enough to require treatment (NBHW, 2013). The majority of patients who suffers from depression are treated at primary health care units (PHC) [Swedish Council on Health Technology Assessment (SBU), 2004].

Several studies indicate that patients with depression do not receive the best treatment recommended by available knowledge (The WHO World Mental Health Survey Consortium, 2004; Pilling, Reference Pilling2008; NBHW, 2013). A recent report by the NBHW in Sweden concluded that the national guidelines for treating depression (introduced in 2009) were applied only to a very limited extent in Swedish clinical practice (NBHW, 2013). Of the ten PHC units the Board examined, only one unit reported that the national guidelines had resulted in practical changes such as greater resources for psychological treatment and improved psychiatric diagnostics.

In PHC, antidepressant medications, especially selective serotonin reuptake inhibitors (SSRIs), are most commonly used to treat depressive disorders. Although the use of antidepressant medication is convenient and often effective, there is evidence that psychological, or psychotherapeutic, treatment can also be effective (Cuijpers et al., Reference Cuijpers, van Straten, Andersson and van Oppen2008). It is also well known that many patients, who are reluctant to take medication for problems they perceive as psycho-social and relational, prefer to talk to medical professionals (Dwight-Johnson et al., Reference Dwight-Johnson, Sherbourne, Liao and Wells2000). Such professional counselling is typically unavailable in Swedish PHC units. Meeting the clinical guidelines for depression in Sweden would require a large change in the current treatment of depression.

Clinical practice guidelines (CPG) are ‘statements that include recommendations intended to optimize patient care. They are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options’ [Institute of Medicine (IOM), 2011: 25]. In Sweden, the SBU and the NBHW produce national guidelines for health care. In 2004 a systematic review report ‘Treatment of Depression’ (CPG-D) summarized the evidence on treatments for depression (SBU, 2004). The CPG-D concluded that for treatment of mild and moderate depression, psychotherapy was as effective as tricyclic antidepressant (high quality of evidence) and probably as effective as SSRIs (moderate quality of evidence) (see Bowers, Reference Bowers1990). The launch of CPG-D was a national attempt to improve the treatment of patients with depression.

The difficulties encountered in implementing innovations and in using evidence-based guidelines in health care settings are well known (Grol et al., Reference Grol, Dalhuijsen, Thomas, Veld, Rutten and Mokkink1998; Flottorp et al., Reference Flottorp, Håvelsrud and Oxman2003; Brusamento et al., Reference Brusamento, Legido-Quigley, Panteli, Turk, Knai, Saliba, Car, McKee and Busse2012). Theoretical models have highlighted the influence of medical professionals’ perceptions and attitudes (Cabana et al., Reference Cabana, Rand, Powe, Wu, Wilson, Abboud and Rubin1999), the potential of various implementation strategies (Grimshaw et al., Reference Grimshaw, Eccles, Thomas, MacLennan, Ramsay, Fraser and Vale2006) and the significance of contextual organizational and political factors on adherence to CPGs (Green et al., Reference Green, Eriksen and Schor1988; Greenhalgh et al., Reference Greenhalgh, Robert, Macfarlane, Bate and Kyriakidou2004). Implementation of CPGs in PHC settings has been described as especially challenging (McKenna et al., Reference McKenna, Ashton and Keeney2004; Rashidian et al., Reference Rashidian, Eccles and Russell2008; Carlfjord et al., Reference Carlfjord, Lindberg, Bendtsen, Nilsen and Andersson2010).

A systematic review of the effectiveness of strategies to implement CPGs (ie, for treatment of chronic diseases) at the primary care level in the European Union concluded that 19% of the studies reported fully effective implementation, 38% partially effective implementation and 43% no effect. Brusamento et al. (Reference Brusamento, Legido-Quigley, Panteli, Turk, Knai, Saliba, Car, McKee and Busse2012) found that the major implementation barrier to the use of CPGs in PHC was the lack of awareness and agreement about them. Internal factors such as organizational changes, staff shortages, inadequate time, resources and support were significant factors that inhibited implementation of CPGs in PHC units (Flottorp et al., Reference Flottorp, Håvelsrud and Oxman2003; Carlfjord et al., Reference Carlfjord, Lindberg, Bendtsen, Nilsen and Andersson2010). Grol’s (Reference Grol2001) evaluation of the implementation of 70 CPGs in PHC in the Netherlands showed that the implementation process benefitted from a thorough initial analysis of the target group and the target setting, as well as of the existing development structures in the organization.

In their examination of the driving forces for changes in health care praxis, Grol and Wensing (Reference Grol and Wensing2004: 59) recommended an integrative, multilevel approach. In its assimilation of other empirical perspectives, their approach implies that incentives for and barriers to change derive from a number of sources. They list the following as barriers that are commonly found in complex health care settings: the characteristics of the innovation (the relative advantages, credibility, accessibility, attractiveness of the innovation); the involved professionals (their awareness, knowledge, attitude, motivation for change, behavioural routines); the patients (their knowledge, skills, attitude, compliance); the social network (culture created by colleagues’ opinions collaboration, leadership); the organization (care processes, staff, capacities, resources, structures); and the economic and political context (financial arrangements, regulations, policies). Grol and Wensing’s (Reference Grol and Wensing2004) theoretical framework was used in this study to structure the barriers of performing a clinical trial.

‘Treating Depression in Primary care’: the DIP project

With the aim of investigating how evidence for treating depression – as formulated in the CPG-D – could be adopted and applied in PHC, a group of researchers and clinicians (the DIP research group) used the key recommendations of the CPG-D in the design of a randomized clinical trial (the DIP project). The group recognized practical and financial constraints that hindered the direct application of the CPG-D recommendations to PHC practice. DIP aimed to explore how the different treatment recommendations could be adapted to the PHC reality in a patient–physician–therapist setting and if the treatment effects would tolerate such an adoption. For evaluating the effects DIP used the randomized clinical trial (RCT)-design.

The project included three groups with different roles: (a) the DIP research group (n=10) who initiated, designed and directed the project and consisted of researchers, facilitators with specialization in clinical trials and clinicians with specialization in psychotherapy and psychiatry; (b) Educators (n=3), that were specialists in psychotherapy who taught and supervised the PHC clinicians in the psychological treatment method used in the project; (c) PHC staff members (n=20), consisting of PHC unit managers, screeners (GPs who collected data and followed patients in the project) and counsellors who were PHC clinicians (eg, GPs and nurses).

The DIP project consisted of the following interventions (summarized):

Preparing the clinical trial

  • Development of a treatment manual of mild/moderate depression in a PHC setting based on the CPG-D recommendations (see Lindgren, Reference Lindgren2007, for a more detailed description).

  • A pilot trial at one PHC unit. Evaluations indicated positive treatment outcomes.

  • Inclusion of five PHC units of different sizes in the Stockholm region in Sweden volunteering to participate in the clinical trial (reg. protocol no. 2007-001450-66).

  • The PHC units received 2000 SEK (c. 220 €) for each patient in the project and 8000 Swedish crowns (c. 875 €) for each patient who completed the treatment procedure.

  • A pharmaceutical firm financed the project (see Acknowledgements).

Support for PHC staff

  • Education and continuously supervision to the Counsellors concerning the psychological treatment method.

  • Distribution of educational materials (eg, check lists, patient information, counselling manual).

  • Clinical research support from an independent organization (Karolinska Trial Alliance) during the process.

  • Intermittent out-reach visits of a researcher-nurse to facilitate enrolment of patients.

  • Two interactive workshops aiming to support the process and to identify barriers.

  • Computerized systems to support structured decision-making surrounding the patient data collection at the PHC units.

Patient screening and inclusion

  • Patients were screened on randomly chosen days by a researcher-nurse (MADRS-S self-rating depression scale, see Montgomery and Åsberg, Reference Montgomery and Asberg1979).

  • Patients with mild or moderate depression (MADRS-S >12⩽20) and who volunteered for the project were included.

Treatment

  • Randomization of patients to (a) the SSRI treatment method or (b) the psychological treatment method.

  • The psychological treatment method was provided by the PHC unit’s trained staff (eg, GPs, nurses).

Follow-up

  • GPs followed-up patients in the project on six occasions as required by the project’s trial protocol.

  • Research data were collected from patient records, seven assessment questionnaires and various blood samples.

The DIP research group needed to enrol at least 240 patients in the project that fulfilled the inclusion criteria of mild or moderate depression. After 28 months, only 30 patients had enrolled in the project and the DIP research group ended the project. As targets were not reached the research group defined the early closure as a project failure and this view was shared by other participants.

Failed clinical trials are seldom published even though such results could contribute with crucial knowledge. Unsuccessful change interventions often meet the same fate. In contrast, this article presents conclusions from a failed clinical trial in PHC. The aim of this study is to investigate factors contributing to the failure of a RCT designed to implement and test CPG for the treatment of depression.

Method

Using a qualitative case study approach (Yin, Reference Yin2009), semi-structured interviews were conducted with eight participants in the clinical trial and with 11 health professionals at the PHC units. Archival data with historical and contemporary information relevant to the research project were also collected.

Data collection

Interviews with five of the ten members of the DIP research group (C.S. was excluded due to his active role in the case study), all three educators and 11 of the 20 participating health professionals at the five PHC units (Table 1) were conducted. All active participants in the DIP project were invited to participate, but some declined or were not able to participate for other reasons (change of work place, etc.). The interviews were conducted at the five PHC units in the Stockholm region of Sweden and at the university that hosted the main activities of the DIP research group. We conducted 14 individual interviews and one group interview with five counsellors.

Table 1 Interviews of participants of the DIP project

DIP=depression in primary care; PHC=primary health care.

We used a semi-structured interview guide that focused on the aims, processes and outcomes of the project and on the factors that facilitated or hindered its implementation. Examples of interview requests/questions: ‘Describe the DIP project’s development and process from the beginning until the end’; ‘In your opinion, what influenced the early closure of the DIP project?’ These interviews, which lasted from 45 to 80 min, were recorded and transcribed verbatim. We allowed the respondents to read the transcripts and to suggest corrections if needed.

Additionally archival data (ie, email correspondence, reports on the clinical trial) from the years 2007–2010 were gathered. Archival data included 82 pages and described the history, context, purpose and process of the trial. Archival data describing the factors contributing to the failure of the clinical trial was included in the data analysis.

Data analysis

We applied qualitative content analysis to the interview and parts of the archival data using a systematic classification process (Graneheim and Lundman, Reference Graneheim and Lundman2004). The classification process produced categories and sub-categories that sorted information about the latent and manifest content of the data.

The analysis was conducted in seven steps. First, the archival data was sorted chronologically. Sections of the reports and the emails that could relate to the failure of the clinical trial were selected for the further analysis. Second, we read the transcriptions from interviews and archival data several times to obtain a sense of the whole. Third, we coded the factors that hindered the implementation and realization of the projects’ aims (eg, descriptions of barriers, challenges and other difficulties). Fourth, we labelled those factors using a time code that indicated the period or periods during the DIP project when respondents described an obstacle. Fifth, we coded related words and sentences. Codes with similar content were divided into categories and sub-categories. Sixth, we compared and validated these categories and sub-categories with the transcribed interviews. Seventh, we placed the categories and sub-categories in a theoretical framework inspired by Grol and Wensing (Reference Grol and Wensing2004). This framework suggests that incentives and barriers to change in health care are expected at various levels including the innovation, the professionals, the patients, the social context, the organization and the economic and political context. By innovation we refer to the DIP-project.

The first author (L.S.) conducted the interviews, performed the preliminary coding and coordinated the sessions with two authors (C.S. and M.N.) in order to confirm the trustworthiness of the research findings. Two authors (L.S. and C.S.) then discussed and reviewed the categories.

Results

Several factors influenced the failed effort to perform the clinical trial based on the CPG-D recommendations. Table 2 presents an overview of these implementation barriers. Statements by interview respondents are used to exemplify and clarify themes, categories and sub-categories.

Table 2 Overview of themes, categories and sub-categories of implementation barriers in the DIP project according to the Grol and Wensing (Reference Grol and Wensing2004) framework

DIP=depression in primary care; RCT=randomized clinical trial; PHC=primary health care; CPG-D=clinical practice guideline depression; SSRI=selective serotonin reuptake inhibitor.

The innovation: the DIP project

The main goal of the DIP project, as described in both formal steering documents and in interviews, was two-fold: to conduct a clinical trial and to advance depression treatment according to current guidelines. Participants from all groups in the DIP project had additional goals and expected still other results from the project (eg, stimulation of the research tradition within the PHC units, work environment gains and career promoting opportunities for the GPs). To some degree, the Counsellors at the PHC units found that these additional goals and expectations were met. Other staff members at the PHC units disagreed, mainly because of the increased work stress. Members of the DIP research group realized that the project goal of stimulating research in PHC was rather unattainable. These results were offered as explanations for their decreased involvement in the DIP project.

‘I guess the expectation I had for the project was unrealistic. Because I thought it would decrease my workload, initially it felt like a fresh breath of air. But eventually it just added to other work burdens’. (PHC manager)

The DIP project design, a randomized, controlled clinical trial, was viewed by the majority of the respondents as a barrier to implementation of the CPG-D recommendations. Some respondents claimed the project design involved an extensive methodology that increased the complexity of the project artefacts (ie, the protocols, instructions and manuals) and activities. The design also contributed to a view of the DIP project as a foreign project, alien to the PHC culture. Other respondents thought that the project design was too demanding and inflexible because it required controlled, systematic activities in order to achieve its research objectives. Moreover, some respondents thought that the repeated use of structured questionnaires was too time-consuming and too difficult to integrate with the patient visits.

The Counsellors and the Educators observed that the psychological treatment method presented a challenge to professional roles and behaviours. As a result, new and different work tasks, procedures and skills were needed. Interviews and archival data express that the psychological treatment method, which demanded changes in the scheduling and planning of patient visits, had administrative implications for the PHC units.

‘I usually dictate the journal directly in the room with the patient present. It helps me to keep up with the time schedule. But it is not appropriate in this kind of [patient] meeting’. (Nurse, Counsellor)

Some Counsellors also declared that the PHC units’ facilities layout and equipment were not suitable for counselling sessions.

‘As you can see [pointing to a tray with medical instruments and to a desk stacked with files], these rooms do not say to the patient, “Sit down and tell me how you really feel”. And it does not matter if the light outside my door is red, indicating do not disturb. People will push open the door and rush in anyway. I have to lock it!’ (Nurse, Counsellor)

The PHC staff members also thought it was difficult to find time to perform activities (eg, training, seminars, out-reach visits and reminders) given their normal working schedules.

The professionals

Some respondents linked their negative responses to the DIP project to the increased work load. The PHC staff members and parts of the DIP research group stated they had underestimated the amount of time and effort the project demanded. Some of them described how these negative responses were reinforced when other internal or external events occurred and were prioritized within the PHC unit (Figure 1). Some respondents said that this was the mental turning point when they decided to leave the project.

Figure 1 Chronology of key events and barriers in the DIP project. PHC=expressed by primary health care staff and management; DIP=depression in primary care; DIP-m=expressed by DIP management; E=expressed by Educators.

‘And then the swine flu vaccination came. That was the last straw for me. I thought then, “I can’t do all of these things”. And because the vaccination programme was a top priority in PHC, I thought to myself, “I can’t do DIP anymore”. Even though I really wanted to and believed in it.’ (GP, Screener)

Some PHC staff members and DIP research group members described how they withdrew from the DIP project activities. For example, they declined to participate in project implementation activities, decreased their project communications, ceased using the questionnaires according to the protocols and/or stopped the enrolment of patients.

A few respondents thought the negative attitudes towards the CPG-D recommendations were related to doubts about the accuracy of the underlying medical evidence. These respondents evaluated other treatment recommendations for depression (ie, pharmacological treatment) as more effective. There was also concern that the DIP project, which was premised on the idea that PHC medical staff could also conduct psychotherapy, promoted economic solutions over medical solutions.

The patients

The interviews showed that the staff members at the PHC units attributed some of the failure of the DIP project to various patient-related factors. Among these factors, which accounted for low enrolment in the project, were patient characteristics, attitudes and experiences related to the treatment of depression. Some respondents argued that the number of patients who met the inclusion criteria was low in the population that sought care at PHC units. Furthermore, they discovered some patients were unwilling to admit to symptoms of depression or were uncomfortable with the waiting room approach in which questions were asked about their mental health. In addition, respondents thought it was unethical to ask patients mental health questions when the patients were seeking other health care treatment. Such screening and questionnaire procedures were perceived to potentially undermine patient confidentiality and/or interfere with the physician/patient relationship. Some PHC staff members also stated that because PHC patients often have multiple and complex disorders, the treatment recommendations, featured in the DIP project, were inflexible and not appropriate for the patient group.

The social network

A majority of respondents described the cultural clash between the research tradition and the PHC tradition. As a result, the PHC units were reluctant to participate in the research. In part, communication difficulties between the researchers and the PHC staff members caused this clash.

‘There is no tradition of research in primary care. We have no experience and are almost afraid of projects such as this [although] there is a lot of respect for research as well. The project was like a large, strange bird in our organization. Our main task is to quickly respond and treat our patients’. (PHC Manager)

PHC staff members also thought the project meetings did not meet their needs in terms of location, topics and terminology use. Some respondents said the collaboration between the PHC management and the PHC staff members negatively influenced the project. They pointed to the low level of trust between leaders and co-workers. A few respondents stated that the PHC staff did not follow the PHC managements’ instructions about participation in the project because of their heavy workload and/or low interest. As a result, it was difficult to manage some professional groups in the project.

The organizational context

Respondents identified four factors in the organizational context that contributed to the project failure: ambivalent leadership, high staff turnover, poor work conditions and conflicting organizational changes. A majority of the participants thought the PHC leadership of the DIP project at the PHC units was ineffective as far as the project’s planning, execution and outcomes. Various respondents from all groups claimed that their leaders (the PHC management and the DIP research group) failed to anchor DIP in the PHC units. Several saw this deficiency as a significant barrier to the project’s long-term survival. Some respondents complained that leaders could not realistically describe and/or assess what the project involved or demanded.

Several respondents from the PHC units and a few from the DIP research group changed work sites or functions during the project period. This resulted in staff changes and shortages in some cases and also meant that information was lost and project participation declined. Additionally, staff shortages in the PHC units in general meant that in the subsequent ordering of work tasks in research and development projects like DIP project were not prioritized.

Some respondents from the PHC units described how the work stress affected their participation. They were too exhausted to communicate, to learn new skills and/or to experience satisfaction in developing their practices. At the DIP seminars and kick-off meetings, when they felt invigorated, they agreed to participate in the project. However, when they returned to work, this enthusiasm waned as they tried to cope with the increased workload.

‘When we were at the project’s kick-off meeting, I felt that the atmosphere was good. And I thought it would work out. I wanted to participate. We need to improve our treatment of patients with depression. But then when I returned to our unit, the workload became too high and my motivation for the project declined’. (GP, Screener)

Some major events occurred during the course of the DIP project, revealed in archival data. See Figure 1 for a summary of events perceived as significant. One significant event was the national health care law ‘Freedom of Choice in Health Care’ that came into force in January of 2009. Respondents declared that the law implied a major organizational change at the PHC units. The units’ priority now was to improve patient access and to increase the number of patient visits. Participants thought that because the PHC units were occupied with this change, their motivation to participate in research and development projects, including the DIP project, decreased as a result of this reform.

‘During this time when the “Freedom of Choice in Health Care” reform was launched, everything was up-side-down. We did not know if we would even exist as a PHC unit when the year was over. Of course this affected the execution of DIP’. (PHC Manager)

Another major event was the national vaccination programme following the swine flu outbreak in 2010. The PHC units had responsibility for administering the vaccinations, and for a period of time this programme received high priority and the focus on the DIP project naturally decreased.

The economic and political context

Several PHC staff members and managers perceived that the PHC units’ main mission and economic incentives had changed during the years that the DIP project was active. In particular, they pointed to the Swedish health care financial model that bases its reimbursements on the number of patient-visits at each PHC unit and to the introduction of the ‘Freedom of Choice in Health Care’ law. This change of focus in the political and economic management of health care was highlighted as a major barrier to the DIP implementation by a majority of the participants. Because the PHC units’ main mission did not include research and/or development, the conclusion was that the DIP project was not a part of their mission.

‘The overall aim in primary health care has evolved into being constantly available for all patients. I understood that this focus decreased their [the staff members’] motivation to participate in our project. The managers’ motivation declined when they realized that the reform “Care Choice Stockholm” contained no specific focus on research and development initiatives’. (Researcher, DIP research group)

‘The new financial system for primary health care is not compatible with the implementation of new clinical guidelines or research and development activities. It exclusively rewards according to the number of patient-visits’. (GP, Screener)

Discussion

The DIP project was an effort to adopt and evaluate an operationalization of guidelines for treating depression in a clinical trial that closed early due to difficulties to enrol patients. In this case study we explore the factors that hindered the clinical trial in the PHC setting. The project demanded resources, efforts (eg, time, involvement, interest) and it implied change. New strict routines and practices that needed to co-exist with the prevailing conditions of PHC (eg, high workload, staff shortage) and also with other change processes and unexpected events (eg, large-scale health care reform, mass vaccinations). This is the reality that implementation efforts of any kind face in complex health care settings as PHC and represent the need for tailored interventions (eg, Baker et al., Reference Baker, Camosso-Stefinovic, Gillies, Shaw, Cheater, Flottorp and Robertson2010) and adherence to the influence of context on implementation and development (eg, Dopson et al., Reference Dopson, Fitzgerald and Ferlie2008; Kaplan et al., Reference Kaplan, Brady, Dritz, Hooper, Linam, Froehle and Margolis2010; Reference Kaplan, Provost, Froehle and Margolis2012; Bate, Reference Bate2014).

The medical professionals eventually resisted the DIP project despite their initial positive attitudes towards it. The reasons were primarily the organizational changes, increased workloads, communication problems and the cultural clashes between clinical praxis and research. Still some barriers seem to have had a more superior role – the lack of leadership and incompatibility with the prevailing way of organizing and delivering care.

Initial motivation to participate declined as chains of problems arose; trying to cope with these problematic events the lack of anchoring, incitements and the diminished prioritization of the project were revealed. The lack of leadership support for the DIP project may have been the single most important barrier to its success. That key actors, such as managers, that influence change has a long-term commitment, provide support and enhance sense-making is an important factor when trying to improve the quality of services in a health care organization (Nyström, Reference Nyström2009).

The concept of compatibility is a significant factor that explains the problem of conducting research in the PHC setting (Carlfjord et al., Reference Carlfjord, Lindberg, Bendtsen, Nilsen and Andersson2010). The perception of mismatch – that was most often connected to the research features of the DIP project – was a significant impediment to the implementation process. In Carlfjord et al.’s study impeding factors found were organizational changes and staff shortages that coincided with the implementation of a computer-based test for lifestyle in PHC settings, similar to the barriers found in this study. Our results are also in line with findings from a trial to implement guidelines in 120 general practices in Norway that concluded that lack of time, resources and support were the most salient factors that could explain the low uptake of guidelines (Flottorp et al., Reference Flottorp, Håvelsrud and Oxman2003).

The theoretical framework used (Grol and Wensing, Reference Grol and Wensing2004) was useful for structuring the barriers. The purpose of identifying barriers to implementation on different levels is to be able to address them when planning for and executing complex change processes in health care. Many similar frameworks exist and a recent review proposed a comprised integrated checklist of determinants of practice (the TICD checklist) with seven domains and 57 determinants (Flottorp et al., Reference Flottorp, Oxman, Krause, Musila, Wensing, Godycki-Cwirko, Baker and Eccles2013). A missing part of both the used framework and TICD is the time and process factor, illustrated in Figure 1. Barriers interacted and were influenced by the key events that occurred during the DIP process. This result suggests a need to continuously monitor barriers during an implementation process and future frameworks or taxonomies could benefit from addressing the time and process factor.

The use of RCT as the gold standard of research has been questioned (eg, Grossman and Mackenzie, Reference Grossman and Mackenzie2005; Cartwright, Reference Cartwright2007; Hansson, Reference Hansson2014). In this case the RCT research design was present in two phases; the CPG-D was based mainly on RCT-studies and when adapting them to clinical practice with the help of the DIP-project the evaluation of the effect of the new approach used an RCT design. The case demonstrates that a methodology with high degree of control and systematics and a high scientific value may operate as an intimidating and to time-consuming procedure in a real health care setting. In other studies the challenges to perform RCTs on interventions in PHC have also been discussed, for example in relation to validity (Godwin et al., Reference Godwin, Ruhland, Casson, MacDonald, Delva, Birtwhistle and Seguin2003) or complexity of the intervention (Campbell et al., Reference Campbell, Fitzpatrick, Haines, Kinmonth, Sandercock, Spiegelhalter and Tyrer2000). Aiming to make use of evidence and science in clinical praxis one must ask how the different research paradigms can be used. When interventions are complex, maybe smaller pilot tests of new approaches, with room for interaction, adaptation and changes, could precede more robust designs aiming for test of causal relations?

Research and education are the missions of the universities and the university hospitals. Despite their differences in assignment, these groups interact. Using the best available knowledge universities train health professionals in clinical settings (ie, the PHC units) where health professionals can collect new clinical data. However, as this study illustrates, there are fundamental impediments in this exchange relationship. While many factors contributed to the failure of the DIP project, one important factor was likely the problem of uniting the missions of the two groups. It was too difficult to combine the PHC units’ primary activity (ie, meeting patients) and their core value (ie, patient access) with the activities (ie, medical data collection) and values (ie, the advancement/dissemination of knowledge) associated with the DIP project.

Methodological considerations

In a retrospective study, methodological problems are a concern. Inaccuracies due to respondents’ recall errors may appear. In addition, there is the problem of author-researcher bias because the project outcome is known. However, the study focused on understanding the reasons for the outcome and the procedure for analysis is presented in detail. In this sense the study provides a reliable and detailed description of the implementation failure from the participants’ perspectives.

Conclusion

This study shows the barriers of performing clinical trials in PHC and some of the complexities of adopting guideline recommendations and changing clinical practices in PHC settings. As it appears the production of health care and production of knowledge implied a conflict in work tasks, motivation and culture that was too difficult to bridge in this case.

In order to support the important collaboration and exchange between academia and health care, prerequisites for research in health care, and especially in distributed primary care units needs to be established. Clinical systems of documentation, routines, resources and physical settings needs to be prompted, aiming for a high quality health care ready to both treat and develop.

Acknowledgements

The authors thank the interview respondents and other participants for their time and effort.

Financial Support

This work was supported by H. Lundbeck A/S, a Danish international pharmaceutical group [Contract 2007-06-04]. Additional funding was provided by the Vinnvård Research Program in Sweden [Grant Number A2008-025] and the FAS Centre for Global Health at the Department for Public Health and Clinical Medicine, Umeå University, Sweden.

Conflicts of Interest

The authors declare that they have no conflicting interests. Two authors (I.K. and C.S.) were members of the DIP research group and for that reason not involved in the collection of data in this study. I.K. was interviewed as he was as a key informant. His role in this study was mainly to confirm the final versions of the manuscript. The first and second authors (L.S. and M.N.), conducted the most of the analysis and the writing and were not part of the DIP project.

Ethical Standards

The authors assert that all procedures used in this work comply with the ethical standards of the relevant national and institutional guidelines on human experimentation (Regional Ethics Committee in Stockholm Dnr 2007/839-31/2) and with the Helsinki Declaration of 1975, as revised in 2008.

References

Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E.J., Cheater, F., Flottorp, S. and Robertson, N. 2010: Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 3, 178.Google Scholar
Bate, P. 2014: Context is everything. In Perspectives on context. London, The Health Foundation, 327. Retrieved 16 April 2014 from http://www.health.org.uk/publications/perspectives-on-context/Google Scholar
Bowers, W.A. 1990: Treatment of depressed in-patients. Cognitive therapy plus medication, relaxation plus medication and medication alone. The British Journal of Psychiatry 156, 7378.Google Scholar
Brusamento, S., Legido-Quigley, H., Panteli, D., Turk, E., Knai, C., Saliba, V., Car, J., McKee, M. and Busse, R. 2012: Assessing the effectiveness of strategies to implement clincial guidelines for the management of chronic diseases at primary care level in EU Members States: a systematic review. Health Policy 107, 168183.Google Scholar
Cabana, M.D., Rand, C.S., Powe, N.R., Wu, A.W., Wilson, M.H., Abboud, P-A.C. and Rubin, H.R. 1999: Why don’t physicians follow clinical practice guidelines? A framework for improvement. The Journal of the American Medical Association 282, 14581465.Google Scholar
Campbell, M., Fitzpatrick, R., Haines, A., Kinmonth, A.L., Sandercock, P., Spiegelhalter, D. and Tyrer, P. 2000: Framework for design and evaluation of complex interventions to improve health. British Medical Journal 321, 694696.Google Scholar
Carlfjord, S., Lindberg, M., Bendtsen, P., Nilsen, P. and Andersson, A. 2010: Key factors influencing adoption of an innovation in primary health care: a qualitative study based on implementation theory. BMC Family Practice 11, 60.Google Scholar
Cartwright, N. 2007: Are RCTs the gold standard? BioSocieties 2, 1120.Google Scholar
Cuijpers, P., van Straten, A., Andersson, G. and van Oppen, P. 2008: Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology 76, 909922.Google Scholar
Dopson, S., Fitzgerald, L. and Ferlie, E. 2008: Understanding Change and Innovation in Healthcare Settings: Reconceptualizing the Active Role of Context. Journal of Change Management 8(3-4), 213231.Google Scholar
Dwight-Johnson, M., Sherbourne, C.D., Liao, D. and Wells, K.B. 2000: Treatment preferences among depressed primary care patients. Journal of General Internal Medicine 15, 527534.CrossRefGoogle ScholarPubMed
Flottorp, S., Håvelsrud, K. and Oxman, D.A. 2003: Process evaluation of a cluster randomized trial of tailored interventions to implement guidelines in primary care – why is it so hard to change practice. Family Practice 20, 333339.Google Scholar
Flottorp, S.A., Oxman, A.D., Krause, J., Musila, N.R., Wensing, M., Godycki-Cwirko, M., Baker, R. and Eccles, M.P. 2013: A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implementation Science 8, 35.Google Scholar
Godwin, M., Ruhland, L., Casson, I., MacDonald, S., Delva, D., Birtwhistle, R. and Seguin, R. 2003: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Medical Research Methodology 3, 28.Google Scholar
Graneheim, U.H. and Lundman, B. 2004: Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Education Today 24, 105112.Google Scholar
Green, L.W., Eriksen, M.P. and Schor, E.L. 1988: Preventive practices by physicians: behavioral determinants and potential interventions. American Journal of Preventive Medicine 4, 101110.Google Scholar
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P. and Kyriakidou, O. 2004: Diffusion of innovations in service organizations: systematic review and recommendations. The Milbank Quarterly 82, 581629.Google Scholar
Grimshaw, J., Eccles, M., Thomas, R., MacLennan, G., Ramsay, C., Fraser, C. and Vale, L. 2006: Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. Journal of General Internal Medicine 21, 1420.Google Scholar
Grol, R. 2001: Successes and failures in the implementation of evidence-based guidelines for clinical practice. Medical Care 39 (Suppl 2), II46II54.Google Scholar
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C., Rutten, G. and Mokkink, H. 1998: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. The British Medical Journal 317, 858861.Google Scholar
Grol, R. and Wensing, M. 2004: What drives change? Barriers to and incentives for achieving evidence based practice. The Medical Journal of Australia 180, S57S60.Google Scholar
Grossman, J. and Mackenzie, F.J. 2005: The randomized controlled trial: gold standard, or merely standard? Perspectives in Biology and Medicine 48, 516534.Google Scholar
Hansson, S.O. 2014: Why and for what are clinical trials the gold standard? Scandinavian Journal of Public Health 42 (Suppl 13), 4148.Google Scholar
Institute of Medicine (IOM). 2011: Clinical practice guidelines we can trust. Committee on standards for developing trustworthy clinical practice guidelines, Institute of Medicine. Retrieved 2 August 2013 from http://www.iom.edu/Reports/2011/Clinical-Practice-Guidelines-We-Can-Trust.aspxGoogle Scholar
Kaplan, H.C., Brady, P.W., Dritz, M.C., Hooper, D.K., Linam, W.M., Froehle, C.M. and Margolis, P. 2010: The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Quarterly 88, 500559.Google Scholar
Kaplan, H.C., Provost, L.P., Froehle, C.M. and Margolis, P.A. 2012: The model for understanding success in quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Quality & Safety 21, 1320.Google Scholar
Lépine, J.-P. and Briley, M. 2011: The increasing burden of depression. Neuropsychiatric Disease and Treatment 7, 37.Google Scholar
Lindgren, A. 2007. DIP Psykologisk behandling. Generella behandlingsprinciper. (DIP psychological treatment. General principles.). Stockholm: Karolinska Institutet, Medical Management Center.Google Scholar
McKenna, H., Ashton, S. and Keeney, S. 2004: Barriers to evidence based practice in primary care: a review of the literature. International Journal of Nursing Studies 41, 369378.Google Scholar
Montgomery, S.A. and Asberg, M. 1979: A new depression scale designed to be sensitive to change. The British Journal of Psychiatry 134, 382389.Google Scholar
National Board of Health and Welfare (NBHW). 2013: Nationell utvärdering 2013 – vård och insatser vid depression, ångest och schizofreni. Indikatorer och underlag för bedömningar. (National evaluation in 2013 – care and interventions for depression, anxiety and schizophrenia. Indicators and data for assessments). Retrieved 11 August 2013 from http://www.socialstyrelsen.se/publikationer2013/2013-6-7Google Scholar
Nyström, M. 2009: Characteristics of health care organizations associated with learning and development: lessons from a pilot study. Quality Management in Health Care 18, 285294.Google Scholar
Pilling, S. 2008: History, context, process and rationale for the development of clinical guidelines. Psychology and Psychotherapy: Theory, Research and Practice 81, 331350.Google Scholar
Rashidian, A., Eccles, M.P. and Russell, I. 2008: Falling on stony ground? A qualitative study of implementation of clinical guidelines prescribing recommendations in primary care. Health Policy 85, 148161.Google Scholar
Swedish Council on Health Technology Assessment (SBU). 2004: Behandling av depressionssjukdomar (Treatment of depression), Stockholm, Volume 1–3 SBU.Google Scholar
The WHO World Mental Health Survey Consortium. 2004: Prevalence, severity and unmet need for treatment of mental disorders in the World Health Organization world mental health surveys. The Journal of the American Medical Association 291, 25812590.Google Scholar
World Health Organization (WHO). 2004: The global burden of disease 2004 update. Géneve: WHO.Google Scholar
Yin, R.K. 2009. Case study research: design and methods, fifth edition. London: SAGE Publications.Google Scholar
Figure 0

Table 1 Interviews of participants of the DIP project

Figure 1

Table 2 Overview of themes, categories and sub-categories of implementation barriers in the DIP project according to the Grol and Wensing (2004) framework

Figure 2

Figure 1 Chronology of key events and barriers in the DIP project. PHC=expressed by primary health care staff and management; DIP=depression in primary care; DIP-m=expressed by DIP management; E=expressed by Educators.