Developing implementation science to improve the translation of research to address low back pain: A critical review




Abstract


The evidence base regarding treatment for back pain does not align with clinical practice. Currently there is relatively little evidence to guide health decision-makers on how to improve the use, uptake or adoption of evidence-based recommended practice for low back pain. Improving the design, conduct and reporting of strategies to improve the implementation of back pain care will help address this important evidence-practice gap. In this paper, we



  • 1)

    Describe implementation science models and approaches.


  • 2)

    Outline important features of implementation research.


  • 3)

    Critically appraise the quality and findings of implementation trials in the low back pain field.


  • 4)

    Provide recommendations for the design and conduct of future implementation studies in the field.



Introduction


The burden of low back pain is well documented. The condition is the leading cause of disability globally in terms of years lived with disability and was estimated to affect 539 million people worldwide in 2015 . Across the globe, a relatively large body of evidence has been produced aiming to reduce this burden. However, research can only affect the health of patients if it is used in practice.


As noted elsewhere is this special edition, clinical practice guidelines for low back pain have been developed to guide the provision of evidence-based clinical care through the explicit recommendation of best practice, based on the synthesis of the large body of research. Many such guidelines exist for low back pain internationally, and their recommendations are strikingly consistent. Arguably, this reflects reliability in the development of low back pain guidelines and their ‘evidence-based’ recommendations, providing a benchmark for best practice evidence-based care for low back pain.


Despite the availability and consistency of guidelines relating to low back pain care, studies have shown that guideline recommended care is not implemented in routine clinical practice. An array of reasons for the failure of guidelines to affect actual care, often relating to barriers to patient and clinician uptake, has been reported. More recently, however, the role of guidelines in changing practice has been questioned, with passive dissemination of guidelines usually not effective in translating evidence to practice . The need for active translation processes to improve the quality of routine care and adopt evidence-based management is now well accepted because guidelines by themselves do not change practice .


Research translation and implementation research


The process of translating research into therapeutic benefits for patients has been described in a five-stage model by the US National Institute of Health . Early translation phases (T1 and T2) focus on basic science, epidemiology and testing the efficacy of health interventions. The third translation phase or ‘T3’ encompasses research designed to increase implementation of evidence-based interventions, practices or policies . In understanding this model, it is essential to differentiate the act of implementation itself from research designed to inform implementation. Implementation itself is the use of strategies to increase the use, uptake, adoption or integration of health interventions, to change practice patterns within specific settings . Implementation research is the study of those ‘implementation strategies’, designed to integrate evidence, increase the use or adoption of policy, or change practice (i.e. achieve successful ‘implementation’) . Implementation research that assesses and compares implementation strategies provides an empirical basis to guide decisions of how to best improve the implementation of clinical guidelines. It is also important to note that implementation research comes with its own set of outcomes, which are distinct from clinical outcomes. Typical outcomes assessed in trials for implementation strategies include, clinician adherence to recommended treatment approaches and rates of (appropriate or inappropriate) referral for medical tests.


The National Institute of Health highlights implementation research as a fundamental component of research translation and a necessary pre-requisite for research to yield health improvements . In the back pain field, dedicated implementation research is required to improve the quality of care provided to patients and reduce the global impact of the condition by maximising the translation of guideline recommendations and research findings. In this paper we (a) discuss implementation models and approaches, (b) discuss the important features of implementation research and (c) critically appraise the quality of implementation research in the low back pain field, including a summary of what implementation strategies have been found to be effective. We conclude with recommendations for the design and conduct of future implementation studies in the field.


Implementation models, theories and frameworks


Implementation science is an emerging field of research. The field draws on a number of theoretical models and frameworks to guide the approach, selection of implementation strategies and methods of evaluation. As synthesized in a recent taxonomy, there are numerous implementation models, theories and frameworks that aim to (a) describe and/or guide the process of translating research into practice (process models), (b) understand and/or explain what influences implementation outcomes (determinant frameworks, classic theories and implementation theories) and (c) evaluate implementation strategies (evaluation frameworks) . The taxonomy of approaches by Nilsen provides an opportunity to facilitate consistency and comparability between studies, examples of which are described below



  • a)

    Guiding translation



Process models


Process models used in implementation science aim to provide guidance regarding the steps involved in translating evidence into practice. These models, otherwise known as research-to-practice or knowledge-to-action models, typically describe the steps required following the generation of research evidence regarding detailed and careful planning and how to execute implementation strategies to maximise research translation. Such process models include the National Institute of Health 5 stages of research translation, the Knowledge-to-Action Framework and the Quality Implementation Framework (QIF). The QIF for example, describes 14 specific steps to facilitate implementation across four phases: initial considerations regarding a host setting, creating a structure for implementation, ongoing structure once the implementation begins and improving future applications ( Table 1 ). Such process models can be used in intervention trials to ensure that appropriate and systematic consideration is given during the planning phase to factors relevant to maximising research translation in the selected host setting.



  • b)

    Understanding what influences implementation outcomes



Table 1

Quality Implementation Framework.





























Phase 1. Initiation Considerations Regarding the Host Setting
Self-assessment strategies

  • 1.

    Conducting a Needs and Resources Assessment


  • 2.

    Conducting a Fit Assessment


  • 3.

    Conducting a Capacity/Readiness Assessment

Decisions about adaptation

  • 4.

    Possibility for Adaptation

Capacity-building strategies

  • 5.

    Obtaining Explicit Buy-in from Critical Stakeholders and Fostering a Supportive Climate


  • 6.

    Building General/Organisational Capacity


  • 7.

    Staff Recruitment/Maintenance


  • 8.

    Effective Pre-Innovation Staff Training

Phase 2. Creating a Structure for Implementation
Structural Features for Implementation

  • 9.

    Creating Implementation Teams


  • 10.

    Developing an Implementation Plan

Phase 3. Ongoing Structure Once Implementation Begins
Ongoing Implementation Support Strategies

  • 11.

    Technical Assistance/Coaching/Supervision


  • 12.

    Process Evaluation


  • 13.

    Supportive Feedback Mechanism

Phase 4. Improving Future Applications


  • 14.

    Learning from Experience


Adapted from Meyers et al 2012 .


Determinant frameworks


Determinant frameworks describe the factors that are theoretically linked or have been shown to be associated with implementation outcomes. Determinants are typically categorised as either barriers (that hinder) or enablers (that facilitate) to implementation. Identification of the barriers and enablers to implementation is important in the design of implementation strategies. Examples of determinant frameworks include the active implementation framework, the ecological framework and the theoretical domains framework (TDF). The TDF has previously been applied to low back pain research . It draws on organisational change theories and defines 14 domains such as ‘Knowledge’, ‘Skills’, ‘Beliefs about Capabilities’ and ‘Environmental Context and Resources’ ( Table 2 ). The TDF also has a process for identifying barriers to implementation and selecting appropriate implementation strategies to address them. Determinant frameworks are best applied in the design phase of implementation trials to identify both the barriers and enablers to implementation within the target population group and setting and choose implementation strategies that may be effective in addressing them.



Table 2

Theoretical domains framework.

















































Domain (definition) Constructs
1. Knowledge (an awareness of the existence of something) Knowledge (including knowledge of condition/scientific rationale); Procedural knowledge; Knowledge of task environment
2. Skills (an ability or proficiency acquired through practice) Skills; Skill development; Competence; Ability; Interpersonal skills; Practice; Skill assessment
3. Social/Professional Role and Identify (A coherent set of behaviours and displayed personal qualities of an individual in a social or work setting) Professional identity; Professional role; Social identity; Identity; Professional boundaries; Professional confidence; Group identity; Leadership; Organisational commitment
4. Beliefs about Capabilities (Acceptance of the truth, reality or validity about an ability, talent or facility that a person can put to constructive use) Self-confidence; Perceived competence; Self-efficacy; Perceived behavioural control; Beliefs; Self-esteem; Empowerment; Professional confidence
5. Optimism (The confidence that things will happen for the best or that desired goals will be attained) Optimism; Pessimism; Unrealistic optimism; Identify
6. Beliefs about Consequences (Acceptance of the truth, reality or validity about outcomes of a behaviour in a given situation) Beliefs; Outcome expectancies; Characteristics of outcome expectancies; Anticipated regret; Consequents
7. Reinforcement (Increasing the probability of a response by arranging a dependent relationship, or contingency, between the response and a given stimulus) Rewards (proximal/distal, valued/not valued, probable/improbable); Incentives; Punishment; Consequents; Reinforcement; Contingencies; Sanctions
8. Intentions (A conscious decision to perform a behaviour or a resolve to act in a certain way) Stability of intentions; Stages of change model; Transtheoretical model and stages of change
9. Goals (Mental representations of outcomes or end states that an individual wants to achieve) Goals (distal/proximal); Goal priority; Goal/target setting; Goals (autonomous/controlled); Action planning; Implementation intention
10. Memory, Attention and Decision Processes (The ability to retain information, focus selectively on aspects of the environment and choose between two or more alternatives) Memory; Attention; Attention control; Decision-making; Cognitive overload/tiredness
11. Environmental Context and Resources (Any circumstance of a person’s situation or environment that discourages or encourages the development of skills and abilities, independence, social competence and adaptive behaviour) Environmental stressors; Resources/material resources; Organisational culture/climate; Salient events/critical incidents; Person × environment interaction; Barriers and facilitators
12. Social influences (Those interpersonal processes that can cause individuals to change their thoughts, feelings or behaviours) Social pressure; Social norms; Group conformity; Social comparisons; Group norms; Social support; Power; Intergroup conflict; Alienation; Group identity; Modelling
13. Emotion (A complex reaction pattern, involving experiential, behavioural and physiological elements, by which the individual attempts to deal with a personally significant matter or event) Fear; Anxiety; Affect; Stress; Depression; Positive/negative affect; Burn-out
14. Behavioural Regulation (Anything aimed at managing or changing objectively observed or measured actions) Self-monitoring; Breaking habit; Action planning

Adapted from Cane et al 2012 .


Classic theories


Classic theories are rooted in other fields such as psychology and seek to explain individual behavioural processes and have been adapted and applied in the field of implementation. These include psychological behaviour change theories (e.g. theory of planned behaviour or theory of reasoned action), sociological theories (e.g. social capital theories) and organisational theories (e.g. situated change theory). The theory of diffusion, which describes the influence of individuals such as opinion leaders and change agents in the adoption and implementation of interventions, is also a classic theory . Classic theories such as behaviour change theories may be best applied in the planning phase of implementation trials to identify and understand individual behaviours or processes that may be a barrier or enabler to successful implementation in a particular setting. Such individual behaviours or processes can then be considered in the selection of implementation strategies to maximise successful implementation.


Implementation theories


Implementation theories are typically behavioural theories that have been adapted for understanding a particular aspect of implementation. These include organisational readiness theory and the normalisation process theory (NPT) , which both aim to understand how and why organisations differ in their adoption of interventions. The organisational readiness theory proposes that organisational readiness for change is a multi-level construct. One level applies to organisational commitment and efficacy for collective change, the second level is individual appraisal of implementation capability based on determinants of task demands, resource availability and situational factors . The NPT focuses on the identification of barriers or enablers to the implementation of complex interventions into routine practice . The application of the NPT focuses on four components of how an intervention becomes normalised by individuals and groups: coherence (or sense-making), cognitive participation (or engagement), collective action (work to enable the intervention to happen), and reflexive monitoring (formal and informal appraisal of the benefits and costs of the intervention) . Such implementation theories can be applied in the planning phase of intervention trials to identify the readiness of organisations for change and inform implementation strategy selection to enhance organisational commitment or resource availability. Such theories can also be applied to help understand or explain different levels of implementation in different settings or organisations.



  • c)

    Evaluation frameworks



Evaluation frameworks describe aspects of implementation processes or outcomes that can be evaluated to assess their impact, such as the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework ( Table 3 ). It is noted that various other models such as the theoretical domains framework and NPT can also be used for evaluation purposes as they also describe measurable aspects of implementation. Evaluation frameworks are best used to inform the implementation processes and outcomes that will be assessed to measure implementation effectiveness.



Table 3

RE-AIM evaluation dimensions.






















Dimension Level
Reach (proportion of the target population that participated in the intervention) Individual
Efficacy (success rate if implemented as in guidelines; defined as positive outcomes minimum negative outcomes) Individual
Adoption (proportion of settings, practices and plans that will adopt this intervention) Organisation
Implementation (extent to which the intervention is implemented as intended in the real world) Organisation
Maintenance (extent to which a programme is sustained over time) Individual and Organisation

Adapted from Glasgow .


Important features of implementation research: improving the quality and efficiency


As a scientific discipline, implementation science is in its relative infancy. For example, just 2% of systematic reviews of health interventions report the findings of implementation trials . Furthermore, the quality of implementation research has been criticised . Implementation trials should possess the same methodological attributes considered to increase internal validity, such as those outlined by Medical Research Council guidance . For example, for the purposes of testing implementation intervention effectiveness, randomised controlled trials (RCTs) have lower risk of bias than other research designs. Concealed allocation and masking where possible are appropriate. This is because the same risks of bias apparent in the research of patient-level treatments apply to implementation research. Just as there are reporting guidelines such as CONSORT to improve the clarity and consistency of RCTs, a reporting guideline has been recently been released for implementation studies. Preparation of study reports according to the Standards for Reporting Implementation studies of complex interventions (StaRI) guidelines will help generate an interpretable and comparable evidence base in the area.


There are, however, several additional considerations important in the design, conduct and reporting of implementation research. We propose three particular areas of consideration: theoretically informed development of implementation strategies that target identified barriers and enablers, categorisation of implementation strategies using standardised terminology, and evaluating the effectiveness on individual and implementation outcomes and on the cost of intervention delivery and adverse events. Close attention to these issues has the potential to advance the science of implementation.



  • a)

    Appropriate intervention development including use of theory or empirical evidence to address identified barriers and enablers



It is recommended that the development of implementation interventions should be guided by an appropriate theory or implementation framework such as those described above. Recognising the inherent complexity in implementing best practice, formative evaluation to appropriately identify and consider questions about context and barriers to change is required to guide any implementation approach. The use of theory or implementation frameworks helps ensure that researchers consider relevant barriers and enablers in the design of implementation strategies. This application of theory or conceptual models in the design of implementation strategies can make explicit the mechanism(s) by which implementation strategies are hypothesised to work, enabling researchers to identify both if and how implementation strategies may improve practice. The importance of their use is supported by findings of systematic reviews, which suggest that the application of such theory and frameworks is associated with more effective implementation . Among the most comprehensive is the TDF, as described above, which has been applied in the development of successful interventions to improve clinical practice.



  • b)

    Categorisation of implementation strategies using standard terminology



Inconsistent use of terminology is a problem for implementation science as it obstructs attempts to synthesise and understand implementation processes and outcomes . A number of attempts have been made to consolidate and standardise terminology. Of particular importance is the use of taxonomies in the description of implementation strategies. Among the most popular include the intervention taxonomy (ITAX) and the Effective Practice and Organisation of Care (EPOC) taxonomy . ITAX provides a comprehensive description of the features of implementation strategies, including the mode of delivery, schedule, adaptability and other characteristics . The EPOC taxonomy has been designed to help describe and categorise health system interventions . The EPOC taxonomy was recently updated to ensure greater alignment with other taxonomies used to classify health system interventions, and it includes four major domains: delivery arrangements, financial arrangements, governance arrangements and implementation strategies . While it is primarily used to assist the classification and synthesis of implementation strategies in systematic reviews, the taxonomy also provides researchers with terminology to describe implementation strategies in individual trials .



  • c)

    Appropriate outcomes for implementation research: individual, implementation, cost and adverse events



While the process of research translation typically involves the use or adoption of known effective treatments in routine care, assessment of both implementation and patient outcomes are essential in implementation trials. This is to understand whether selected implementation strategies influence the use of the targeted treatment or practice and whether such practice changes in turn affect patient outcomes. For example, an implementation strategy may be effective in improving implementation outcomes but not affect patient outcomes because of natural adaptions in the delivery of the treatment in routine care. Arguably, such understanding is necessary to avert continued implementation and investment in policy or practice that does not affect real-world patient outcomes.


Implementation strategies can also cause harm. For example, the introduction of new interventions into clinical systems can displace other important clinical practices, or incorrect implementation could increase the risk of adverse patient outcomes. Policy-makers and practitioners need to weigh the benefits of implementation of effective interventions with potential unintended harms when making decisions regarding therapeutic intervention or health service investment. As such, evaluation of implementation strategies should include evaluation of both benefits and harms. The cost of implementation is also a fundamental consideration for health services that need to manage finite resources. A recent review of 91 systematic reviews in primary care to improve the implementation of complex interventions concluded that evidence on cost-effectiveness was limited and reporting on costs was scarce and of low quality. Reporting of cost data, or formal cost analyses, as part of trials of implementation strategies would help fill this gap.


Critical appraisal of implementation studies in low back pain


We searched the Cochrane library and PubMed [using the search terms (‘low back pain’ OR ‘musculoskeletal conditions’) AND ‘implementation’ AND ‘review’)] to identify reviews that assessed the effectiveness of implementation strategies to improve the implementation of low back pain care. We then summarised and appraised the individual studies included in the reviews according to methods (attention to the three important features of implementation research outlined above and risk of bias assessment) and content (which implementation strategies are effective).


Characteristics of individual studies


Twenty-one unique trials were included in the five identified systematic reviews (see Table 4 ). Three studies were excluded because they did not report an explicit implementation strategy. One study aimed to improve the implementation of low back pain care guidelines but did not include an implementation strategy and two studies assessed the publication of guidelines without the addition of active implementation strategies . Collectively, these excluded studies provide some evidence that passive dissemination of guidelines is not effective in changing practice .



Table 4

Characteristics of individual implementation studies to improve low back pain care.



































































































Study/Year/Country Study characteristics Study quality risk of bias implementation study quality criteria Study findings
Baker 1987, USA Study design: Interrupted time series;
Participants: number of providers not reported. number of tests 1443 in control year and 759 in experimental year;
Setting: Hospital;


  • Intervention: Reminder: note on X-ray referral form;

Implementation outcomes: Number of emergency lumbosacral spine examinations, use of lumbosacral spine radiography, percentage compliance with limited indications form.
Patient outcomes: None.
Overall: Low
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Empirical evidence informed intervention: NR
Taxonomy used to describe implementation strategies: NR
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention was more effective than control on the use of lumbosacral spine radiography.
Becker 2008, Germany Study design: C-RCT
Participants: 126 GPs from 118 practices, 1378 participants;
Setting: Primary care
Intervention:


  • Intervention 1: Distribution of low back pain guidelines, interactive seminars, individual academic detailing sessions, patient leaflets (educational material + outreach visits + educational meetings);



  • Intervention 2: Distribution of low back pain guidelines, interactive seminars, individual academic detailing sessions, patient leaflets (educational material + outreach visits + educational meetings), motivational counselling session for GPs, training for practice nurses, patient counselling sessions;



  • Comparison: Distribution of guidelines on low back pain (educational material).

Patient outcomes: Functional capacity, physical activity, days in pain, days of sick leave, quality of life and fear avoidance beliefs.
Sequence generation: Low
Allocation concealment: Low
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Low/Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies.
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited from two systematic reviews.
Implementation outcomes: NR
Patient outcomes: Yes
Cost analysis: Yes (reported separately)
Adverse events: NR
Intervention 2 was more effective than control on functional capacity at 6 months, but not 12 months. Intervention 1 was not effective on functional capacity at 6 months or 12 months.
Intervention 1 and 2 were effective on the number of pain days at 6 and 12 months.
Bekkering 2005,
The Netherlands
Study design: C-RCT
Participants: 113 physiotherapists
Setting: Primary care physiotherapy practices


  • Intervention: Group training sessions, postal dissemination of guidelines and education material;



  • Comparison: Postal dissemination of guidelines and educational material.

Implementation outcomes: Adherence to recommended treatment approaches
Patient outcomes: Physical function, pain, sick leave.
Overall: Low
Theoretically informed intervention: Yes – Grol 1994
Intervention targeted identified barriers/enablers: Yes – previous studies and previous survey of Dutch physiotherapists
Taxonomy used to describe implementation strategies: NR

Empirical evidence informed intervention: Yes – empirical evidence
Implementation outcomes: Yes
Patient outcomes: Yes
Cost analysis: NR
Adverse events: NR
The intervention was more effective than the comparison in limiting physiotherapist treatment sessions for patients with normal course of back pain, setting functional treatment goals, using mainly active interventions, giving adequate patient education and adhering to recommended treatment approach criteria.
Physical functioning and pain in the two groups improved substantially in the first 12 weeks; however, no difference was found between the intervention and comparison groups at follow-up.
Bishop 2006, Canada Study design: RCT
Participants: 462 GPs, 428 patients
Setting: Primary care
Intervention:


  • Intervention 1: Distribution of educational materials to GP, reminders;



  • Intervention 2: Distribution of educational materials to GP and patient, reminders to GP and patient;

Comparison: usual care
Implementation outcomes: Concordance with specific clinical guidelines-derived history-taking items, physical examination procedures and treatment recommendations.
Patient outcomes: None.
Sequence generation: Low
Allocation concealment: High
Blinding of participants: NR
Blinding of outcome assessment: Unclear
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention was more effective than usual care in guideline-concordant treatments of prolonged bed rest, passive therapies and recommendations for aerobic exercise.
Dey 2004, UK Study design: C-RCT
Participants: 24 practices, 2187 patients
Setting: Primary care


  • Intervention: Educational outreach visit + guidelines (educational material) + poster of guidelines + referral forms with guidelines + access to fast-track physiotherapy and a back clinic.



  • Comparison: Standard practice.

Implementation outcomes: Rate of referral for lumbar spine X-ray within 3 months, number of sickness certificates issues, number of prescribed opioids or muscle relaxants, number referred to secondary care, number referred to physiotherapy or educational programme.
Patient outcomes: None.
Sequence generation: Low
Allocation concealment: Low
Blinding of participants: NR
Blinding of outcome assessment: High
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Low
Theoretically informed intervention: Yes – ‘elaboration likelihood model of persuasion’ was used in part to inform the intervention
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention was more effective than standard practice in referring patients to physiotherapy or a back pain unit. There was no effect of the intervention on the proportion of patients referred for X-ray, issued with a sickness certificate, prescribed opioids or muscle relaxants or referred to secondary care.
Eccles 2001, UK Study design: C-RCT (2 × 2 factorial design)
Participants: General practitioners from 247 practices
Setting: Primary care
Intervention:


  • Intervention 1: Distribution of educational materials + audit and feedback (number of practice referrals compared with peers;



  • Intervention 2: Distribution of education materials + reminders (messages on X-ray results);



  • Intervention 3: Distribution of educational materials + audit and feedback + reminders;

Comparison:


  • Control group: Distribution of educational materials (guideline).

Implementation outcomes: Number of lumbar radiographs requested per 1000 patients for 2 years.
Patient outcomes: None.
Sequence generation: Low
Allocation concealment: Low
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited for specific prompts at time of consultation and audit and feedback
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention of routine attachment of educational reminder messages on X-ray results was more effective than control in reducing the request rate of lumbar radiographs. No effect of a 6 monthly feedback of audit data intervention on reducing the request rate of lumbar radiographs.
Engers 2005, The Netherlands Study design: C-RCT
Participants: 41 GPs, 531 patients
Setting: Primary care


  • Intervention: 2-h workshop (negotiation skills), guideline on low back pain and guidance on low back pain for occupational physicians, 2 scientific articles, a patient education tool and a management decision tool (distribution of educational materials).



  • Comparison: No intervention, usual care

Implementation outcomes: Number of referrals to a therapist (physical, exercise or manual therapist), prescription of pain medication on a time-contingent basis, prescription of paracetamol versus NSAIDs, adequacy of patient education.
Patient outcomes: None.
Sequence generation: Low
Allocation concealment: High
Blinding of participants: NR
Blinding of outcome assessment: High
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: High
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies cited
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited for distribution of the guideline for occupational physicians and scientific articles concerning GP management of nonspecific low back pain.
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
No effect of the intervention of advice and education provided; prescription of paracetamol or NSAIDs; or the overall number of referrals to physical therapist, exercise therapist or manual therapist.
French 2013, Australia Study design: C-RCT
Participants: 78 practices, 92 GPs
Setting: Primary care


  • Intervention: 2 facilitated interactive educational workshops aiming to facilitate behaviour change plus distribution of educational DVDs to all physicians;



  • Comparison: Usual care;

Implementation outcomes: GP reported behavioural change and number of X-ray and CT requests.
Patient outcomes: Planned, but not measured because of low numbers of patients recruited.
Sequence generation: Low
Allocation concealment: Low
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: High
Selective outcome reporting: High
Other risk of bias: High
Theoretically informed intervention: Yes, Theoretical Domains Framework
Intervention targeted identified barriers/enablers: Yes – focus group interviews with GPs
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – strategies selected using a mapping tool
Implementation outcomes: Yes
Patient outcomes: No
Cost analysis: Yes
Adverse events: NR
The intervention was more effective than usual care in the GP’s intention of practising consistency with the guidelines for the clinical behaviour of X-ray referral, GPs adherence to guideline recommendations about X-ray and advice to stay active. There was no effect of the intervention on imaging referral.
Goldberg 2001, USA Study design: RCT
Participants: Spine surgeons, primary care physicians, patients who were surgical candidates, and hospital administrators
Setting: Entire communities


  • Intervention: Surgeon study group meetings, use of local opinion leaders, GP education sessions, printed educational materials, audit, patient educational materials, financial data analysis meetings;



  • Comparison: Usual care

Implementation outcomes: Surgical procedures carried out from the Comprehensive Hospital Reporting System.
Patient outcomes: None
Overall: High
Sequence generation: High
Allocation concealment: Unclear
Blinding of participants: Unclear
Blinding of outcome assessment: Unclear
Incomplete outcome data: High
Selective outcome reporting: Low
Other risk of bias: Low
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies cited and consultation with clinicians and administrators.
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: No
Cost analysis: Yes (reported intervention cost)
Adverse events: NR
The intervention was effective in reducing surgical rates compared to usual care.
Hazard 1997, USA Study design: RCT
Participants: 59 patients
Setting: primary care


  • Intervention: Distribution of educational materials + reminders to GPs (letters regarding the specific patient with advice on how to limit work loss);



  • Comparison: Control

Implementation outcomes: Influence of care following information provision;
Patient outcomes: 3-month work absence rate, disability (VDPQ score), satisfaction with health care, impact of health care on return to work, days of work loss, days until first return to work.
Sequence generation: Low
Allocation concealment: High
Blinding of participants: NR
Blinding of outcome assessment: High
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: Yes
Cost analysis: NR
Adverse events: NR
No effect of the intervention on 3-month work absence rate, pain, satisfaction with health care, impact of health care on return to work, days or work loss, or days until first return to work.
Kerry 2000, UK Study design: C-RCT
Participants: 69 practices, 175 GPs, 43,778 radiological requests;
Setting: Primary care


  • Intervention: Distribution of guidelines + individual feedback on referral rates + graph of the average radiation dose for different examinations (educational material and audit/feedback);



  • Comparison: Standard care.

Implementation outcomes: number of X-ray requests (chest, limbs and joints, spine) within 12 months;
Patient outcomes: None
Sequence generation: Low
Allocation concealment: Unclear
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: Low
Selective outcome reporting: High
Other risk of bias: Low
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies citing GP lack of guidelines knowledge.
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical (conflicting) evidence cited for end-user involvement in guideline development.
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
No intervention effect on the total number of X-ray requests. Practices that followed the guidelines requested significantly fewer spinal examinations
than standard practice.
Matowe 2002, UK Study design: Interrupted time series
Participants: Number of practices and providers not reported. Analysis included 117,747 imaging requests;
Setting: Primary care


  • Intervention: Professional intervention (distribution of educational materials)

Implementation outcomes: Number of X-ray referrals
Patient outcomes: None
Overall: Low
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
There were no significant effects of the intervention on the total number of requests or requests for individual examinations.
Oakeshott 1994, UK Study design: C-RCT
Participants: 62 practices, analysis was of 2578 X-ray examinations
Setting: Primary care


  • Intervention: Professional intervention (distribution of educational materials)



  • Comparison: Control (not specified)

Implementation outcomes: number of radiology requests within 9 weeks, percentage of radiology requests that confirm to guidelines;
Patient outcomes: None.
Sequence generation: Unclear
Allocation concealment: Unclear
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: Low
Selective outcome reporting: Unclear
Other risk of bias: Low
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
Practices that received the guidelines requested significantly fewer spinal examinations and made significantly higher proportion of requests than those that did not. No intervention effects on the proportion of forms giving physical findings or the proportion of positive findings in radiology.
Robling 2002, UK Study design: C-RCT
Participants: 30 practices, 182 MRI requests
Setting: Primary care


  • Intervention 1: Professional intervention (distribution of educational materials + educational meetings, practice based);



  • Intervention 2. Professional intervention (audit and feedback);



  • Intervention 3. Professional intervention (1 + 2);



  • Comparison: Distribution of educational materials.

Implementation outcomes: proportion of MRI requests that are in concordance with guideline (length of follow-up not clear);
Patient outcomes: None
Sequence generation: Low
Allocation concealment: Unclear
Blinding of participants: NR
Blinding of outcome assessment: Unclear
Incomplete outcome data: Unclear
Selective outcome reporting: Unclear
Other risk of bias: Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited for GP education
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: Yes – intervention cost
Adverse events: NR
No significant differences were found between the four intervention groups in the proportion of MRI requests, which are in concordance with guidelines.
Rossignol 2000, Canada Study design: RCT
Participants: 110 patients
Setting: Primary care


  • Intervention: Organisational intervention (clinical multidisciplinary team)



  • Comparison: Usual care

Implementation outcomes: proportion of patients who received lumbar imaging (X-ray, CT, MRI or myelogram) within 6 months;
Patient outcomes: return to work; function; health care consumption; satisfaction.
Sequence generation: Low
Allocation concealment: Unclear
Blinding of participants: NR
Blinding of outcome assessment: Low
Incomplete outcome data: Unclear
Selective outcome reporting: Unclear
Other risk of bias: High
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: Yes
Cost analysis: NR
Adverse events: NR
The intervention group used significantly less specialised imaging tests of the spine at 6 months than control.
At 6 month follow-up, there was no effect of the intervention on return to work; however, there was evidence of an intervention effect on 3 of 5 functional recovery outcomes compared to usual care.
Schectman 2003, USA Study design: C-RCT
Participants: 85 physicians, 2020 patients, 14 group practice sites
Setting: Primary care


  • Intervention 1. Distribution of guidelines on the management of acute low back pain + educational meeting + feedback on back pain encounters + individual follow-up visit by investigator 6 months afterwards and another feedback on back encounters + educational material for patients including a videotape (educational material + meeting + audit + outreach);



  • Intervention 2. Education materials for patients: pamphlet and video. Two reminders within the first 3 months to clinicians to use these materials (educational material);



  • Intervention 3.1 + 2;



  • Comparison: Control group;

Implementation outcomes: Proportion of lumbar plain X-ray, CT or MRI consistent with guideline within 12 months, Subspecialty referral, Physiotherapy referral;
Patient outcomes: Beliefs about care, satisfaction with care, clinical outcome measures using validated instruments.
Sequence generation: Unclear
Allocation concealment: Low
Blinding of participants: NR
Blinding of outcome assessment: Unclear
Incomplete outcome data: Unclear
Selective outcome reporting: Unclear
Other risk of bias: High
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies
Taxonomy used to describe implementation strategies: NR
Evidence informed intervention: NR
Implementation outcomes: Yes
Patient outcomes: Yes
Cost analysis: NR
Adverse events: NR
Intervention 1 (clinician intervention) was effective in increasing guideline-consistent behaviour compared to control. There was no effect of intervention 2 on guideline-consistent behaviour compared to control.
Stevenson 2006, UK Study design: C-RCT
Participants: 30 physiotherapists
Setting: Primary care


  • Intervention: 5-h education session delivered by a local opinion leader;



  • Comparison: Standard in-service session on knee pathologies;

Implementation outcomes: Change in physiotherapists’ clinical practice (discharge summary questionnaire);
Patient outcomes: None.
Overall: High
Sequence generation: Unclear
Allocation concealment: Unclear
Blinding of participants: Low
Blinding of outcome assessment: Low
Incomplete outcome data: Low
Selective outcome reporting: Low
Other risk of bias: High
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: Yes – previous studies cited.
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited for continual medical education, printed educational material, feedback, clinical guidelines and use of opinion leaders.
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention group was more likely than the control group physiotherapists to give ‘advice to increase activity level’ and ‘change attitudes/beliefs about pain’ but was less likely to ‘encourage to undertake activities themselves’. The control
group was significantly more likely to ‘use acupuncture’, ‘encourage to undertake activities themselves’ and ‘receive postural advice’ compared with the intervention group.
Winkens 1995, The Netherlands Study design: C-RCT
Participants: 79 providers
Setting: Primary care


  • Intervention: Professional intervention (audit and feedback for one set of tests);



  • Comparison: No intervention control

Implementation outcomes: number of diagnostic tests ordered within 2 years; diagnostic tests concordant with guideline;
Patient outcomes: None.
Sequence generation: Unclear
Allocation concealment: Unclear
Blinding of participants: NR
Blinding of outcome assessment: Unclear
Incomplete outcome data: Unclear
Selective outcome reporting: Unclear
Other risk of bias: Unclear
Theoretically informed intervention: NR
Intervention targeted identified barriers/enablers: NR
Taxonomy used to describe implementation strategies: NR
Empirical evidence informed intervention: Yes – empirical evidence cited for GP feedback
Implementation outcomes: Yes
Patient outcomes: NR
Cost analysis: NR
Adverse events: NR
The intervention was effective in decreasing the proportion of non-rational requests compared to control.

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

Nov 10, 2017 | Posted by in RHEUMATOLOGY | Comments Off on Developing implementation science to improve the translation of research to address low back pain: A critical review

Full access? Get Clinical Tree

Get Clinical Tree app for offline access