- Study Protocol
- Open Access
Rural access to MAT in Pennsylvania (RAMP): a hybrid implementation study protocol for medication assisted treatment adoption among rural primary care providers
Addiction Science & Clinical Practice volume 14, Article number: 25 (2019)
The continued escalation of opioid use disorder (OUD) calls for heightened vigilance to implement evidence-based care across the US. Rural care providers and patients have limited resources, and a number of barriers exist that can impede necessary OUD treatment services. This paper reports the design and protocol of an implementation study seeking to advance availability of medication assisted treatment (MAT) for OUD in rural Pennsylvania counties for patients insured by Medicaid in primary care settings.
This project was a hybrid implementation study. Within a chronic care model paradigm, we employed the Framework for Systems Transformation to implement the American Society for Addiction Medicine care model for the use of medications in the treatment of OUD. In partnership with state leadership, Medicaid managed care organizations, local care management professionals, the Universities of Pittsburgh and Utah, primary care providers (PCP), and patients; the project team worked within 23 rural Pennsylvania counties to engage, recruit, train, and collaborate to implement the OUD service model in PCP practices from 2016 to 2019. Formative measures included practice-level metrics to monitor project implementation, and outcome measures involved employing Medicaid claims and encounter data to assess changes in provider/patient-level OUD-related metrics, such as MAT provider supply, prevalence of OUD, and MAT utilization. Descriptive statistics and repeated measures regression analyses were used to assess changes across the study period.
There is an urgent need in the US to expand access to high quality, evidence-based OUD treatment—particularly in rural areas where capacity is limited for service delivery in order to improve patient health and protect lives. Importantly, this project leverages multiple partners to implement a theory- and practice-driven model of care for OUD. Results of this study will provide needed evidence in the field for appropriate methods for implementing MAT among a large number of rural primary care providers.
The high prevalence of opioid use disorder (OUD) in the US continues to have serious public health repercussions, including overdose death. Approximately 1.9 million individuals report a current prescription-related OUD , and the prevalence of heroin-related OUD has more than tripled in the past decade . OUD is a chronic health condition that requires long-term multimodal clinical approaches to engage, treat, retain, promote long term recovery, and prevent additional opioid-related adverse events among patients, such as overdose . OUD in rural areas has taken a particularly heavy toll due to the dearth of health and human services resources available within these communities [4, 5]. Across the US, there likewise has been a continued shift in the cause of overdose deaths in the last 20 years from prescribed opioids, to heroin, to synthetic opioids . Given these rural health challenges, it is paramount to leverage existing resources and strengthen rural service systems to meet the needs of those with OUD.
One area for potential rapid expansion of opioid addiction services is office-based prescribing of medication assisted treatment (MAT), primarily buprenorphine and buprenorphine/naloxone (hereafter defined as buprenorphine) and extended-release naltrexone in combination with psychosocial counseling services. Although office-based treatments, such as buprenorphine, have been shown to be effective in OUD treatment, recent data show 56% percent of rural counties in the US lack a buprenorphine prescriber, and 30% of rural residents in the US live in a county without a buprenorphine prescriber . Rural physician practices report a number of challenges with implementing buprenorphine prescribing. These challenges include concerns of buprenorphine diversion, lack of behavioral health providers/services to which patients can be referred, time constraints to learn about and to provide MAT services, lack of clinic staff to support patient needs, and lack of sufficient financial support/reimbursement for MAT services . In addition, providers also report stigma as a critical barrier faced in prescribing buprenorphine for OUD in rural areas . Given the need for rapid response to the opioid epidemic while considering the challenges of providing high quality office-based MAT, thoughtful and concerted efforts for expanding access to MAT in rural areas are crucial.
Expanding MAT through primary care
Management of patients with chronic health conditions requires intentional efforts to target system- and patient-level factors necessary to significantly and clinically improve patient outcomes [9,10,11,12,13]. The Chronic Care Model importantly is recognized as an effective paradigm for the long term management of chronic conditions and has received attention regarding management of substance use disorder (SUD) [14, 15]. Building upon principles of chronic care management, the purpose of this article is to describe the protocol of a study working to expand access to MAT by utilizing an implementation science framework to initiate a MAT service model in 23 rural Pennsylvania (PA) counties. This project was among a series of initiatives funded by the Agency for Healthcare Research and Quality to expand access and quality of MAT in rural settings (AHRQ 5R18HS025072, PI: DiDomenico). The methods described in this paper have the potential to aid in the advancement of the current implementation science knowledgebase for expanding access to MAT services for OUD in rural areas of the US.
Study design and population
This project is a hybrid implementation study that is specifically recruiting, training, and supporting rural primary care providers (PCPs) in delivering MAT services to Medicaid enrollees served within their practices. Hybrid designs focus on assessing formative study outcomes related to implementation and summative outcomes related to intervention efficacy. This project leverages existing payers and local providers in identified rural communities to support MAT expansion in order to facilitate long-term service provision to patients with OUD (Fig. 1). Individuals enrolled in Medicaid living in rural areas is a critical population of focus given that the Medicaid program provides health coverage to 24% of non-elderly adults in rural areas. Moreover, the Medicaid program provides health coverage for nearly 40% of those with OUD in the US .
This project is currently being implemented among practices that serve Medicaid enrollees in 23 PA counties designated as rural by Rural–Urban Continuum Codes [17, 18]. Pennsylvania is 8th overall in overdose deaths within the US . The counties in this project were selected based on whether their OUD prevalence and/or overdose death rate was above the national average , and thus, represented areas of greatest need for OUD treatment expansion.
This project is being executed through collaboration among a number of key state/private organizations, leaders, researchers, and stakeholders. The PA Department of Human Services (DHS), which is the state agency that administers the Medicaid program and is a large payer of MAT of the managed care Medicaid providers targeted in this project. DHS collaborates with the PA Department of Drug and Alcohol Programs and the following agencies to form a Steering Committee that guides the project:
PA Medicaid Managed Care Organizations (MCOs).
An Implementation Team located within the University of Pittsburgh School of Pharmacy.
Addiction medicine clinical and educational programs within the UPMC Western Psychiatric Institute and Clinic and the University of Utah.
Local care management professionals.
A Project Evaluation Team based at the University of Pittsburgh and University of Utah; comprised of addiction medicine, internal medicine, health policy, and social work faculty and staff.
Participating primary care practices and the patients which they serve.
Partner roles, site identification, and recruitment
PA DHS is facilitating all partnerships with the participating project collaborators and is managing all support components of the intervention for the participating primary care practices. PA DHS is also receiving active support and feedback from the project Steering Committee. PA DHS, Medicaid MCOs, and the Implementation Team work together to identify, recruit, and engage primary care practices. MCOs also specifically recommend practices to DHS based on their knowledge of their existing capabilities, Medicaid enrollee patient volume, and likelihood of successfully initiating and sustaining MAT. Once MCOs provide recommendations to DHS; the DHS team, MCO representatives, and the Implementation Team begin the recruitment and engagement process. The Implementation Team also has engaged in a number of additional outreach activities to contact potential practices, including directly contacting clinics, rural-based health systems, healthcare agencies, and provider associations as well as seeking referrals from behavioral health providers in the area. The goal is to recruit 24 practices within the 23 counties during the three project years.
Practice-based MAT delivery model intervention
The model of MAT implemented in all participating practices adheres to current guidelines from the American Society of Addiction Medicine (ASAM) on the use of medications in the treatment of OUD [21, 22]. The ASAM delivery model focuses on provider processes that include assessment, diagnosis, treatment, and considerations for populations with behavioral health needs.
Screening, care management referral, and assessment
Participating practices are trained in and subsequently screen patients for OUD using the NIDA-Modified Alcohol, Smoking, and Substance Involvement Screening Test . Primary care practices are also trained in the provision of motivational interviewing principles for the purpose of engaging patients and motivating them to accept a referral to the Rural Access to MAT in Pennsylvania (RAMP) program. Patients that screen positive on the screening test are then referred to RAMP-involved care managers who conduct a confirmatory assessment for OUD using the Diagnostic and Statistical Manual of Mental Disorders (DSM-5)  criteria and who also assess patients’ other mental health and psychosocial needs. From this assessment, patient eligibility for MAT is determined and the patient is enrolled with RAMP. Following enrollment, patients are given a comprehensive assessment, which includes a physical exam, screening for concomitant medical conditions, appropriate laboratory testing, pregnancy testing, and tobacco screening and cessation counseling. Following assessment, PCPs diagnose patients with OUD if confirmation is obtained via: (1) patient’s reported substance use behaviors during the confirmatory assessment, (2) communication with an ancillary prescribing provider, or (3) through a validated clinical scale (such as the Clinical Opioid Withdrawal Scale). Urine testing is also recommended whenever possible and deemed appropriate to help confirm patient histories.
Patients are subsequently referred and provided with a warm handoff by the PCP and/or clinic staff using principles of motivational interviewing to care management professionals from organizations that participate in DHS’ OUD Centers of Excellence programs , county public SUD treatment management entities, local substance use treatment centers, or onsite nurse care managers who have volunteered to be trained by the Implementation Team in the Massachusetts nurse care manager model . DHS Centers of Excellence are a network of sites across PA that receive state support to provide OUD services to patients and support to health care providers who are caring for those with OUD ; Centers are specifically modeled after the behavioral health home model [27,28,29]. Care managers further assess the patient to determine the level of needed OUD care (e.g., whether patients require ambulatory detoxification). Assessment to determine the level of OUD care follows either the Pennsylvania Placement Criteria for Adults  or the ASAM Criteria . Once the detoxification is completed or determined to not be needed, the care management professional and patient make a subsequent appointment with the PCP for MAT treatment recommendation and initiation.
Treatment recommendation and induction
PCPs and the care management team consider patient preferences and treatment history when determining the optimal treatment recommendations and treatment settings for the patient, which focus in the current project is buprenorphine or extended-release naltrexone delivered in outpatient settings. However, if the PCP believes that after consultation with intervention supports (e.g., addiction medicine teleconsultation), the patient is best suited for a higher-level of care (e.g., inpatient treatment), the PCP makes such a referral in coordination with the care management professionals.
As part of recruitment of the implementation sites, we have found that not all participating PCPs are immediately comfortable with prescribing all types of medications for OUD. The Implementation Team assesses where each site is at with their readiness to provide MAT, and some practices begin by screening and referring, such as a “hub and spoke” model, and others pursue their DATA 2000 waiver to begin prescribing buprenorphine. However, the Implementation Team continues to work with PCPs with the ultimate goal of increasing their experience and comfort with offering MAT.
Care management and psychosocial services
In concert with MAT initiation, care management professionals coordinate a number of different services to support the patient’s OUD treatment. These services include additional community behavioral health services, continuing patient engagement in OUD treatment, assisting patients navigating transitions of care (e.g., inpatient hospitalization to outpatient treatment), patient self-management training, peer support, supporting patients in ongoing behavioral health and OUD counseling services, and communication with law enforcement, such as parole or probation officials. Importantly, care management also involves connecting patients to community-based services and recovery support specialists to help them address housing, food security, or transportation needs.
PCP clinical support
As rural practices are enrolled in the project, they are offered clinical supports to ensure successful MAT service provision: which include peer consultation, peer support, and education. PCPs have access to a peer-to-peer teleconsultation service staffed by addiction medicine providers or that are facilitated by the Implementation Team. PCPs can contact specialists to receive consultation on treatment decisions for individual patients and discuss questions or concerns about the structure of MAT in their clinic. PCPs also have the option of obtaining consultation services via email. The project goal for responding to consultation requests is to return all provider phone queries within 30 min and email within 24 h. Teleconsultation addiction experts can also coordinate with the program website to communicate commonly asked questions and concerns.
Clinical addiction specialists and the Implementation Team offers site-specific tailored intervention resources designed to improve and sustain access to MAT for OUD in primary care settings. Provision of such resources that are aimed at increasing the knowledgebase and clinical proficiency of prescribers and multidisciplinary providers have shown to improve the number of prescribers of MAT and to encourage and enhance high quality care [32, 33]. In the current project, the Implementation Team, project website, and consulting addiction specialist offer MAT training and education for each clinic site, a link to the DATA2000 waiver training for PCPs needing certification, a webinar series based on clinic questions and concerns or other related topics identified as needed by project staff, training and support for patient self-management, and consultation services.
Noted above, rural primary care practices often lack the resources necessary to provide MAT. All MAT, behavioral, and physical health related services delivered within the project service model are reimbursable through Medicaid MCO contracts with providers. Practices recruited to participate in this project are directly connected with billing specialists from their corresponding Medicaid MCOs to instruct on appropriate procedures and available billing codes to ensure adequate reimbursement for services provided to sustain MAT expansion within the clinic.
The process for supporting the MAT program implementation follows the Framework for Systems Transformation (STF) [34, 35] and encompasses 7 domains, see Table 1. The domains are: Vision, Leadership, Performance Measurement, Internal Learning, External Learning, Organizational Culture/Behavior, and Organizational Structure. The implementation team uses the STF to understand the organizational health of each implementation site and partnership, which helps determine the amount of resources necessary to ensure the program meets its implementation goals and to support the sites in the development of a common programmatic vision, specification of implementation processes, collection of implementation related data, and application of continuous quality improvement efforts.
Quality improvement efforts
Data collected from each participating site are used to ensure that the primary care practice and collaborating partners are implementing the Project RAMP as designed. The data collected from the primary care practices includes SUD screening counts and data related to naltrexone and buprenorphine administration, such as the stage of treatment (initiation versus maintenance) and date of administration. Other collaborating partners, such as the care management teams, collect data related to contact and follow-up with patients, assessment results, and reasons for discharge from treatment. This data is provided via a web-based application system and/or paper-based spreadsheets faxed to the implementation team, which regularly provides aggregated data back to the sites and to the Steering Committee.
To assess outcomes, the Evaluation Team will conduct a retrospective claims-based analysis and a prospective patient-level survey. For the claims-based analysis, the Evaluation Team will use Pennsylvania Medicaid enrollment, claims, and encounter data to assess the extent MAT utilization increased for Medicaid beneficiaries in participating counties and practices following the intervention implementation during the three-year project period, 2016–2018. Using these data, a number of dependent variables will be constructed for analysis (Table 2), for instance: MAT provider supply defined as number of unique providers billing Medicaid for MAT, OUD prevalence, and MAT utilization. With these indicators, outcomes will be examined across time to assess whether implementation is correlated with changes in the indicators.
For the prospective patient survey, participants will be recruited at the various clinic sites. The purpose of the survey will be to assess patient’s perceived access to care and level of satisfaction as well as changes in these domains over a 6-month follow up period after patients are recruited into the project. Recruitment of patients is conducted by both the primary care physician and the care management team. Patient survey packets are distributed to eligible individuals, and those interested are asked to mail back a form indicating their willingness to be contacted by the research team. Survey responses cover items from the Consumer Assessment of Healthcare Providers and Systems survey, Primary Care Center Study Patient Satisfaction Questionnaire, and the Client Perception of Coordination Questionnaire. In addition to close-ended survey questions, participants will also be asked a series of open-ended research questions, which will explore perceived satisfaction, quality of care, and stigma. Participants receive a $10 gift card as remuneration for participation.
This project provides a needed response to a major gap in the availability of MAT in rural areas. Results of this project have the potential to advance the field in two important ways. First, this project recognizes opioid-related adverse events, including OUD, are indeed chronic health conditions  and delivers MAT following a chronic condition management model of care, which models have demonstrated in previous research to result in important improvements for patient outcomes [9,10,11,12,13]. Specifically, the service model in this project initiates a redesign of the current delivery system into a proactive approach that facilitates care the management professionals working with rural PCPs, so patients may have access to an interdisciplinary team. This project also works with key staff to ensure leadership is invested and motivated to provide the care required for MAT and reimbursement is available to practices, which engagement efforts have been identified as critical aspects for sustainment of new practices within health care settings [36,37,38]. Efforts within Project RAMP also include providing expert-informed decision support to guide patient care and grow PCPs’ skillsets . Lastly, Project RAMP offers training and expertise to PCPs via webinars and phone and email responses to questions on MAT and patient self-management. In the spirit of self-management, PCPs and care management professionals work to identify and refer patients to beneficial services and resources.
The second important contribution this project makes is that it follows an implementation model, the Framework for Systems Transformation [34, 35], in order to ensure high fidelity for model implementation. Given the gap between real-world public health application and scientific discovery in the field, rigorous monitoring and evaluation of implementation efforts of evidence-based health care models into practice has been increasingly valued in recent years [40,41,42]. Thus, the chronic care based MAT model of service utilized in this project follows an implementation process designed to iteratively monitor and provide feedback to project leaders and practitioners. Utilization of implementation science has broad support for evidence-based practice implementation and results in service adoption, maintenance, and long-term outcomes [40, 43,44,45]. Utilization of such a framework is especially important in rural areas given limited resources available for training and monitoring health and human services.
Rural areas in the US have been hit particularly hard by the current OUD and overdose epidemic given the paucity of health and human services resources available [4, 5]. This project has the potential to provide a model for how other states in the US can expand access to MAT. Components of this project may be transferable to other rural counties in the US, including working with payers to identify communities in need, recruiting key staff within PCP practices to help move forward project needs, and leveraging existing community resources to support behavioral and care management needs of patients.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study—data are forthcoming.
Han B, Compton WM, Blanco C, Crane E, Lee J, Jones CM. Prescription opioid use, misuse, and use disorders in U.S. adults: 2015 National Survey on Drug Use and Health. Ann Intern Med. 2017;167(5):293–301.
Martins SS, Sarvet A, Santaella-Tenorio J, Saha T, Grant BF, Hasin DS. Changes in US lifetime heroin use and heroin use disorder: prevalence from the 2001–2002 to 2012–2013 National Epidemiologic Survey on Alcohol and Related Conditions. JAMA Psychiatry. 2017;74(5):445–55.
NIDA. Drugs, brains, and behavior: the science of addiction. Bethesda: National Institutes of Health, National Institute on Drug Abuse; 2010.
Havens JR, Oser CB, Leukefeld CG, et al. Differences in prevalence of prescription opiate misuse among rural and urban probationers. Am J Drug Alcohol Abuse. 2007;33(2):309–17.
Young AM, Havens JR, Leukefeld CG. A comparison of rural and urban nonmedical prescription opioid users’ lifetime and recent drug use. Am J Drug Alcohol Abuse. 2012;38(3):220–7.
CDC. Understanding the epidemic. 2018. https://www.cdc.gov/drugoverdose/epidemic/index.html. Accessed 26 Mar 2019.
Andrilla CHA, Moore TE, Patterson DG, Larson EH. Geographic distribution of providers with a DEA waiver to prescribe buprenorphine for the treatment of opioid use disorder: a 5-year update. J Rural Health. 2018;35(1):108–12.
Andrilla CHA, Coulthard C, Larson EH. Barriers rural physicians face prescribing buprenorphine for opioid use disorder. Ann Fam Med. 2017;15(4):359–62.
Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium. Health Aff. 2009;28(1):75–85.
de Bruin SR, Versnel N, Lemmens LC, et al. Comprehensive care programs for patients with multiple chronic conditions: a systematic literature review. Health Policy. 2012;107(2–3):108–45.
Thota AB, Sipe TA, Byard GJ, et al. Collaborative care to improve the management of depressive disorders: a community guide systematic review and meta-analysis. Am J Prev Med. 2012;42(5):525–38.
Tsai AC, Morton SC, Mangione CM, Keeler EB. A meta-analysis of interventions to improve care for chronic illnesses. Am J Manag Care. 2005;11(8):478–88.
ImprovingChronicCare. The chronic care model. 2014. http://www.improvingchroniccare.org/. Accessed 3 June 2014.
McLellan AT, Starrels JL, Tai B, et al. Can substance use disorders be managed using the chronic care model? Review and recommendations from a NIDA consensus group. Public Health Rev. 2014;35(2):8.
McLellan AT, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. JAMA. 2000;284(13):1689–95.
KFF. Medicaid’s role in addressing the opioid epidemic. Menlo Park: Kasier Family Foundation; 2018.
USDA. Rural-Urban Continuum Codes. 2013. http://www.ers.usda.gov/data-products/rural-urban-continuum-codes/documentation.aspx#.VC61zGddUrA. Accessed 3 Oct 2014.
Baldwin LM, Andrilla CH, Porter MP, Rosenblatt RA, Patel S, Doescher MP. Treatment of early-stage prostate cancer among rural and urban patients. Cancer. 2013;119(16):3067–75.
CDC. Drug overdose deaths by state, US 2013 and 2014. 2016. http://www.cdc.gov/drugoverdose/data/statedeaths.html. Accessed 24 Feb 2016.
CountyHealthRankings&Roadmaps. Pennsylvania drug overdose deaths. 2018. http://www.countyhealthrankings.org/app/pennsylvania/2018/measure/factors/138/data?sort=desc-3. Accessed 27 Aug 2018.
American Society of Addiction Medicine. Quality & Practice: National Practice Guideline. 2016. http://asam.upgrade.matrixdev.net/quality-practice/guidelines-and-consensus-documents/npg. Accessed 24 Feb 2016.
Kampman K, Jarvis M. American Society of Addiction Medicine (ASAM) National Practice Guideline for the use of medications in the treatment of addiction involving opioid use. J Addict Med. 2015;9(5):358–67.
National Institute on Drug Abuse. Resource guide: screening for drug use in general medical settings. 2016. https://www.drugabuse.gov/publications/resource-guide-screening-drug-use-in-general-medical-settings/nida-quick-screen. Accessed 26 Feb 2016.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Arlington: American Psychiatric Publishing; 2013.
PADHS. Centers of excellence. 2018. http://www.dhs.pa.gov/citizens/substanceabuseservices/centersofexcellence/. Accessed 24 July 2018.
LaBelle CT, Han SC, Bergeron A, Samet JH. Office-based opioid treatment with buprenorphine (OBOT-B): statewide implementation of the Massachusetts collaborative care model in community health centers. J Subst Abuse Treat. 2016;60:6–13.
Centers for Medicare and Medicaid Services. Medicaid health homes: an overview. Baltimore: Centers for Medicare and Medicaid Services; 2015.
Centers for Medicare and Medicaid Services. Health homes. 2016. https://www.medicaid.gov/Medicaid-CHIP-Program-Information/By-Topics/Long-Term-Services-and-Supports/Integrating-Care/Health-Homes/Health-Homes.html. Accessed 19 Feb 2016.
SAMHSA. Behavioral health homes for people with mental health and substance use conditions. Washington: SAMHSA-HRSA Center for Integrated Health Solutions; 2012.
Commonwealth of Pennsylvania Department of Drug and Alcohol Programs. Pennsylvania’s client placement criteria for adults. Harrisburg: Commonwealth of Pennsylvania Department of Drug and Alcohol Programs; 2014.
Mee-Lee D, editor. The ASAM criteria: treatment criteria for addictive, substance related, and co-occurring conditions. 3rd ed. Chevy Chase: American Society on Addiction Medicine; 2013.
Gordon AJ, Liberto J, Granda S, Salmon-Cox S, Andree T, McNicholas L. Outcomes of DATA 2000 certification trainings for the provision of buprenorphine treatment in the Veterans Health Administration. Am J Addict. 2008;17(6):459–62.
Gordon AJ, Liberto J, Granda S, Salmon-Cox S, Andrée T, McNicholas L. Physician training is never a failure. Am J Addict. 2009;18(4):337–8.
Diamond L, Kues J, Sulkes D. The quality improvement education (QIE) roadmap: a pathway to our future. Birmingham: The Alliance for Continuing Education in the Health Professions; 2015.
Scott KA, Pringle J. The power of the frame: systems transformation framework for health care leaders. Nurs Adm Q. 2018;42(1):4–14.
Bokhour BG, Fix GM, Mueller NM, et al. How can healthcare organizations implement patient-centered care? Examining a large-scale cultural transformation. BMC Health Serv Res. 2018;18(1):168.
Stumbo SP, Ford JH 2nd, Green CA. Factors influencing the long-term sustainment of quality improvements made in addiction treatment facilities: a qualitative study. Addict Sci Clin Pract. 2017;12(1):26.
Willis CD, Saul J, Bevan H, et al. Sustaining organizational culture change in health systems. J Health Organ Manag. 2016;30(1):2–30.
Chauhan BF, Jeyaraman MM, Mann AS, et al. Behavior change interventions and policies influencing primary healthcare professionals’ practice—an overview of reviews. Implement Sci. 2017;12(1):3.
Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;3(1):32.
Ostergren JE, Hammer RR, Dingel MJ, Koenig BA, McCormick JB. Challenges in translational research: the views of addiction scientists. PLoS ONE. 2014;9(4):e93482.
Lobb R, Colditz GA. Implementation science and its application to population health. Annu Rev Public Health. 2013;34:235–51.
Titler MG. The evidence for evidence-based practice implementation. In: Hughes RG, editor. Patient safety and quality: an evidence-based handbook for nurses. Rockville: AHRQ; 2008.
Cabassa LJ. Implementation science: why it matters for the future of social work. J Soc Work Educ. 2016;52(Suppl 1):S38–50.
Wells KB, Jones L, Chung B, et al. Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities. J Gen Intern Med. 2013;28(10):1268–78.
Sullivan MD, Edlund MJ, Fan MY, Devries A, Brennan Braden J, Martin BC. Risks for possible and probable opioid misuse among recipients of chronic opioid therapy in commercial and Medicaid insurance plans: the TROUP Study. Pain. 2010;150(2):332–9.
This study was supported by a grant from the Agency for Healthcare Research and Quality (5R18HS025072, PI: DiDomenico).
Ethics approval and consent to participate
This project was approved by the University of Pittsburgh Institutional Review Board for human subjects and complies with all ethical standards and participant consent requirements required.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.