Skip to main content

What do clinicians want? Understanding frontline addiction treatment clinicians’ preferences and priorities to improve the design of measurement-based care technology

Abstract

Background

Measurement-based care (MBC) is the practice of routinely administering standardized measures to support clinical decision-making and monitor treatment progress. Despite evidence of its effectiveness, MBC is rarely adopted in routine substance use disorder (SUD) treatment settings and little is known about the factors that may improve its adoptability in these settings. The current study gathered qualitative data from SUD treatment clinicians about their perceptions of MBC, the clinical outcomes they would most like to monitor in MBC, and suggestions for the design and implementation of MBC systems in their settings.

Methods

Fifteen clinicians from one publicly-funded and two privately-funded outpatient SUD treatment clinics participated in one-on-one research interviews. Interviews focused on clinicians’ perceived benefits, drawbacks, and ideas related to implementing MBC technology into their clinical workflows. Interviews were audio recorded, transcribed, and coded to allow for thematic analysis using a mixed deductive and inductive approach. Clinicians also completed a card sorting task to rate the perceived helpfulness of routinely measuring and monitoring different treatment outcomes.

Results

Clinicians reported several potential benefits of MBC, including improved patient-provider communication, client empowerment, and improved communication between clinicians. Clinicians also expressed potential drawbacks, including concerns about subjectivity in patient self-reports, limits to personalization, increased time burdens, and needing to learn to use new technologies. Clinicians generated several ideas and preferences aimed at minimizing burden of MBC, illustrating clinical changes over time, improving ease of use, and improving personalization. Numerous patient outcomes were identified as “very helpful” to track, including coping skills, social support, and motivation for change.

Conclusions

MBC may be a beneficial tool for improving clinical care in SUD treatment settings. MBC tools may be particularly adoptable if they are compatible with existing workflows, help illustrate gradual and nonlinear progress in SUD treatment, measure outcomes perceived as clinically useful, accommodate multiple use cases and stakeholder groups, and are framed as an additional source of information meant to augment, rather than replace, existing practices and information sources.

Background

Every year, over 2.5 million American adults receive treatment in substance use disorder (SUD) facilities [1]. Even when patients receive evidence-based treatments in these settings, the clinical course and outcomes of individual patients vary considerably [2, 3].

Measurement-based care (MBC), which is the practice of routinely measuring and reviewing treatment progress using standardized measures, can help patients and clinicians understand whether an individual patient is responding to treatment [4, 5] and can help inform clinical decision-making regarding the current course of treatment. MBC for non-SUD mental health conditions has been associated with better treatment outcomes and improved quality of care, including better detection of clinical improvement and decline, improved therapeutic alliance, more accurate clinical judgments, and improved individualization of care [6]. However, despite the benefits of MBC for non-SUD mental health conditions, the use of MBC in SUD treatment settings has been limited [7].

Little is known about the optimal approaches for incorporating MBC into SUD treatment settings [7, 8]. Although previous research indicates that digital technologies can improve the efficiency of MBC delivery and can reduce burden to clinicians (e.g., by aiding in the administration, scoring, storage, retrieval, and display of MBC data; [9,10,11]), it is important to understand how MBC systems can be best designed for the clinical workflows of SUD-specific treatment settings [12]. A recent review highlighted several clinician-level barriers that impede the use of MBC in mental health treatment, including increased burden in workflows, negative attitudes toward MBC, and concerns that some outcome measures may not be relevant to patients [13]. Developing MBC systems that are perceived by SUD treatment clinicians as beneficial, minimally burdensome, and relevant to the clinical care of patients may therefore improve adoptability and implementation success, potentially leading to improved outcomes and better quality of care for patients [4,5,6].

The current study explored how MBC systems can be optimized for SUD treatment settings by drawing on the expertise of frontline clinicians in SUD treatment settings. We examined clinicians’ perceptions of potential benefits and drawbacks of using MBC in their clinical routines, explored their ideas for designing a MBC delivery system in the context of their existing workflows, and identified their preferences about the clinical outcomes that would be most helpful to routinely measure and monitor. We focused specifically on clinicians as key stakeholders, given their lived experiences in working intensively with patients in SUD treatment and the importance of designing an intervention that is perceived as congruent with current workflows to avoid future implementation problems [14].

Methods

Settings and participants

Fifteen clinicians from three SUD treatment clinics in the Pacific Northwest of the United States participated in the study. Eight clinicians were recruited from a large, publicly funded SUD treatment clinic affiliated with an academic medical center, and seven clinicians were recruited from two smaller clinics affiliated with one privately funded addiction treatment organization. SUD treatment services available at the academic medical center clinic included case management, individual- and group-based psychotherapy (outpatient and intensive outpatient), psychiatric medication management, and buprenorphine treatment for opioid use disorder. SUD treatment services at the two smaller clinics included individual- and group-based psychotherapy (outpatient and intensive outpatient). Participants were recruited via announcements in staff meetings, emails, and recruitment letters. All clinicians provided verbal consent to participate and were remunerated with $50 gift cards for their time. All procedures were approved by the University of Washington Institutional Review Board.

Demographic and professional descriptive data for the clinicians in our sample are shown in Table 1. Most clinicians were female, non-Hispanic, White, and had a bachelor’s or master’s degree. Ages ranged from 26 to 70; durations of experience working in the SUD field ranged from 6 months to 32 years. Participants reported numerous clinical approaches, with over half reporting the use of motivational interviewing and relapse prevention, and a third or more reporting case management, client-centered/humanistic, or twelve-step based approaches. Approximately a quarter or less of the sample reported using medication management, cognitive-behavioral, psychodynamic, family/couple, or other approaches.

Table 1 Sample Descriptive Statistics (N = 15)

Procedures

Each participating clinician completed a semi-structured interview with the study PI in a private setting, typically their clinic office. The interviews included questions about clinicians’ roles in the clinic, their typical work routines, and the clinical data they used to guide their treatments. The interviewer then introduced MBC and asked questions about clinicians’ perceived benefits, drawbacks, preferences, and ideas related to designing MBC systems for SUD treatment settings.

After the interviews, clinicians completed a card-sorting task in which they rated the perceived helpfulness of measuring and monitoring several indicators of clinical progress [15]. The list of progress indicators included several outcomes that are often directly associated with substance use (e.g., alcohol/drug use, craving, harms caused by substances), psychosocial functioning (e.g., depression, anxiety, employment, suicidal ideation), and hypothesized mechanisms of change that have been shown in research to often improve during SUD treatment and predict longer-term treatment outcomes (e.g., abstinence self-efficacy, coping skills, social support; [16,17,18]. The card sorting task only included indicators that could be measurable via patient self-report and included 23 indicators plus five blank cards for writing in additional indicators. Clinicians were asked to sort each indicator into one of three piles indicating whether the outcome would be “most helpful/always helpful”, “somewhat helpful/sometimes helpful”, or “least helpful/rarely helpful” to routinely measure and monitor in the treatments they deliver. After sorting the cards into three piles, they were asked to identify the top three most helpful indicators from the cards they rated as “most helpful/always helpful”.

After the card sorting task, clinicians completed questionnaires to report their demographics, professional backgrounds, and clinical orientations. The interview and card sorting materials are available in the Additional file 1 to this article and were developed by the research team, which included a board-certified addiction psychiatrist and two clinical psychologists with expertise in addiction treatment.

Qualitative analysis

Interviews were audio recorded, transcribed, and loaded into QDA Miner Lite software [19] and Dedoose software [20] for mixed deductive and inductive qualitative analysis. One digital audio file for an interview was corrupted and could not be transcribed; however, card-sorting and questionnaire data from this clinician were available and included in the analysis.

In the first round of coding, a deductive coding procedure was used to identify statements in transcripts that reflected one of three a priori domains, including (1) perceived benefits of MBC, (2) perceived drawbacks or barriers of MBC, and (3) ideas and preferences related to the design and/or implementation of MBC systems within their clinical setting. Two coders developed an initial codebook with criteria for identifying instances of each domain within the transcript text. The coders then independently coded two transcripts to identify instances of these domains and reviewed their codes together to identify discrepancies and refine the criteria outlined in the codebook. The remaining transcripts were then independently coded by both coders. All coding discrepancies were jointly reviewed until 100% agreement was reached.

In the second round of coding, an inductive coding procedure was used to identify emergent themes within each of the three broader domains [21]. Two different coders first read through all transcripts, without coding, to understand overarching themes. The coders then each independently performed open coding of four transcripts (two from the public clinic and two from the private clinics) to develop an initial set of themes within the existing broader domains (benefits, drawbacks, and ideas/preferences related to MBC) and a codebook with codes summarizing those themes. Following, each coder independently applied codes to seven separate transcripts, adding new codes as they emerged from the text. Newly added codes were discussed before coding was completed on the remaining seven transcripts. All code applications and discrepancies were reviewed until 100% consensus was reached. Data was reduced (e.g., combining infrequently used codes that reflected similar themes) and findings summarized with all themes and subthemes endorsed by three or more clinicians retained and presented in the final results.

Results

Qualitative interviews

Qualitative interviews lasted a median of 57 min (range = 44 to 78 min). The final codebook included 11 themes and 29 subthemes. Tables 2 and 3 list the themes and subthemes that were endorsed by three or more clinicians with exemplar quotes. These themes are briefly summarized below, organized by the a priori domains of perceived benefits, perceived drawbacks or barriers, and ideas and preferences related to MBC.

Table 2 SUD Treatment Clinician Perceptions of Measurement-Based Care (MBC) Benefits and Drawbacks
Table 3 SUD Treatment Clinicians’ Ideas and Preferences for Measurement-Based Care (MBC) Systems

Domain 1: perceived benefits of MBC

Improves patient-clinician communication

One of the most frequently mentioned themes was the potential for MBC to improve patient-clinician communication during treatment, under which there were several subthemes (see Table 2). For example, clinicians expressed that MBC could provide additional data that could be compared or contrasted to patients’ verbal reports in sessions to understand patients’ experiences more fully. Several clinicians also brought up the positive influence that MBC could have in structuring their in-person sessions by helping them focus more directly on important issues that might have been raised in MBC assessment results. Clinicians additionally noted that MBC could help patients see progress over time, including changes in substance use or craving that occur gradually, nonlinearly, or that do not include complete abstinence from substance use and therefore may often go unnoticed by patients. Another perceived benefit for MBC was to help detect early warning signs (e.g., increases in craving) that could help facilitate targeted interventions to reduce the risk of adverse outcomes (e.g., unintended substance use). Finally, some clinicians observed that MBC could reduce bias in their communication with patients and thus improve their understanding of patient experiences due to the use of neutral language within standardized MBC assessments.

Empowers patients

Another frequently discussed theme addressed MBC potentially empowering and engaging patients more in their SUD care. Clinicians noted that MBC could encourage recognition of improvements made during treatment and greater reflection around the specific actions that patients took to achieve those improvements. Several clinicians noted that helping patients see how their outcomes changed over time could further instill self-reflection and hopefulness that change is possible, while also normalizing expectations that recovery may develop slowly or be challenged by setbacks. Many also noted that completing MBC questionnaires offered the opportunity for patients to check in with themselves during the moments they completed the questionnaires, providing additional opportunity for self-reflection, including at moments when patients may not be physically inside the treatment setting. Some clinicians noted that, collectively, these experiences could help put patients in a position of greater agency within their own recovery journey.

Improves communication between clinicians

A final theme highlighted that MBC could potentially improve communication between clinicians, both within and across different clinical teams. For example, some clinicians noted that MBC could provide standardized data that multiple clinicians could access for the same patient, which could reduce duplication of different providers asking similar questions to the same patient. Likewise, MBC could improve communication with providers who may have difficulty seeing patients’ improvement when abstinence has not been achieved by introducing other measures of progress capable of capturing incremental gains.

Domain 2: perceived drawbacks or barriers of MBC

Patient self-report is subjective

Several clinicians expressed concerns about potential drawbacks of MBC, one of the most common being a sense of concern that patient-reported outcome measures could include unreliable, incomplete, or inaccurate information. For example, several clinicians noted that patients could self-report inaccurate information in MBC measures, for instance, reporting they are abstinent from substances or participating in recovery-related activities even if they are not. Some clinicians noted that changes in patient attitudes or moods could bias the information they self-report in MBC questionnaires, as could their rapport with clinicians and expectancies related to meeting with clinicians.

Lack of personalization

Some clinicians noted that MBC can lack personalization, in part because standardized questionnaires may lack context, depth, and specificity needed to fully understand a patient’s individual circumstances. Additionally, questionnaires may seem repetitive to some patients and lead to a disengaged form of responding. Some clinicians noted that they may not always be able to review the results of MBC questionnaires that patients have completed, potentially resulting in patients feeling unheard. Some providers also noted that the use of technology (e.g., computers, smartphones) to support measurement-based care could feel rigid or cold and would lack the sensitivities and emotionality of a human clinician.

Burden of time

Other concerns about MBC included potential increased workloads for clinicians, including time spent learning new software, managing and keeping track of hardware (e.g., tablet computers, if used), reviewing of MBC data, and addressing issues that could come to light upon reviewing MBC results. For example, reviewing MBC results may require extra time that is not currently built into clinicians’ workflows and it may take extra time to sort out which information is useful for specific patients and circumstances.

Domain 3: ideas and preferences for MBC systems

Minimize clinician burden

Clinicians expressed several ideas and preferences for the design of MBC systems (Table 3), including suggestions for minimizing burden to clinicians. Suggestions included providing built-in support for clinical documentation, for example, by building features that allow MBC data to supplement or replace elements of their session notes, progress reports, or discharge summaries. Several clinicians also expressed a desire for MBC technology to be integrated with the technologies they already use (e.g., electronic health records) and to be easily accessible (e.g., minimize extra steps needed to access MBC results) to minimize workflow interruptions and more easily access clinical data from a single source. Likewise, clinicians expressed a preference for MBC systems to present the necessary clinical data in a single place (e.g., on a single summary page), in contrast to current practices of looking through multiple historical session notes to obtain necessary information to evaluate change over time. Some clinicians also expressed that organizing MBC results into predefined categories (e.g., organized into higher-level categories like “strengths” and “needs”) could make it easier to find the information they need.

Quantify results over time

Several clinicians expressed preferences related to how results should be quantified and displayed over time. Ideas and preferences included using simple quantitative scales that could numerically summarize clinical progress (e.g., on a 1 to 10 scale) and graphical summaries that could highlight patterns over time (e.g., improvements, decline, or stability). Some clinicians also stated a preference for a single, overall summary score that could combine multiple measures of clinical progress to efficiently understand a patient’s overall progress and/or risk for adverse outcomes.

Easy for patients

Clinicians expressed recommendations for making MBC systems easy for patients to use, noting that questionnaires should be short and simply worded to ensure patients could understand and remain engaged while completing them. Clinicians also reported variable preferences regarding the frequency (e.g., daily, weekly, monthly) and location that patients should complete MBC assessments. Some clinicians indicated that MBC assessments could be completed through a smartphone application, for example, to check in on clinical progress more frequently than what may be feasible if they were only completed at in-person clinic appointments. Others expressed a preference to also have an option for patients to complete MBC questionnaires in designated areas within the clinic.

Emphasize personalization

Finally, some clinicians expressed preferences for MBC systems to be flexible in tracking outcomes that are personalized to the needs of different patients. This could include, for example, assessing patients’ treatment goals as part of the MBC assessment process to help provide context when interpreting clinical outcome measures. Additionally, this could include an option to incorporate different outcome measures that are matched to the unique self-identified goals and concerns of each patient. Clinicians suggested considering measures that could help determine treatment placement needs. Also mentioned was a preference for including options for patients to provide narrative responses to help capture information that may not be ascertained through standardized multiple-choice questions.

Most useful outcomes to measure in MBC

Figure 1 summarizes the card sorting task results in which clinicians rated the usefulness of routinely measuring and monitoring various indicators of clinical progress. Twelve potential outcome measures were rated in the “most helpful/always helpful” category by the majority of clinicians; these measures spanned several broader domains related to current substance use (e.g., current alcohol and drug use, cravings), psychosocial functioning (e.g., suicidality, depression, anxiety), hypothesized mechanisms of change in SUD treatment (e.g., coping skills, motivation, self-confidence to abstain, support for recovery, general support), and other categories (e.g., engagement in valued activities, housing status).

Fig. 1
figure1

Most useful outcomes to monitor in measurement-based care, according to SUD treatment clinicians

Progress indicators that were more often rated as “somewhat helpful/sometimes helpful” or “least helpful/rarely helpful” included twelve-step work, sponsorship in twelve-step programs (e.g., Alcoholics Anonymous), self-identification as a person with addiction, employment or volunteer activities, and harm reduction outcomes.

Discussion

Through qualitative interviews with SUD treatment clinicians, we identified potential benefits, drawbacks, ideas, and preferences related to the use of MBC in SUD treatment settings. These ideas and concerns should be considered when developing and implementing technology to support MBC in SUD treatment settings. Failure to take clinician perspectives into account may result in poor adoption of MBC tools and implementation failure [22], further perpetuating gaps in the use of MBC, an evidenced-based practice that could potentially improve the quality of care for patients in SUD treatment settings.

Clinicians identified several potential benefits of MBC, many of which are well aligned with empirically identified benefits of MBC in non-SUD mental healthcare contexts, including a better ability to detect clinical improvement and decline, improved therapeutic alliance, more accurate clinical judgments, and the ability to modify intervention plans based on assessment measures that are collected [6]. Additionally, clinicians highlighted several benefits that may be particularly salient in the context of SUD treatment. For example, clinicians noted that MBC could be helpful in allowing patients and clinicians to see treatment progress when it occurs gradually or nonlinearly, or when it does not include complete abstinence from substances. These are common experiences in the course of SUD treatment [23] and may not always indicate treatment failure [24] yet may be difficult for some patients and clinicians to notice and appreciate. Additionally, clinicians highlighted that MBC could help facilitate a more multidimensional, self-reflective, holistic, and empowering patient perspective toward SUD treatment, which aligns with contemporary conceptualizations of SUD recovery [25, 26]. This perspective diverges from the common primary focus of measuring and monitoring psychiatric symptoms in MBC for non-SUD mental health conditions [8, 9]. This perspective also contrasts common current practices in SUD treatment where clinical progress is formally or informally gauged using measures that primarily emphasize abstinence (e.g., duration of sobriety, substance toxicology test results), which may result in neglect of other forms of progress that occur outside of the context of abstinence.

The potential drawbacks of MBC that were highlighted by clinicians suggest concerns or pitfalls that may require careful attention when designing and implementing MBC in SUD treatment settings. Although these drawbacks were less frequently mentioned than potential benefits, they should be carefully addressed, including concerns about the validity of patient self-reported data, lack of personalization associated with standardized measures, workload burdens, and concerns about incorporating new technologies into workflows. Similar concerns have been described in the context of MBC in non-SUD mental health settings [13]. However, concerns about the limited validity of patient-reported measures may be particularly salient to many clinicians in the SUD treatment context, where compassion fatigue has been especially shown to engender concerns about misrepresentation and mistrust between clinicians and patients [27].

Recommendations for MBC system design and implementation

The perspectives shared by clinicians highlight several opportunities for optimizing design and implementation of MBC systems in SUD treatment settings. Table 4 provides a list of considerations that may enhance the design of MBC technology, systems, and workflows based on the benefits, drawbacks, ideas, and preferences described by clinicians. Several overarching themes from these recommendations are briefly discussed in the text below.

Table 4 Summary of design considerations for MBC systems

Develop tools to be compatible with current systems and workflows

It may be counterproductive to design MBC technology with a goal of replacing current practices or workflows for evaluating and communicating patient progress. Replacing or excessively altering current workflows, even if they are perceived as burdensome, may have unintended negative consequences on care delivery. Instead, MBC could be presented to clinicians as an additional way of obtaining information about clinical progress and goals from a different perspective than what may be currently available (e.g., verbal reports of progress by patients during treatment sessions, physical appearance, substance toxicology testing, etc.). This additional source of information is meant to supplement clinical judgement, rather than replace it. It may sometimes help with structuring and enriching clinical tasks, while also promoting patient self-reflection and empowerment.

Optimizing MBC systems for team-based care is advisable. Many SUD treatment programs rely heavily on team-based care. Ensuring that all clinicians involved in patient care have access to the same data may help clinicians who provide care to the same patient stay coordinated in their perceptions of patients’ progress and with the services they provide. Without MBC, different clinicians may each have access to different information, depending on the questions a given clinician chooses to ask when meeting with a patient or how the patient presented at that time. In contrast, implementing MBC may help all clinicians within a care team have access to a uniform set of information, while also making assessment processes more efficient and consistent across clinicians.

Integrating MBC with existing technology systems (e.g., electronic health records) may also be critical to limiting burdensomeness. Previous studies have shown that incorporating assessments into electronic health record systems facilitates the adoption of MBC [28] and incompatibility with record systems is often cited as a reason for implementation failure [29].

Highlight gradual, nonlinear progress with data visualization

MBC may be particularly well suited for helping patients and providers understand trends in outcomes that occur slowly, non-linearly, or imperfectly. Whereas patients and clinicians may easily notice changes that are sudden or absolute (e.g., transitioning from daily substance use to complete abstinence, or vice versa), less absolute change patterns are common in SUD treatment [23, 24] and may be more difficult for patients and clinicians to notice. Graphical displays of clinical progress over time (e.g., line graphs) may be one means of illustrating such progress. Additionally, MBC systems could potentially provide interpretations as to whether a trend reflects reliable improvement or decline, increased or decreased risk for adverse outcomes, and/or suggested interventions based on the measures collected [30].

Measure outcomes that are perceived as clinically useful

In contrast to common practices of gauging clinical progress based on complete abstinence from substances (or lack of abstinence), clinicians identified several indicators of change as being equally or more important than measuring substance use. Many of the outcomes that were rated as most clinically useful by clinicians reflected areas that clinicians may directly target in the psychosocial treatments they deliver (e.g., coping skills, motivation, social support) and/or represent psychosocial functioning or quality of life outcomes that patients identify as highly important (e.g., depression, anxiety, suicidality, engagement in valued activities). Including measures of some of these constructs may make MBC systems more clinically useful, while also highlighting that SUD treatment may target numerous clinical outcomes, not just substance use. This could inspire hopefulness among patients while illustrating the potential value of SUD treatment in improving multiple outcome domains that are often highly valued by patients.

Design to accommodate multiple use cases and stakeholder groups

MBC systems may need to be designed with flexibility to accommodate various patient and stakeholder groups. For example, patients may have differing levels of access to technology to complete MBC assessments (e.g., smartphones, computers). Additionally, patients and clinicians may vary in their comfort and ability to use these technologies. Studies suggest that most patients in SUD treatment own smartphones [31]; however, alternative, non-digital approaches to delivering MBC may be necessary for some patients who do not have computers or smartphones or who have limited skills or comfort using them. Prototypes of digital and non-digital MBC tools developed for SUD treatment settings should undergo usability testing with patients and clinicians to identify unanticipated issues with usability and understandability [15, 32].

Building in measures that are personalized to individual patients may also enhance the clinical utility of MBC. For example, MBC systems could include a core set of measures that are relevant to all patients, with options to add in additional measures that may be selected for use with different patients. Routinely assessing treatment goals and allowing open-ended responses may also help contextualize standardized progress measures and highlight the priorities of individual patients.

Address concerns toward patient-reported outcomes

Finally, clinician concerns about the validity of patient-reported outcomes could be addressed directly. One way to do this could be to position patient-reported outcome measures as an important but subjective form of information, meant to supplement other sources of information that may help with understanding complex clinical issues. Introducing MBC with brief training and/or case vignettes that describe how to address potentially inaccurate MBC results may help clinicians feel confident in addressing concerns about potentially inaccurate patient reports. Additionally, the benefits patients may experience by completing MBC questionnaires (e.g., self-reflection, empowerment) could be highlighted to clinicians as a potential benefit to patients, even if there are doubts about the validity of the information patients report. Moreover, treatment programs that utilize MBC could aim to develop a culture in which completion of MBC questionnaires is considered a form of treatment adherence and/or rewarded, and in which punitive clinician reactions to patients’ responses to MBC questionnaires are avoided to help encourage more frequent and candid patient responses.

Limitations

Our study had several noteworthy limitations. First, we sampled only three SUD treatment clinics within two organizations, and it is possible that perspectives would have varied had we included clinicians from additional settings. Although our sample included providers with various training backgrounds, the size of the sample precluded us from directly comparing provider subgroups. Our sample was comprised of predominately white, non-Hispanic female-identifying clinicians and thus had limited representation of Black, Indigenous, and People of Color (BIPOC) clinicians. By design, our sample only included SUD clinicians because of their role as critical stakeholders who are vital to facilitating the use of MBC in SUD treatments; however, we did not evaluate the perspectives of other stakeholders, including patients and clinic leadership in this study. We also did not collect data on some clinician characteristics that could potentially have influenced their opinions about MBC, such as their current or historical experiences using MBC, or their personal treatment history or recovery status. Additionally, while our study identified which progress indicators clinicians perceived as potentially helpful to measure, it did not test whether those indicators were useful when measured routinely in practice, nor if they provide adequate information that would be required for MBC to be acceptable. Our interviews also focused primarily on the use of MBC for clinical practice with individual patients, as opposed to the use of aggregated MBC data across many patients or clinics (e.g., to obtain performance measures or quality indicators). Thus, there may be additional benefits and drawbacks about MBC that may not have been voiced by clinicians during our interviews (e.g., potential benefits of using aggregated MBC data to support quality improvement efforts within clinics, or potential concerns about aggregated MBC data being used to inappropriately draw de-contextualized conclusions about clinicians’ work performance [33]).

Our study also had several strengths. The data were obtained from frontline clinicians who worked in community treatment settings and offered an array of treatment approaches. The perspectives of community-based SUD clinicians have often been under-valued in SUD treatment research, despite their vast wealth of real-world experience delivering SUD treatment to diverse patient populations and extensive practice-based knowledge developed through direct clinical experience. The use of open-ended interview questions paired with rigorous qualitative analyses provided rich and detailed data, informed by real world clinical experience. Such data is critical to understanding how MBC systems may best be developed and tailored to SUD treatment settings, given the patient population and their unique experiences and needs.

Conclusions

MBC has untapped potential for improving the quality, efficiency, and effectiveness of SUD treatment. However, efforts to implement MBC in SUD treatment settings have been hampered by a lack of research on how MBC systems should be designed to be most usable and useful in these settings. The findings of this study suggest SUD treatment providers hold positive perceptions about MBC and would likely be more welcoming of MBC systems if they are designed to be flexible, easy to use, and compatible with existing workflows. This study provides important preliminary information about how MBC technology can be designed to support these design goals and may aid the development, testing, and implementation of MBC systems that fit the unique needs of SUD treatment settings. Incorporating suggestions presented in this paper may improve MBC adoption and increase the likelihood of implementation success, ultimately leading to better a patient care experience and improved treatment outcomes.

Availability of data and materials

Data sharing is not applicable to this article as only qualitative datasets containing direct quotes from clinicians were collected, which we did not obtain consent to share. Research materials used with research participants are available in supplemental materials associated with this article.

Abbreviations

MBC:

Measurement-based care

SUD:

Substance use disorder

References

  1. 1.

    Lipari RN, Van Horn SL. Trends in substance use disorders among adults aged 18 or older. The CBHSQ Report. 2017 (cited 2021 Feb 22). https://www.samhsa.gov/data/sites/default/files/report_2790/ShortReport-2790.html.

  2. 2.

    Wilson AD, Bravo AJ, Pearson MR, Witkiewitz K. Finding success in failure: using latent profile analysis to examine heterogeneity in psychosocial functioning among heavy drinkers following treatment. Addiction. 2016;111(12):2145–54.

    Article  Google Scholar 

  3. 3.

    Litten RZ, Ryan ML, Falk DE, Reilly M, Fertig JB, Koob GF. Heterogeneity of alcohol use disorder: understanding mechanisms to advance personalized treatment. Alcohol Clin Exp Res. 2015;39(4):579–84.

    Article  Google Scholar 

  4. 4.

    Fortney JC, Unützer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–88.

    Article  Google Scholar 

  5. 5.

    Lambert MJ, Whipple JL, Kleinstäuber M. Collecting and delivering progress feedback: a meta-analysis of routine outcome monitoring. Psychotherapy (Chic). 2018;55(4):520–37.

    Article  Google Scholar 

  6. 6.

    Aboraya A, Nasrallah HA, Elswick DE, Ahmed E, Estephan N, Aboraya D, et al. Measurement-based care in psychiatry—past, present, and future. Innov Clin Neurosci. 2018;15(11–12):13–26.

    PubMed  PubMed Central  Google Scholar 

  7. 7.

    Goodman JD, McKay JR, DePhilippis D. Progress monitoring in mental health and addiction treatment: a means of improving care. Prof Psychol Res Pract. 2013;44(4):231–46.

    Article  Google Scholar 

  8. 8.

    Marsden J, Tai B, Ali R, Hu L, Rush AJ, Volkow N. Measurement-based care using DSM-5 for opioid use disorder: can we make opioid medication treatment more effective? Addiction. 2019;114:1346.

    Article  Google Scholar 

  9. 9.

    Scott K, Lewis CC. Using measurement-based care to enhance any treatment. Cogn Behav Pract. 2015;22(1):49–59.

    Article  Google Scholar 

  10. 10.

    Lyon AR, Lewis CC, Boyd MR, Hendrix E, Liu F. Capabilities and characteristics of digital measurement feedback systems: results from a comprehensive review. Adm Policy Ment Health. 2016;43(3):441–66.

    Article  Google Scholar 

  11. 11.

    Lyon AR, Wasse JK, Ludwig K, Zachry M, Bruns EJ, Unützer J, et al. The Contextualized Technology Adaptation Process (CTAP): optimizing health information technology to improve mental health systems. Adm Policy Ment Health. 2016;43(3):394–409.

    Article  Google Scholar 

  12. 12.

    Jensen-Doss A, Hawley KM. Understanding barriers to evidence-based assessment: clinician attitudes toward standardized assessment tools. J Clin Child Adolesc Psychol. 2010;39(6):885–96.

    Article  Google Scholar 

  13. 13.

    Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiat. 2019;76(3):324–35.

    Article  Google Scholar 

  14. 14.

    Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update). Implement Sci. 2016;11(1):146.

    Article  Google Scholar 

  15. 15.

    IDEO DK. The field guide to human-centered design. IDEO Canada; 2015.

  16. 16.

    Kelly JF, Magill M, Stout RL. How do people recover from alcohol dependence? A systematic review of the research on mechanisms of behavior change in Alcoholics Anonymous. Addiction Res Theory. 2009;17(3):236–59.

    Article  Google Scholar 

  17. 17.

    Longabaugh R, Magill M. Recent advances in behavioral addiction treatments: focusing on mechanisms of change. Curr Psychiatry Rep. 2011;13(5):382–9.

    Article  Google Scholar 

  18. 18.

    Witkiewitz K, Marlatt GA. Behavioral therapy across the spectrum. Alcohol Res Health. 2011;33(4):313–9.

    PubMed  PubMed Central  Google Scholar 

  19. 19.

    Lewis RB, Maas SM. QDA Miner 2.0: mixed-model qualitative data analysis software. Field Methods. 2007;19(1):87–108.

    Article  Google Scholar 

  20. 20.

    Dedoose web application for managing, analyzing, and representing qualitative and mixed methods research data. Los Angeles, CA: SocioCultural Research Consultants, LLC; 2020. www.dedoose.com

  21. 21.

    Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15.

    Article  Google Scholar 

  22. 22.

    Trivedi MH, Kern JK, Marcee A, Grannemann B, Kleiber B, Bettinger T, et al. Development and implementation of computerized clinical guidelines: barriers and solutions. Methods Inf Med. 2002;41(5):435–42.

    CAS  Article  Google Scholar 

  23. 23.

    Maisto SA, Hallgren KA, Roos CR, Swan JE, Witkiewitz K. Patterns of transitions between relapse to and remission from heavy drinking over the first year after outpatient alcohol treatment and their relation to long-term outcomes. J Consult Clin Psychol. 2020;88(12):1119–32.

    Article  Google Scholar 

  24. 24.

    Witkiewitz K, Roos CR, Pearson MR, Hallgren KA, Maisto SA, Kirouac M, et al. How much is too much? Patterns of drinking during alcohol treatment and associations with post-treatment outcomes across three alcohol clinical trials. J Stud Alcohol Drugs. 2017;78(1):59–69.

    Article  Google Scholar 

  25. 25.

    Neale J, Finch E, Marsden J, Mitcheson L, Rose D, Strang J, et al. How should we measure addiction recovery? Analysis of service provider perspectives using online Delphi groups. Drugs Edu Prev Policy. 2014;21(4):310–23.

    Article  Google Scholar 

  26. 26.

    Best D, Irving J, Collinson B, Andersson C, Edwards M. Recovery networks and community connections: identifying connection needs and community linkage opportunities in early recovery populations. Alcohol Treat Q. 2017;35(1):2–15.

    Article  Google Scholar 

  27. 27.

    Reyre A, Jeannin R, Largueche M, Moro MR, Baubet T, Taieb O. Overcoming professionals’ challenging experiences to promote a trustful therapeutic alliance in addiction treatment: a qualitative study. Drug Alcohol Depend. 2017;174:30–8.

    Article  Google Scholar 

  28. 28.

    Sayre M, Lapham GT, Lee AK, Oliver M, Bobb JF, Caldeiro RM, et al. Routine assessment of symptoms of substance use disorders in primary care: prevalence and severity of reported symptoms. J Gen Intern Med. 2020;35(4):1111–9.

    Article  Google Scholar 

  29. 29.

    Cifuentes M, Davis M, Fernald D, Gunn R, Dickinson P, Cohen DJ. Electronic health record challenges, workarounds, and solutions observed in practices integrating behavioral health and primary care. J Am Board Fam Med. 2015;28(Suppl 1):S63-72.

    Article  Google Scholar 

  30. 30.

    Hallgren KA, Holzhauer CG, Epstein EE, McCrady BS, Cook S. Optimizing the length and reliability of measures of mechanisms of change to support measurement-based care in alcohol use disorder treatment. J Consult Clin Psychol. 2021;89(4):277–87.

    Article  Google Scholar 

  31. 31.

    Tofighi B, Leonard N, Greco P, Hadavand A, Acosta MC, Lee JD. Technology use patterns among patients enrolled in inpatient detoxification treatment. J Addict Med. 2019;13(4):279–86.

    Article  Google Scholar 

  32. 32.

    Dulin PL, Gonzalez VM, Campbell K. Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: usability and early outcomes. Subst Abus. 2014;35(2):168–75.

    Article  Google Scholar 

  33. 33.

    Wees PJVD, Sanden MWGN-VD, Ayanian JZ, Black N, Westert GP, Schneider EC. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 countries. Milbank Quar. 2014;92(4):754–75.

Download references

Acknowledgements

The authors wish to thank the clinicians who participated in this research.

Funding

This study was funded by National Institute on Alcoholism and Alcohol Abuse (NIAAA) award K01AA024796. DA’s effort on this study was supported NIAAA award K02AA023814. The content is solely the responsibility of the authors and does not necessarily represent the official views of NIAAA or the National Institutes of Health.

Author information

Affiliations

Authors

Contributions

JST, EBC, and KAH contributed the development of the manuscript. EBC, TRJ, KDD, and KAH performed qualitative coding and analysis. DCA and RR helped guide the study design and interpretation of results. KAH served as study PI, designed the research protocol, and conducted the research interviews. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kevin A. Hallgren.

Ethics declarations

Ethics approval and consent to participate

This research was approved by the University of Washington Human Subjects Division, application number 51250. All participants provided informed consent to participate.

Consent for publication

Not applicable.

Competing interests

Dr. Atkins is a co-founder with equity stake in a technology company, Lyssn.io, focused on tools to support training, supervision, and quality assurance of psychotherapy and counseling. All other authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Interview guide, card sort materials, and demographics questionnaire.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tauscher, J.S., Cohn, E.B., Johnson, T.R. et al. What do clinicians want? Understanding frontline addiction treatment clinicians’ preferences and priorities to improve the design of measurement-based care technology. Addict Sci Clin Pract 16, 38 (2021). https://doi.org/10.1186/s13722-021-00247-5

Download citation

Keywords

  • Addiction treatment
  • Measurement-based care
  • Mechanisms of behavior change
  • Progress monitoring
  • Routine outcome monitoring
  • Substance use disorder treatment
  • User-centered design