Skip to main content

Optimizing internet-delivered cognitive behaviour therapy for alcohol misuse—a randomized factorial trial examining effects of a pre-treatment assessment interview and guidance

Abstract

Background

Internet-delivered cognitive behavioral therapy (ICBT) for alcohol misuse has potential to radically improve access to evidence-based care, and there is a need to investigate ways to optimize its delivery in clinical settings. Guidance from a clinician has previously been shown to improve drinking outcomes in ICBT, and some studies suggest that pre-treatment assessments may contribute in initiating early change. The objective of this study was to investigate the added and combined effects of a pre-treatment assessment interview and guidance on the outcomes of ICBT for alcohol misuse delivered in an online therapy clinic.

Methods

A 2X2 factorial randomized controlled trial was conducted where participants received access to an 8-week ICBT program, and either a pre-treatment assessment interview (Factor 1), guidance (Factor 2), a combination of these, or neither of these. Participants were 270 individuals (66.8% female, mean age = 46.5) scoring 8 or more on the Alcohol Use Disorders Identification Test and consuming 14 standard drinks or more in the preceding week. Primary outcomes were number of drinks consumed and number of heavy drinking days during the preceding week, 3 months post-treatment.

Results

Large within-group effects were found in terms of alcohol reductions (dw ≥ 0.82, p < 0.001), but neither of the factors significantly improved drinking outcomes. Guidance was associated with greater adherence (i.e. completed modules).

Conclusions

Neither a pre-treatment assessment interview nor guidance from a clinician appears to improve drinking outcomes resulting from internet-delivered cognitive behaviour therapy for alcohol misuse when delivered in a routine online therapy clinic.

Trial registration: NCT03984786. Registered 13 June 2019, https://clinicaltrials.gov/ct2/show/NCT03984786

Background

Alcohol misuse contributes greatly to the global burden of disease [1, 2], but only one in six receive treatment [3]. Internet interventions could radically increase access to evidence-based treatment for the alcohol misuse population, and with a recent individual patient-data meta-analysis (IPDMA) demonstrating that they render significant alcohol reductions [4], the question no longer appears to be whether these interventions are effective, but rather how their effects can be optimized when implemented in routine online therapy clinics [5] and other clinical settings.

The most common way of optimizing effects in internet interventions is through adding guidance from a clinician [6]. In the previously mentioned IPDMA, guided interventions were found superior to unguided ones (comparative reduction: − 6.78 drinks) [4]. However, there are several reasons that more research on guidance is needed: first, the IPDMA did not distinguish between the two main intervention formats: internet-based cognitive behavioral therapy (ICBT) and personalized normative feedback (PNF). In fact, only three studies in the IPDMA compared guided to unguided ICBT; two found small and medium differential effects in favor of guidance [7, 8], and one did not find differential effects [9]. Second, several recent trials have failed to find differential effects between guided and unguided ICBT [10,11,12], indicating that effects of guidance may not be as robust as suggested by the IPDMA. Further, none of the above mentioned studies were conducted in routine care clinics, suggesting a need to investigate the effects of guidance when ICBT is delivered in clinical settings.

Exposure to structured assessments represents another factor that may improve drinking outcomes in alcohol treatment, a phenomenon referred to as assessment reactivity (AR) [13,14,15]. Although the exact mechanisms of AR are unknown, it has been hypothesized that being asked to reflect on one’s own drinking may lead to recognition of a discrepancy between current behaviour and personal values, which, in turn initiates change [16]. AR has been observed at pre-treatment, post-treatment and follow-up assessments [17], and research suggests that semi-structured pre-treatment assessment interviews render immediate reductions in drinking. For example, in one study, where females with alcohol problems received three assessment interviews prior to being randomized to receive either individual or couples CBT, 44% of participants became abstinent prior to treatment start, and these participants also had significantly better drinking outcomes both during treatment and at 12-month follow-up [18]. In a trial of adolescents with substance use problems where all participants underwent an intake assessment interview before treatment start, 51% had become abstinent by the first session, with further analyses showing that those abstinent by the first session had significantly better drinking outcomes at the last session of the treatment than those not abstinent [19]. In a third study, significant reductions were observed in a non-help seeking control group after participating in an extensive intake interview [20]. Although none of these studies employed an experimental design, the findings appear consistent with an AR effect. Furthermore, the initial alcohol reductions observed were related to longer-term reductions in two of the studies [18, 19], suggesting that pre-treatment assessment interviews have potential as a treatment component that could help optimize treatment effects of internet interventions. However, there are no studies investigating the impact of pre-treatment assessment interviews in ICBT for people with alcohol misuse.

The aim of the current factorial randomized controlled trial was to examine optimal delivery of ICBT for alcohol misuse in a routine online therapy clinic through the application of two specific factors: an assessment interview guided by the alcohol use disorder module of the Structured Clinical Interview DSM-5 (SCID-5) (Factor 1) and guidance from a clinician (Factor 2).

We hypothesized that at the 3-month follow-up:

  1. a)

    participants receiving the assessment interview would have reduced their drinking more than those not receiving the assessment interview;

  2. b)

    participants receiving guidance would have reduced their drinking more than those not receiving such guidance; and

  3. c)

    participants receiving a combination of the two factors (assessment interview and guidance), would have reduced their drinking more than any of the other three treatment conditions.

Secondarily, we evaluated immediate effects of the assessment interview on drinking and motivation to change, hypothesizing that, at pre-treatment:

  1. a)

    participants receiving the assessment interview would have reduced their drinking more than those not receiving the assessment interview; and

  2. b)

    participants receiving the assessment interview would have increased their motivation to change their drinking more than those not receiving the assessment interview.

We further hypothesized that reductions at pre-treatment would be significantly associated with drinking at the 3-month follow-up.

Methods

Trial design

This study was a 2X2 factorial randomized controlled trial where all participants received access to an 8-week ICBT program, and either an assessment interview (Factor 1), guidance (Factor 2), a combination of these (Factor 1 and 2), or neither of these. The trial was conducted at the Online Therapy Unit (OTU; www.onlinetherapyuser.ca), based at the University of Regina, Saskatchewan, Canada. The OTU routinely offers ICBT to residents of Saskatchewan free of charge, financed by the Saskatchewan Ministry of Health. The study was registered at www.clinicaltrials.gov (NCT03984786) and approved by the University of Regina Ethics Review Board (approval number 2019-058). The protocol has been published [21].

Participants

Participants were recruited through a variety of methods, including Google and Facebook ads across Canada; emails and posters distributed to primary care physicians in Saskatchewan; and emails sent to Canadian organizations. Interested participants were directed to the OTU webpage, where they could complete a consent form and questions regarding contact information, background information (e.g., demographics, medical history, mental health history etc.), alcohol use, depression, and anxiety. Applicants meeting initial inclusion criteria scheduled a telephone screening call with OTU staff. In the call (conducted within 1–2 weeks of survey completion), applicants were asked follow-up questions to the screening questions to confirm eligibility, and were asked to verbally consent to participation. To be included in the trial, participants had to (a) be 18 years or older; (b) be a Canadian resident; (c) have access to the internet; (d) score ≥ 8 on the Alcohol Use Disorder Identification Test (AUDIT) [22] indicating at least hazardous drinking; and (e) have consumed ≥ 14 drinks in the preceding week. Applicants were excluded from the trial if they presented with (a) > 24 on the Patient Health Questionnaire 9-item (PHQ-9) [23]; b) suicidal ideation; (c) unmanaged bipolar disorder or schizophrenia; (d) > 24 on the Drug Use Disorder Identification Test (DUDIT) [24] or severe substance use problems as assessed in the telephone enrollment call; (e) low motivation to engage with online treatment as assessed in the telephone enrollment call; (f) frequent visits with a mental health professional (i.e., more than twice a month); or (g) hospitalization for mental health reasons in the past year. Ineligible applicants were referred to appropriate services or were offered the course without being included in the trial.

Randomization

Immediately after eligibility had been confirmed and verbal consent had been obtained in the telephone screening call, screening staff randomized participants to one of the four treatment conditions. The randomization sequence was pre-generated on http://randomization.com using blocks of 16 and uploaded to the survey system used for data collection. The sequence was hidden from the staff randomizing and participants were blinded to the factors investigated. At the end of screening calls, all participants received a username and temporary password, along with instructions for accessing the course. All participants were given access to the ICBT program on the second Monday after randomization. This treatment delay was chosen to allow a minimum period of nine days to evaluate changes in drinking and motivation to change resulting from the assessment interview.

Intervention: the alcohol change course

The Alcohol Change Course (ACC) is an ICBT program originally developed in Switzerland [25,26,27] and translated to English [28] to target alcohol misuse and depression in young adults. For the purpose of this study, the program was adapted for use by adults, with relevant information about alcohol use in Canada (prevalence, guidelines etc.), abstinence, and the impact of alcohol on physical health added to Lesson 1. Further, the program content was restructured to be consistent with the OTU’s other ICBT programs; each lesson consisted of information provided in a slide show format, combined with case stories, worksheets to practice skills, and quizzes and exercises related to each lesson. Participants could download worksheets for use at a later date. The 12 lessons were delivered consecutively over the span of 8 weeks. The adaptation process was completed by a patient-oriented working group consisting of four patients, two clinicians, two managers, two trainees, and two group facilitators. The program was pilot-tested with nine participants before formal start of the factorial trial.

Experimental factors

Factor 1: assessment interview

The assessment interview was administered in the screening call immediately following the randomization. The purpose of the assessment interview was to increase participants’ insight into their own alcohol habits and their consequences through a supportive conversation guided by the AUD module of the Structured Clinical Interview Diagnostic Statistical Manual 5 – Research Version (SCID-5 RV) [29]. In total, three screeners were involved in the screening. The screeners ranged in background training and included Bachelor’s degrees in social work (n = 2) and a Master’s degree in counselling psychology (n = 1). Screeners received a SCID-5 training session as well as training and supervision provided by authors CS and MN. Since the goal of the interview was not to establish a diagnosis, participants were not informed about how many criteria they screened positive for. Screening calls with the assessment interview were 36.0 min (SD = 11.2), while screening calls without the assessment interview were 18.4 min (SD = 6.4), (t = − 14.771, p =  < 0.001, Cohen´s d = 1.87, CI: 1.572–2.169).

Factor 2: guidance

Two clinicians provided guidance. Clinicians held graduate degrees in counselling psychology (MEd) and social work (MSW) and had been practicing for 1 and 13 years, respectively, at the time of study onset. They were blinded to whether participants had been randomized to the assessment interview or not and were instructed to spend approximately 15 min per week communicating with each participant, primarily through messages on the treatment platform. In these messages, clinicians were to answer participants’ questions, reinforce module completion, and boost motivation. In rare cases, clinicians contacted participants by telephone (i.e., if a participant requested a call, if there was increased suicide risk, or to address misunderstanding).

Across all four conditions, participants received automated, weekly emails with information about new lesson content. Those randomized to a group without guidance did not receive any other regular contact, but a member of the research team reviewed weekly survey responses to check for significant clinical issues requiring attention (i.e., major increase in drinking, sudden increase in depression symptoms or suicidal ideation). If any participant was deemed at risk, they were contacted and offered referral to appropriate health care. However, they were only discontinued from the trial if they requested it. All participants could contact the OTU if they experienced technical difficulties related to the treatment platform or wanted to discontinue the intervention.

Monitoring of participants

Each week throughout the 8-week course, all participants who logged in to the platform were asked to complete two questions about past week alcohol use; (1) How many drinks have you had in the past week; and (2) Over how many days did you consume these drinks? They also completed the Patient Health Questionnaire-4 (PHQ-4), a brief questionnaire assessing depression and anxiety [30], and item 9 from PHQ-9 assessing suicidal ideation [23]. These weekly questionnaires were not intended as outcome measures, but allowed systematic monitoring of client symptoms as a safety measure. Participants also responded to reflection questions asking them to list challenges they had with the exercises and to provide examples of what they had learned.

Measurements

Participants were asked to complete online questionnaires with outcome measures at screening, pre-treatment, mid-treatment (4 weeks into the treatment), post-treatment (8 weeks), and 3-month post-treatment (6 month and 1 year follow-up data collection is ongoing). Participants who did not complete questionnaires were contacted via telephone and/or email as a reminder to complete measures, with a maximum of three reminders per follow-up period. The primary outcomes were number of drinks and number of heavy drinking days (HDD; defined as ≥ 4 drinks per day for women and ≥ 5 drinks per day for men) in the preceding week. Secondary measures were the AUDIT [22], the Penn Alcohol Craving Scale (PACS) [31], and the Brief Situational Confidence Questionnaire (BSCQ) [32]. Additional measures included daily functioning (Sheehan Disability Scale; SDS) [33], depression (the Patient Health Questionnaire-9; PHQ-9) [23], and anxiety (Generalized Anxiety Disorder-7; GAD-7) [34]. Initial motivation, as well as motivational changes between screening and treatment start were assessed using the Readiness to Change Questionnaire –Treatment Version (RCQ-TV) [35]. Finally, treatment credibility was assessed at mid-treatment using the Credibility/Expectancy Questionnaire [36]. Questions pertaining to treatment evaluation and negative effects were assessed at post-treatment and have previously been reported for the overall sample [37]. Treatment engagement was assessed via: number of lessons accessed, days between first and last access to the website, and mean number of website log-ins.

Sample size and power analysis

The trial aimed to recruit 300 participants to the four conditions (75 participants per group). To estimate this sample size, we used the Factorial PowerPlan provided in the R package MOST [38]. Regarding effect size estimates of factor 1 (assessment interview) we had no available studies to draw on, and therefore pragmatically decided to estimate the effect size as 0.35, as this was the minimum effect size that would indicate this factor to be worth implementing, considering the time spent by staff conducting the interview. Regarding factor 2 (guidance), we estimated the effect size as 0.35, based on previously published studies [7, 8]. Power was set at 80%, alpha at 0.05, and we assumed a correlation of 0.5 between pre-and post-test measurements, and an attrition of 30%

Statistical analyses

At least one primary or secondary outcome measure was missing for 27% of the sample at post-treatment and 37% at 3-month follow-up. Missing responses were strongly associated with fewer lessons completed (p < 0.001) and with the self-guided course (p = 0.002). To attempt to control for possible bias from differential response rates we used a multiple imputation procedure to replace missing outcome measures. Fifty imputed datasets were created with the MICE package in R [39]. The imputation models controlled for lesson completion, treatment factors, observed values of that measure at other observation times, and interactions between lesson completion, treatment, and observed values.

To evaluate changes in primary and secondary measures, we modeled responses using generalized estimating equations (GEE) [40] using the geepack package, version 1.3.2. in R. The GEE models used Gamma distributions to accommodate skewed response distributions and a log-link function to model changes as proportional to pre-treatment severity. We specified an exchangeable working correlation matrix within individuals to address within-subject correlations, estimated standard errors with robust “sandwich” estimates, and tested whether interactions between Time and Factor were significant using the multivariate Wald test pooling results from the multiply imputed datasets. To evaluate whether the assessment interview had an effect on RCQ-TV change between screening and pre-treatment we planned to use a multinomial logit model. However, as virtually all participants were in the same “readiness to change” stage at screening (i.e., contemplation stage) and at pretreatment (i.e., action stage) respectively, we did not conduct this analysis. To evaluate changes in drinking between screening and pre-treatment, two-way ANOVA’s were used, and to evaluate program engagement, credibility, satisfaction and negative effects by group, one-way ANOVA’s were used. SPSS 25 was used for descriptive statistics and to analyze changes between screening and pre-treatment, while R version 4.1.0. was used for all outcome analyses.

Results

Participation flow

Between August 1, 2019 and November 2, 2020, 312 individuals were randomized. Of these, 36 (11.5%) did not start treatment and 6 (2%) formally withdrew, leaving a sample of 270 participants. See Fig. 1 for overview of trial flow.

Fig. 1
figure 1

Flow chart

Baseline characteristics

Of the 270 participants, 180 (66.8%) were female and average age was 46.5 (SD = 11.3; range: 22–72), see Table 1. The sample was predominately married (n = 170, 63.0%), employed (n = 187, 69.3%), White (n = 252, 93.3%), and had formal education following high school (n = 231, 85.6%). Participants reported having had 41.7 (SD = 24.8) drinks and 4.5 (SD = 2.1) HDD in the preceding week and the mean AUDIT score was 24.0 (SD = 5.8). No significant differences were identified between groups at baseline.

Table 1 Baseline demographic and clinical characteristics

Changes between screening and pre-treatment

Readiness to change

Nearly all patients had moved to the action stage by pre-treatment, see Table 2.

Table 2 Screening and pre-treatment by group (assessment interview vs no Assessment interview): Readiness to change

Alcohol consumption

Overall reductions were observed between screening and at pre-treatment, but there were no significant differences between the groups in either drinks or HDD (see Table 3). Fifteen participants in each group (11.0% vs 11.2%) reported being abstinent at pre-treatment.

Table 3 Screening and pre-treatment by group (assessment interview vs no assessment interview): Alcohol consumption

Primary outcomes

All groups showed large within-group reductions in drinks and HDD from screening to post-treatment and from screening to 3-month follow-up (Cohen’s dw ≥ 0.82, proportional reduction ≥ 48%, p < 0.001). The Time*factor interactions of reductions in drinks and HDD for pre-treatment to post-treatment and to the 3-month follow-up were not significant for either treatment factor (p > 0.07), and neither were the overall tests of time*factor (drinks; assessment interview: p = 0.29, guidance p = 0.50, HDD; assessment interview: p = 0.56, guidance: p = 0.65). See Table 4 for findings per group and Additional file 1: Table S1 for findings by factor. The combination of factors (assessment interview + guidance) did not appear to render greater alcohol reductions. However, alcohol reductions from screening to pre-treatment significantly correlated with improvements from screening to 3-month follow-up on both drinks (r = 0.52, p < 0.001) and HDD (r = 0.46, p < 0.001).

Table 4 Estimated marginal means, within-group effect sizes and proportional reductions at all time points by group*

Secondary outcomes

There were large within-group improvements on AUDIT, PACS, BSCQ, SDS, and PHQ-9 (Cohen’s dw ≥ 0.81, proportional reduction ≥ 27%, p < 0.001), and moderate improvements on the GAD-7 (Cohen’s dw ≥ 0.55, proportional reduction ≥ 34%, p < 0.001), see Table 4. One significant time*factor interaction was found on the BSCQ, where the group receiving the assessment interview had smaller improvements from screening to 3-month follow-up (31.8%) than the group with no assessment interview (42.9%, p = 0.04). The overall test of time*assessment interview interactions for the BSCQ, however, was not significant (p = 0.09), see Additional file 2: Table S2. There were no significant time*factor interactions on any other secondary measure (p > 0.05) and neither were there any significant overall tests of time*factor.

Participants completed an average of 8.3 lessons (SD = 3.8), with those receiving guidance completing significantly more lessons (p < 0.001). Those who received guidance were significantly more likely to use the program for a longer duration (p = 0.01) and had significantly higher number of log-ins (p < 0.001), see Table 5.

Table 5 Program engagement, credibility, satisfaction and negative effects by group

Treatment credibility, satisfaction and negative effects

There were no significant differences among groups in treatment credibility, satisfaction, or negative effects (See Table 5). The majority of participants indicated that they were either ‘Satisfied’ or ‘Very satisfied’ with overall treatment (n = 136, 70.1%) and treatment materials (n = 155, 80.0%). Few patients reported negative or adverse events resulting from participation in the ACC (2.6%, n = 6).

Discussion

The aim of this randomized factorial trial was to examine ways to optimize delivery of ICBT for alcohol misuse in a routine online therapy clinic by examining effects of two factors: (1) a pre-treatment assessment interview and (2) guidance. Large within-group reductions were observed in all groups, but no main effects were observed for the two factors and neither did we observe an interaction effect. Similarly, moderate to large within-group effect sizes were found for secondary outcomes but no effects related to the two factors. As for initial change (between screening and pre-treatment), significant within-group reductions in both groups were observed, and nearly all participants moved from the contemplation stage to the action stage, regardless of whether they had received the assessment interview or not. Initial reductions in drinks and heavy drinking days correlated significantly with reductions at post-treatment and follow-up.

This is the first time that the effects of a pre-treatment assessment interview has been experimentally investigated in ICBT for alcohol misuse, and it did not improve outcomes in our study. Guidance did not improve outcomes either, which adds to recent studies failing to find differential effects [9,10,11,12]. One explanation for the lack of effects may be that the Online Therapy Unit, the clinic where the trial was conducted, by default provides some degree of human contact to all participants regardless of group assignment, something which could potentially increase engagement for everyone [41]. Specifically, the assessment interview was provided as an extension of a screening call that all participants received and may not have been sufficient to produce any additional effects over and above the screening call. Further, in line with routine procedures at the clinic, all participants were called by staff whenever concern about a major increase in alcohol consumption or suicidal ideation was noted in the weekly questionnaires. A relatively large proportion of those randomized to a group without guidance were contacted by staff, possibly contributing to a dilution of the effect of the guidance factor. As has been suggested in research on ICBT for depression and anxiety, it may be that optimal outcomes are achieved when high quality treatment material is combined with clinical interviews and clinical monitoring during treatment [42].

There are limitations to this study. We had missing data for 27% of participants on at least one primary or secondary measure at post-treatment and for 37% of participants at 3-month follow-up. Importantly, we also had differential attrition such that those receiving guidance were significantly more likely to complete both post-treatment and 3-month follow-ups. Although a multiple imputation analysis was conducted to account for potential bias in the data that was collected, it is possible that participants who did not complete the follow-ups differed in other important ways from those who did complete the follow-ups. Although no trends were apparent in the data, it is possible that with a larger sample size, small effects between factors may have been detected. Further, much of the data was collected after the COVID-19 pandemic began in early 2020, something which may have impacted the results. According to Canadian statistics, the pandemic has been associated with increased alcohol use among the one-third of Canadian residents with a history of alcohol use [43] with residents reporting that factors such as stress, boredom and reduced mental health contributed to increased use [44].

Even though the assessment interview did not increase alcohol reductions or initial motivation, the finding that initial reductions (i.e. between screening and pre-treatment) correlated with reductions at follow-ups suggests that initial reductions (or lack thereof) can predict long-term change among clients using these kinds of interventions. Other ways to optimize effects of internet interventions for alcohol misuse, such as post-treatment boosters [45] should be further investigated. Future research may also examine ways to improve engagement and treatment completion.

Most participants moved from the contemplation stage in the screening to the action stage at pre-treatment, but motivation may have waned over the course of the treatment. Interventions that target low motivation when it arises in treatment, such as motivational interviewing (MI) may be beneficial [46] and further research could investigate ways to assess motivation during treatment and offer support when motivation wanes. In a meta-analysis on the treatment of comorbid AUD and depression, combined CBT and MI resulted in small but clinically significant benefits compared to treatment as usual [47]. Lastly, including additional resources related to the use of other substances (e.g., cannabis), may be beneficial to investigate, as individuals with AUD often have comorbid concerns [48].

Conclusions

ICBT for alcohol misuse was associated with large reductions in alcohol consumption when delivered in a routine online therapy clinic but neither a pre-treatment assessment interview nor guidance from a clinician appeared to increase these reductions.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

IPDMA:

Individual patient data meta-analysis

PNF:

Personalized normative feedback

CBT:

Cognitive behaviour therapy

ICBT:

Internet-delivered cognitive behaviour therapy

AR:

Assessment reactivity

SCID-5:

Structured Clinical Interview DSM-5

OTU:

Online therapy unit

ACC:

Alcohol change course

AUD:

Alcohol use disorders

AUDIT:

Alcohol Use Disorder Identification Test

DUDIT:

Drug Use Disorder Identification Test

PHQ-9:

Patient Health Questionnaire 9-item

PHQ-4:

Patient Health Questionnaire 4-item

GAD-7:

Generalized anxiety disorder-7

HDD:

Heavy drinking days

BSCQ:

Brief Situational Confidence Questionnaire

SDS:

Sheehan disability scale

RCQ-TV:

Readiness to change questionnaire–treatment version

GEE:

Generalized estimating equations

References

  1. Rehm J, Baliunas D, Borges GL, Graham K, Irving H, Kehoe T, et al. The relation between different dimensions of alcohol consumption and burden of disease: an overview. Addiction. 2010;105(5):817–43.

    PubMed  PubMed Central  Article  Google Scholar 

  2. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013;382(9904):1575–86.

    PubMed  Article  Google Scholar 

  3. Mekonen T, Chan GCK, Connor J, Hall W, Hides L, Leung J. Treatment rates for alcohol use disorders: a systematic review and meta-analysis. Addiction. 2021;116(10):2617–34.

    PubMed  Article  Google Scholar 

  4. Riper H, Hoogendoorn A, Cuijpers P, Karyotaki E, Boumparis N, Mira A, et al. Effectiveness and treatment moderators of internet interventions for adult problem drinking: An individual patient data meta-analysis of 19 randomised controlled trials. PLoS Med. 2018;15(12): e1002714.

    PubMed  PubMed Central  Article  Google Scholar 

  5. Titov N, Dear B, Nielssen O, Staples L, Hadjistavropoulos H, Nugent M, et al. ICBT in routine care: A descriptive analysis of successful clinics in five countries. Internet Interv. 2018;13:108–15.

    PubMed  PubMed Central  Article  Google Scholar 

  6. Palmqvist B, Carlbring P, Andersson G. Internet-delivered treatments with or without therapist input: does the therapist factor have implications for efficacy and cost? Expert Rev Pharmacoecon Outcomes Res. 2007;7(3):291–7.

    PubMed  Article  Google Scholar 

  7. Blankers M, Koeter MW, Schippers GM. Internet therapy versus internet self-help versus no treatment for problematic alcohol use: a randomized controlled trial. J Consult Clin Psychol. 2011;79(3):330–41.

    PubMed  Article  Google Scholar 

  8. Sundström C, Gajecki M, Johansson M, Blankers M, Sinadinovic K, Stenlund-Gens E, et al. Guided and Unguided Internet-Based Treatment for Problematic Alcohol Use - A Randomized Controlled Pilot Trial. PLoS ONE. 2016;11(7): e0157817.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  9. Boss L, Lehr D, Schaub MP, Paz Castro R, Riper H, Berking M, et al. Efficacy of a web-based intervention with and without guidance for employees with risky drinking: results of a three-arm randomized controlled trial. Addiction. 2018;113(4):635–46.

    PubMed  Article  Google Scholar 

  10. Sundström C, Schell C, Wardell JD, Godinho A, Cunningham JA. Can Brief Email guidance enhance the effects of an internet intervention for people with problematic alcohol use? A randomized controlled trial. Subst Use Misuse. 2020;55(12):2011–9.

    PubMed  Article  Google Scholar 

  11. Sundström C, Eék N, Kraepelien M, Fahlke C, Gajecki M, Jakobson M, et al. High- versus low-intensity internet interventions for alcohol use disorders: results of a three-armed randomized controlled superiority trial. Addiction. 2020;115(5):863–74.

    PubMed  PubMed Central  Article  Google Scholar 

  12. Johansson M, Berman AH, Sinadinovic K, Lindner P, Hermansson U, Andréasson S. The effects of internet-based cognitive behavioral therapy for harmful alcohol use and alcohol dependence as self-help or with therapist-guidance: A three-armed randomized trial. J Med Internet Res. 2021;:29666 (forthcoming/in press).

  13. Schrimsher GW, Filtz K. Assessment reactivity: can assessment of alcohol use during research be an active treatment? Alcohol Treat Q. 2011;29(2):108–15.

    Article  Google Scholar 

  14. Clifford PR, Maisto SA. Subject reactivity effects and alcohol treatment outcome research. J Stud Alcohol. 2000;61(6):787–93.

    CAS  PubMed  Article  Google Scholar 

  15. McCambridge J, Kypri K. Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS ONE. 2011;6(10): e23748.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  16. Moos RH. Context and mechanisms of reactivity to assessment and treatment. Addiction. 2008;103(2):249–50.

    PubMed  Article  Google Scholar 

  17. Clifford PR, Davis CM. Alcohol treatment research assessment exposure: a critical review of the literature. Psychol Addict Behav. 2012;26(4):773–81.

    PubMed  PubMed Central  Article  Google Scholar 

  18. Epstein EE, Drapkin ML, Yusko DA, Cook SM, McCrady BS, Jensen NK. Is alcohol assessment therapeutic? Pretreatment change in drinking among alcohol-dependent women. J Stud Alcohol. 2005;66(3):369–78.

    PubMed  Article  Google Scholar 

  19. Kaminer Y, Burleson JA, Burke R. Can assessment reactivity predict treatment outcome among adolescents with alcohol and other substance use disorders? Subst Abus. 2008;29(2):63–9.

    PubMed  Article  Google Scholar 

  20. Morgenstern J, Irwin TW, Wainberg ML, Parsons JT, Muench F, Bux DA Jr, et al. A randomized controlled trial of goal choice interventions for alcohol use disorders among men who have sex with men. J Consult Clin Psychol. 2007;75(1):72–84.

    PubMed  Article  Google Scholar 

  21. Sundström C, Hadjistavropoulos H, Wilhelms A, Keough M, Schaub M. Optimizing internet-delivered cognitive behaviour therapy for alcohol misuse: a study protocol for a randomized factorial trial examining the effects of a pre-treatment assessment interview and health educator guidance. BMC Psychiatry. 2020;20(1):126.

    PubMed  PubMed Central  Article  Google Scholar 

  22. Saunders JB, Aasland OG, Babor TF, Delafuente JR, Grant M. Development of the alcohol-use disorders identification test (AUDIT) - who collaborative project on early detection of persons with harmful alcohol-consumption-II. Addiction. 1993;88(6):791–804.

    CAS  PubMed  Article  Google Scholar 

  23. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  24. Berman AH, Bergman H, Palmstierna T, Schlyter F. Evaluation of the drug use disorders identification test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. Eur Addict Res. 2005;11:22–31.

    PubMed  Article  Google Scholar 

  25. Baumgartner C, Schaub MP, Wenger A, Malischnig D, Augsburger M, Lehr D, et al. “Take Care of You”—Efficacy of integrated, minimal-guidance, internet-based self-help for reducing co-occurring alcohol misuse and depression symptoms in adults: Results of a three-arm randomized controlled trial. Drug Alcohol Depend. 2021;225: 108806.

    PubMed  Article  Google Scholar 

  26. Schaub MP, Blankers M, Lehr D, Boss L, Riper H, Dekker J, et al. Efficacy of an internet-based self-help intervention to reduce co-occurring alcohol misuse and depression symptoms in adults: study protocol of a three-arm randomised controlled trial. BMJ Open. 2016;6(5): e011457.

    PubMed  PubMed Central  Article  Google Scholar 

  27. Augsburger M, Kaal E, Ülesoo T, Wenger A, Blankers M, Haug S, et al. Effects of a minimal-guided on-line intervention for alcohol misuse in Estonia: a randomized controlled trial. Addiction. 2022;117(1):108–17.

    PubMed  Article  Google Scholar 

  28. Frohlich JR, Rapinda KK, Schaub MP, Wenger A, Baumgartner C, Johnson EA, et al. Efficacy of an online self-help treatment for comorbid alcohol misuse and emotional problems in young adults: protocol for a randomized controlled trial. JMIR Res Protocols. 2018;7(11): e11298.

    Article  Google Scholar 

  29. First MBWJ, Karg RS, Spitzer RL. Structured clinical interview for DSM-5—research version (SCID-5 for DSM-5, research version; SCID-5-RV). Arlington: American Psychiatric Association; 2015.

    Google Scholar 

  30. Kroenke K, Spitzer RL, Williams JB, Lowe B. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613–21.

    PubMed  Google Scholar 

  31. Flannery BA, Volpicelli JR, Pettinati HM. Psychometric properties of the Penn Alcohol Craving Scale. Alcohol Clin Exp Res. 1999;23(8):1289–95.

    CAS  PubMed  Article  Google Scholar 

  32. Breslin FC, Sobell LC, Sobell MB, Agrawal S. A comparison of a brief and long version of the Situational Confidence Questionnaire. Behav Res Ther. 2000;38(12):1211–20.

    CAS  PubMed  Article  Google Scholar 

  33. Sheehan KH, Sheehan DV. Assessing treatment effects in clinical trials with the discan metric of the Sheehan Disability Scale. Int Clin Psychopharmacol. 2008;23(2):70–83.

    PubMed  Article  Google Scholar 

  34. Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.

    PubMed  Article  Google Scholar 

  35. Heather N, Hönekopp J. A revised edition of the readiness to change questionnaire [Treatment version]. Addiction Res Theory 2009;16:421–33.

  36. Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73–86.

    CAS  PubMed  Article  Google Scholar 

  37. Hadjistavropoulos HD, Chadwick C, Beck CD, Edmonds M, Sundström C, Edwards W, et al. Improving internet-delivered cognitive behaviour therapy for alcohol misuse: Patient perspectives following program completion. Internet Intervent. 2021. https://doi.org/10.1016/j.invent.2021.100474.

    Article  Google Scholar 

  38. Collins L HL, Dziak J. _MOST: Multiphase Optimization Strategy. R package version 0.1.0. 2017. https://doi.org/10.1007/978-3-319-72206-1_1

  39. Van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate imputation by chained equations in R. J Stat Softw. 2011;45:1–67.

    Article  Google Scholar 

  40. Hardin JW, Hilbe JM. Generalized estimating equations, 2nd ed. Taylor & Francis; 2013. https://doi.org/10.1201/b13880

  41. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to ehealth interventions. J Med Internet Res. 2011;13(1): e30.

    PubMed  PubMed Central  Article  Google Scholar 

  42. Titov N, Dear BF, Staples LG, Terides MD, Karin E, Sheehan J, et al. Disorder-specific versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: A randomized controlled trial. J Anxiety Disord. 2015;35:88–102.

    CAS  PubMed  Article  Google Scholar 

  43. Canadian Centre on Substance Use and Addiction. 2021.

  44. Canadian Centre on Substance Use and Addiction. 2020.

  45. Braitman AL, Lau-Barraco C. Personalized boosters after a computerized intervention targeting college drinking: a randomized controlled trial. Alcohol Clin Exp Res. 2018;42(9):1735–47.

    PubMed  PubMed Central  Article  Google Scholar 

  46. Nyamathi A, Shoptaw S, Cohen A, Greengold B, Nyamathi K, Marfisee M, et al. Effect of motivational interviewing on reduction of alcohol use. Drug Alcohol Depend. 2010;107(1):23–30.

    PubMed  PubMed Central  Article  Google Scholar 

  47. Riper H, Andersson G, Hunter SB, de Wit J, Berking M, Cuijpers P. Treatment of comorbid alcohol use disorders and depression with cognitive-behavioural therapy and motivational interviewing: a meta-analysis. Addiction. 2014;109(3):394–406.

    PubMed  PubMed Central  Article  Google Scholar 

  48. Midanik LT, Tam TW, Weisner C. Concurrent and simultaneous drug and alcohol use: results of the 2000 National Alcohol Survey. Drug Alcohol Depend. 2007;90(1):72–80.

    PubMed  PubMed Central  Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the participants and clinicians who involved with the trial as well as Jona Frohlich and others who have completed previous research on the original materials that were used to create the Alcohol Change Course.

Funding

Open access funding provided by Karolinska Institute. The Saskatchewan Ministry of Health provides the Online Therapy Unit funding to deliver internet-delivered cognitive behaviour therapy to the residents of Saskatchewan. In part, this work was supported by funding from the Saskatchewan Health Research Foundation and Saskatchewan Centre for Patient-Oriented Research. Funders had no involvement in the study design, collection, analysis, or interpretation of the data.

Author information

Authors and Affiliations

Authors

Contributions

CS: Study design. Course set-up. Project administration. Data curation. Supervision. Data analyses. Writing—original draft. HH: Funding acquisition. Study design. Course set-up. Data analyses. Writing—original draft. VP: Data analysis. Writing—original draft. CC: Data analyses. Writing—original draft. AW: Course set-up. Data curation. Data analyses. Revision of manuscript. DT: Data analyses. Writing—original draft. MN: Funding acquisition. Course set-up. Project administration. Revision of manuscript. MS: Course set-up. Study design. Revision of manuscript. MK: Course development. Study design. Revision of manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Christopher Sundström.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the University of Regina Ethics Review Board (approval number 2019–058).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Table S1. Factor table.

Additional file 2:

Table S2. Overall tests.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sundström, C., Peynenburg, V., Chadwick, C. et al. Optimizing internet-delivered cognitive behaviour therapy for alcohol misuse—a randomized factorial trial examining effects of a pre-treatment assessment interview and guidance. Addict Sci Clin Pract 17, 37 (2022). https://doi.org/10.1186/s13722-022-00319-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13722-022-00319-0

Keywords

  • Alcohol
  • Treatment
  • Internet
  • Cognitive behavior therapy
  • Guidance
  • Assessment reactivity