Research | Open | Published:
Patient-centered feedback on the results of personality testing increases early engagement in residential substance use disorder treatment: a pilot randomized controlled trial
Addiction Science & Clinical Practicevolume 10, Article number: 9 (2015)
Patient-centered models of assessment have shown considerable promise for increasing patients’ readiness for mental health treatment in general, but have not been used to facilitate patients’ engagement in substance use disorder (SUD) treatment. We developed a brief patient-centered intervention using assessment and feedback of personality data and examined its acceptability and efficacy to increase early engagement in residential SUD treatment.
Thirty patients entering a 90-day residential SUD treatment program were randomly assigned to a feedback (n = 17) or control (n = 13; assessment-only) condition. Normal-range personality was assessed with the NEO Personality Inventory-Revised (NEO PI-R). Patients were re-interviewed one month after treatment entry to obtain information on their satisfaction with the intervention, as well as their adjustment to the residential milieu. Electronic medical records were reviewed to obtain information on patients’ length of stay in the program and discharge status. Univariate ANOVAs and chi-square tests were conducted to examine group differences on outcomes.
Patients’ ratings indicated strong satisfaction with the feedback intervention and expectations that it would have a positive impact on their treatment experiences. Among patients who had not previously been treated in the residential program, the feedback intervention was associated with more positive relationships with other residents in treatment and a stronger alliance with the treatment program one month after treatment entry. The feedback intervention was also associated with a longer length of stay in treatment, although this effect did not reach statistical significance.
The findings highlight the clinical utility of providing SUD patients with patient-centered feedback based on the results of personality testing, and provide preliminary support for the acceptability and efficacy of this intervention to facilitate early engagement in residential SUD treatment.
Engagement in substance use disorder (SUD) treatment is a robust predictor of treatment retention and outcomes [1,2]. Measures of positive adjustment, such as more patient satisfaction , perceived program support and alliance [4,5], and supportive relationships with peers in treatment , may be conceptualized as indicators of treatment engagement  and are linked to better outcomes and a longer length of stay in SUD treatment.
Personality traits have also been linked to SUD treatment engagement and retention [8,9]. However, the field has lacked a compelling model for how to use information about personality to facilitate patients’ engagement in treatment. Patient-centered models of assessment and feedback, such as Finn’s semi-structured approach (“therapeutic assessment”) [10,11], are well suited for this purpose. In this approach, patients are viewed as collaborators who work with an assessor to define assessment goals and help interpret assessment results. Use of assessment results in this manner is theorized to facilitate positive change in patients by addressing needs of self-verification, self-enhancement, and self-discovery . The efficacy of this approach for increasing readiness for and engagement in mental health treatment is supported by quasi-experimental and pragmatic trials [13,14], randomized trials [15-17], and a meta-analysis . However, this approach has not been used to facilitate patients’ engagement in SUD treatment.
We developed a patient-centered intervention using assessment and feedback of personality data for patients entering residential SUD treatment. Briefly, upon entry to a residential SUD program, patients are assessed with the NEO Personality Inventory-Revised (NEO PI-R) , a measure of normal-range personality, and are provided with personalized feedback describing: (a) how their personality profile compares to that of their age-related peers; (b) their possible pattern of adjustment to the treatment milieu; and (c) cognitive-behavioral assignments that can help address problematic behavioral tendencies. This approach is expected to help patients adapt to the demands of the residential setting by enabling them to anticipate how their personal tendencies may impact their treatment experiences. Further, the assessment of normal-range personality dimensions allows patients to feel recognized as unique individuals rather than as psychiatric patients with a pathological condition. Finally, the assessment results (a description of the patient in “normal” personality terms) are also provided to treatment staff to facilitate their ability to empathize with patients and assist with the development of more individualized treatment plans for patients.
This patient-centered intervention follows several principles of collaborative forms of assessment, particularly the principles of therapeutic assessment espoused by Finn [10,11]. For example, patients work with an assessor to develop individualized assessment questions in terms of what they would like to learn about themselves from the personality assessment, identify behavioral tendencies they would like to work on or change, or how to get the most out of the residential program. To facilitate this, patients are presented with brief descriptions of the personality domains that are measured by the NEO PI-R and are asked if any are of particular interest to them and why. During the feedback session, patients are encouraged to assist with interpretation of the assessment results in terms of how well the test’s description of their personality does or does not match their experiences in the residential milieu and in the context of their lives more generally. Consistent with the tenets of therapeutic assessment, the assessor is encouraged to maintain empathic connections with patients during all sessions and to discuss and acknowledge patients’ past assessment experiences and any reservations they may have about the current assessment process.
In addition to its use of therapeutic assessment principles, this intervention incorporates several elements of a personality assessment system for SUD patients that was developed by Moffett, Steinberg, and Rhode . Specifically, the present intervention involves: (a) the assessment of normal, rather than abnormal, personality traits; (b) feedback to patients on their possible adjustment to the treatment milieu, given their personality profile; and (c) treatment recommendations that may help the patient maximize his/her benefit from the program. Consistent with Moffett et al. , with patients’ permission, assessment results are also shared with the staff of the residential program. In contrast to Moffett et al. , the present intervention does not include a reassessment of the patient’s personality during treatment in order to revise his or her treatment plan. Rather, it includes a follow-up session with the patient one month into treatment to discuss the consistency of the assessment findings with the patient’s treatment experiences and progress toward treatment goals, and the utility of the previously suggested treatment recommendations.
The objectives of the present study were to examine the acceptability of a patient-centered feedback intervention using assessment and feedback of personality data and efficacy of the intervention to increase early engagement in SUD treatment. This investigation was designed as a pilot randomized controlled trial (RCT) with the goal of obtaining preliminary data on the objectives; thus, it corresponds to a Stage I trial in the stage model of behavioral therapies .
Participants included 30 patients entering a 90-day residential SUD treatment program. Patients were mostly male (n = 28); ranged in age from 26 to 64 years (M = 49.07 years, SD = 11.15); had 13 years of education, on average (SD = 2.27); were predominantly Caucasian (n = 18); and were not currently married (n = 28). On average, patients had three prior episodes of residential SUD care (SD = 2.26).
Design and procedures
Within one week of entry into the residential program, patients were recruited and randomly assigned to either the feedback (n = 17) or control (n = 13) condition. We oversampled for patients in the feedback condition to maximize information on perceptions of the intervention—i.e., prior to recruitment, a list of 30 numbers (20 corresponding to the feedback condition, and 15 corresponding to the control condition) were put into random order in a Microsoft Excel spreadsheet. As patients entered the study, a research assistant added the patient to the randomization spreadsheet, notified the patient of his/her assignment, and scheduled the initial session with the Intervention Coordinator (IC).
The intervention procedures were conducted by a masters-level clinician who served as the IC. The IC was trained in the feedback protocol by the lead author. The training protocol included mock intervention sessions with the lead author and practice intervention sessions with eight SUD patients from the target program. The lead author was trained in the principles of therapeutic assessment by Dr. Finn and other members of the Center for Therapeutic Assessment through multiple in-person courses.
For the randomized trial, patients in the feedback condition completed three sessions with the IC. Sessions were videotaped and reviewed weekly with the lead author to ensure the IC’s fidelity to the protocol:
Initial session (8.3 mean days after treatment entry, SD = 3.0): Patients completed assessments of sociodemographics, treatment history, substance-related functioning, and personality. Next, patients worked with the IC to develop individualized assessment questions geared toward what they wanted to learn about themselves from the personality assessment, behavioral tendencies they wanted to work on or change, or how to get the most out of the residential program. To facilitate this, patients were presented with brief descriptions of the five broad domains of personality that are measured by the NEO PI-R and were asked if any were of particular interest to them and why. Patients were then asked to rate (a) how they thought their scores on the NEO PI-R compared to those of others their age and gender, and (b) their “ideal” personality. Responses to both sets of questions were given on a 5-point scale (1 = much lower than others my age, 5 = much higher than others my age) and were used by the IC to engage patients in a discussion of their current beliefs about their personality. This approach to administration of the NEO PI-R was used to assist the patient and IC in the development of individualized assessment questions (e.g., “How do I compare to others in terms of self-esteem and anger?”), as well as to help the IC understand aspects of the patient’s personality in which he or she might lack insight. This information was then used by the IC to develop a personalized summary sheet of the assessment results. To maximize the patient’s comprehension, feedback was limited to three or four test findings, with priority given to information that: (a) was relevant to the patient’s assessment questions; (b) matched the patient’s current self-perception; and (c) expanded the patient’s knowledge about his or her personality.
Patient-centered feedback session (13.8 mean days after treatment entry; SD = 4.9): The IC provided patients with a summary sheet describing: (a) how their personality profile compared to that of others their age and gender; (b) how their personality might impact their adjustment to the program; and (c) recommendations to help address problematic behavioral tendencies. An example of feedback given to a patient in the feedback condition is shown in the Appendix. For each assessment finding presented by the IC, the patient was encouraged to assist with its interpretation in terms of how well the description of his/her personality did or did not match his/her experiences in the milieu and life more generally, as well as which behavioral tendencies (as measured by the NEO PI-R) he/she wanted to prioritize in treatment. At the end of the session, a research assistant not involved in the patient-centered assessment collected information on the patient’s perceptions of the feedback intervention.
1-month follow-up session (32.8 mean days after treatment entry; SD = 4.8): Patients completed assessments regarding their adjustment to the residential program (these data were also collected by a research assistant who was not involved in the patient-centered assessment). Next, the patient and IC reviewed the summary sheet and discussed consistency of the findings with the patient’s treatment experiences, the patient’s progress towards their treatment goals, and usefulness of the previously suggested treatment recommendations.
In addition, the IC provided feedback to program staff regarding patients’ personality profiles and discussed with staff how to incorporate the recommendations into patients’ treatment plans.
Patients in the control condition received only the initial and 1-month follow-up sessions with the IC, which entailed administration of the same assessments given to patients in the feedback condition. All procedures were approved by the local institutional review board.
Substance use-related functioning. A 7-item “risk-use” factor from the Brief Addiction Monitor  assessed physical and psychological health, drug use and cravings, exposure to risky situations, and interpersonal problems with family and friends in the past 30 days . Scores could range from zero to 28 (M = 13.23, SD = 4.93; α = .68).
Personality. The NEO PI-R  is a 240-item self-report measure of normal-range personality. Items were rated on a 5-point scale (1 = strongly disagree, 5 = strongly agree), which provided age- and gender-normed T-scores (relative to the general population) on five factors: Neuroticism – tendency to experience negative affective states (M = 67.07, SD = 12.44; α = .93); Extraversion – tendency to be sociable, assertive, and active (M = 44.50, SD = 10.77; α = .87); Openness – intellectual curiosity and willingness to entertain novel ideals and unconventional values (M = 48.57, SD = 10.90; α = .86); Agreeableness – tendency to be altruistic, cooperative, and sympathetic (M = 45.90, SD = 13.45; α = .90); and Conscientiousness – tendency to be planful, organized, and reliable (M = 35.73, SD = 12.43; α = .94). Each factor also provided scores on six facet scales.
There were no significant differences between participants in the feedback and control conditions on any of the demographic or prior treatment variables, on the substance use-related functioning scale, or on any NEO PI-R facet or factor scores.
Perceptions of the feedback intervention. The Assessment Questionnaire (AQ), a 48-item questionnaire measuring satisfaction with the patient-centered assessment process [15,17], was administered to patients in the feedback condition only. Items were rated on a 5-point scale (1 = strongly disagree, 5 = strongly agree) and yielded scores on four factors: new self-awareness – how much patients felt that they learned something new about themselves (13 items); positive accurate mirroring – how much patients felt validated and understood by the assessment (12 items); positive relationship with the examiner – how much patients experienced a strong alliance with the IC (12 items); and negative feelings about the assessment – how much patients felt hurt, judged, or exposed by the assessment (11 items). A total satisfaction score was computed from the average response to all 48 items.
Patients also provided ratings on a 5-point scale (1 = very negative effect, 5 = very positive effect) regarding the expected impact of the intervention on their: (a) relationship with program staff; (b) likelihood of following staff recommendations; (c) relationship with other residents; (d) likelihood of following recommendations of other residents; (e) willingness to stay in the program; (f) willingness to continue treatment after leaving the program; and (g) motivation to stay sober from alcohol and other drugs.
1-month follow-up session
Program adjustment. For all patients, adjustment to the program was assessed by: (a) satisfaction with the program—i.e., scores on an 11-item version of the Client Satisfaction Questionnaire (CSQ)  (α = .95); (b) program support—i.e., the sum of 10 true-false items on the Support subscale of the Community Oriented Programs Environment Scale (COPES)  (α = .81); and (c) positive relations with other residents—i.e., scores on the 6-item Resident Resources subscale from the Life Stressors and Social Resources Inventory (LISRES)  (α = .84). A program alliance composite was constructed based on the average of the z-scores of the CSQ, COPES, and LISRES scales, which were highly intercorrelated (average r = .55; range = .40–.76) .
Treatment outcomes. Information regarding length of stay and whether or not patients dropped out of the program was gathered from administrative records 3 months after patients’ dates of entry.
Perceptions of the feedback intervention (Table 1)
T-scores for the AQ factors, based on norms for patients treated at the Center for Therapeutic Assessment (Finn, personal communication, 8 Nov 2011), ranged from 50.00 to 56.01, indicating that patients were highly satisfied with the intervention. Mean ratings on items assessing the expected impact of the feedback ranged from 4.12 to 4.53 (scale of 1–5), indicating that patients thought the intervention would have a positive impact on their experiences in the program.
Program adjustment and treatment outcomes (Table 2)
Univariate ANOVAs and chi-square tests compared the feedback and control conditions on program adjustment (1-month) and treatment outcomes. Four patients (all from the control condition) who had previously attended the program were excluded from these analyses to balance the conditions in terms of having no prior exposure to the treatment milieu. Patients in the feedback condition had higher ratings on all program adjustment indices, with generally large effect sizes (average Cohen’s d = .63; range = .48–.72). Patients in the feedback condition reported significantly more positive relations with other residents and had significantly higher scores on the program alliance composite. There were no statistically significant differences between conditions on treatment outcomes. However, those in the feedback condition had a longer length of stay in the program (i.e., approximately 7 days, on average) than those in the control condition, which equated to a small to medium effect size.
This study represents a Stage I efficacy  trial of a patient-centered feedback intervention based on the results of personality testing, which aimed to increase patients’ engagement in SUD treatment. This intervention is novel because of its application of therapeutic assessment principles to an SUD population, as well as its integration of these principles with the personality assessment system for SUD patients developed by Moffett and colleagues . The findings provide preliminary support for the acceptability and efficacy of this intervention to facilitate early engagement in SUD treatment and highlight the clinical utility of providing patient-centered feedback on personality testing to SUD patients. Accordingly, this work lays the foundation for larger trials with additional follow-up assessments to test the efficacy of this intervention to increase retention in SUD care and improve outcomes post-treatment (i.e., a Stage II trial) .
While encouraging, the findings should be interpreted with caution, given the small sample size, short follow-up period, and exclusive use of patient reports to measure the indicators of treatment engagement. In addition, it is not clear which component of the intervention—the patient-centered assessment process with patients, or the feedback to staff and discussion of how to modify treatment plans based on a patient’s personality profile—contributed to the higher ratings of program adjustment at the 1-month mark. Although testing of this intervention is still in the preliminary stages, if evidence accumulates to support its efficacy, research designs should evaluate the incremental contribution of the staff feedback component of the intervention to determine its association with outcomes, above and beyond the impact of providing feedback to patients only.
In terms of treatment outcomes, although the impacts of the intervention on length of stay and premature dropout were in the expected directions, they were not statistically significant. Notwithstanding the fact that power was limited in this small sample, it is possible that the dosing of the intervention may need to be increased in order to have a more beneficial impact on treatment outcomes. For example, an additional follow-up session and/or reassessment of patients’ personality at the end of treatment may boost the positive 1-month effects and provide patients with data on progress toward their treatment goals. Notably, this modification would align the intervention with measurement-based models of care, which have shown promise in the treatment of SUD patients . Further, future work should examine the impact of the intervention on treatment outcomes beyond 1 month, particularly post-treatment outcomes such as engagement in continuing care, substance use, and functioning.
The findings of this pilot RCT highlight the clinical utility of providing SUD patients with patient-centered feedback based on the results of personality testing, and provide preliminary support for the acceptability and efficacy of this intervention to facilitate early engagement in residential treatment. Therefore, this work supports future studies (e.g., a larger Stage II trial)  aimed at testing the efficacy of this brief, patient-centered intervention to increase retention in SUD care, as well as improve post-treatment outcomes related to substance use and general mental health functioning.
Moos RH, Moos BS. Long-term influence of duration and intensity of treatment on previously untreated individuals with alcohol use disorders. Addiction. 2003;98:325–37.
Simpson DD. A conceptual framework for drug treatment process and outcomes. J Subst Abuse Treat. 2004;27:99–121.
Hser YI, Evans E, Huang D, Anglin DM. Relationship between drug treatment services, retention, and outcomes. Psychiatr Serv. 2004;55:767–74.
Gifford EV, Ritsher JB, McKellar JD, Moos RH. Acceptance and relationship context: a model of substance use disorder treatment outcome. Addiction. 2006;101:1167–77.
Harris AH, McKellar JD, Moos RH, Schaefer JA, Cronkite RC. Predictors of engagement in continuing care following residential substance use disorder treatment. Drug Alcohol Depend. 2006;84:93–101.
Moos RH, King MJ. Participation in community residential treatment and substance abuse patients’ outcomes at discharge. J Subst Abuse Treat. 1997;14:71–80.
Moos R, Finney J, Cronkite R. Alcoholism treatment: context, process, and outcome. New York, NY: Oxford University Press; 1990.
Ball SA, Carroll KM, Canning-Ball M, Rounsaville BJ. Reasons for dropout from drug abuse treatment: symptoms, personality, and motivation. Addict Behav. 2006;31:320–30.
Samuel DB, LaPaglia DM, Maccarelli LM, Moore BA, Ball SA. Personality disorders and retention in a therapeutic community for substance dependence. Am J Addict. 2011;20:555–62.
Finn SE. Manual for using the MMPI-2 as a therapeutic intervention. Minneapolis, MN: University of Minnesota Press; 1996.
Finn SE. In our clients’ shoes: theory and techniques of therapeutic assessment. New York, NY: Taylor & Francis Group; 2007.
Finn SE, Tonsager ME. Information-gathering and therapeutic models of assessment: complementary paradigms. Psychol Assess. 1997;9:374–85.
Smith JD, Eichler WC, Norman KR, Smith SR. The effectiveness of collaborative/therapeutic assessment for psychotherapy consultation: a pragmatic replicated single-case study. J Pers Assess. 2014, doi:10.1080/00223891.2014.955917.
Ougrin D, Ng AV, Low J. Therapeutic assessment based on cognitive-analytic therapy for young people presenting with self-harm: pilot study. BJ Psychiatric Bull. 2008;32:423–6.
De Saeger H, Kamphuis JH, Finn SE, Smith JD, Verheul R, van Busschbach JJ, et al. Therapeutic assessment promotes treatment readiness but does not affect symptom change in patients with personality disorders: findings from a randomized clinical trial. Psychol Assess. 2014;26:474–83.
Finn SE, Tonsager ME. Therapeutic effects of providing MMPI-2 test feedback to college students awaiting therapy. Psychol Assess. 1992;4:278–87.
Newman ML, Greenway P. Therapeutic effects of providing MMPI-2 test feedback to clients at a university counseling service: a collaborative approach. Psychol Assess. 1997;9:122–31.
Poston JM, Hanson WE. Meta-analysis of psychological assessment as a therapeutic intervention. Psychol Assess. 2010;22:203–12.
Costa PT, McCrae RR. Revised NEO Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual. Odessa, FL: Psychological Assessment Resources, Inc.; 1992.
Moffett LA, Steinberg SL, Rohde P. Personality assessment of substance-dependent patients in a therapeutic community. J Subst Abuse Treat. 1996;13:127–34.
Rounsaville BJ, Carroll KM, Onken LS. A stage model of behavioral therapies research: getting started and moving on from stage I. Clin Psychol: Sci Pract. 2001;8:133–42.
Cacciola JS, Alterman AI, DePhilippis D, Drapkin ML, Valadez Jr C, Fala NC, et al. Development and initial evaluation of the brief addiction monitor (BAM). J Subst Abuse Treat. 2013;44:256–63.
Nelson KG, Young K, Chapman H. Examining the performance of the brief addiction monitor. J Subst Abuse Treat. 2014;46:472–81.
Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2:197–207.
Moos RH. Understanding environments: the key to improving social processes and program outcomes. Am J Community Psychol. 1996;24:193–201.
Moos RH, Moos BS. Life stressors and social resources inventory: adult form manual. Odessa, FL: Psychological Assessment Resources; 1994.
Crits-Christoph P, Ring-Kurtz S, Hamilton JL, Lambert MJ, Gallop R, McClure B, et al. A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. J Subst Abuse Treat. 2012;42:301–9.
This project was funded by a Career Development Award-2 from the VA Office of Research and Development (Clinical Sciences Research & Development) and a Locally Initiated Project (LIP13DB1) through the VA Palo Alto Center for Innovation to Implementation (Ci2i) awarded to Dr. Blonigen. Drs. Timko (Health Services Research & Development; RCS 00-001) and Jacob (Clinical Sciences Research & Development) were each supported by a Senior Research Career Scientist award from the VA Office of Research and Development. The VA and Ci2i had no role in the study design; collection, analysis, or interpretation of the data; writing of the manuscript; or the decision to submit the paper for publication. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veteran Affairs.
The authors wish to thank Jennifer L. Latimer, LCSW; Lisa L. Baldini, B.A.; Stephen E. Finn, Ph.D.; Louis A. Moffett, Ph.D.; and staff members of the participating treatment program for their contributions to this study.
The authors declare they have no competing interests.
DB designed the feedback intervention, conducted all statistical analyses, and wrote the first draft of the manuscript. All co-authors contributed substantially to the conceptualization and design of the study and participated in revising the manuscript critically for important intellectual content. All authors approve the submission of the manuscript to Addiction Science & Clinical Practice.
Your Personality Summary
Your statements on the questionnaire you completed were compared with others your age and gender to show your particular ways of thinking, feeling, and interacting with others. The results that may be most interesting to you, given the question(s) you had, as well as how you can best adjust to and benefit from your treatment program, are listed below:
Your assessment question: “How do I compare to others in terms of self-esteem and anger?”
Your feelings of self-worth and competence are similar to those of others your age; however, you are more likely than others to believe that you cannot cope with stress and will fall apart under pressure.
Possible adjustment to the program:
May often feel overwhelmed by treatment program assignments and duties.
May doubt self and capabilities when facing challenging situations.
Practice relaxation techniques when feeling stressed; ask for support from peers and staff if feeling overwhelmed with your duties.
Complete cognitive restructuring worksheets (“Triple Columns”) on statements that reflect your beliefs in your ability to cope with stress (e.g., “If I left the program, I would die.”)
You tend to be more assertive, outspoken, and prone to conflict than others. You tend to struggle with “letting things go” when bothered by the actions of others.
Possible adjustment to the program:
Likely to adjust well to program expectation of providing feedback to peers.
May easily get involved in interpersonal conflict and drama with other residents.
Log when you have insisted on your way, and when you followed another's way.
List past instances of involvement in conflict with others, how you acted, and the pros & cons of your behavior.
Attend interpersonal skills groups (e.g., Dialectical Behavior Therapy [DBT]).
Compared to your peers, you have more difficulty trusting others.
Possible adjustment to the program:
May have difficulty confiding in staff or peers.
May struggle to form relationships with others or accept their feedback or advice.
May distrust others and believe they have harmful intentions, which could lead to altercations.
List pros and cons of trusting others. Log instances when you have and have not benefitted from trusting someone else’s advice.
“Triple columns” on statements that reflect your beliefs in the trustworthiness of others.
You are less likely than others to plan ahead and tend to act impulsively, particularly when you feel stressed out.
Possible adjustment to the program:
May be stressed by the high structure and planning requirements of the program.
May receive critical feedback for not “thinking before acting.”
Consider past spur-of-the-moment decisions and the pros and cons of them.
Log impulsive thoughts & feelings; use “Triple Columns” to manage impulses and develop alternative responses.