Skip to main content

More than three times as many Indigenous Australian clients at risk from drinking could be supported if clinicians used AUDIT-C instead of unstructured assessments

Abstract

Background

Aboriginal and Torres Strait Islander (‘Indigenous’) Australians experience a greater burden of disease from alcohol consumption than non-Indigenous peoples. Brief interventions can help people reduce their consumption, but people drinking at risky levels must first be detected. Valid screening tools (e.g., AUDIT-C) can help clinicians identify at-risk individuals, but clinicians also make unstructured assessments. We aimed to determine how frequently clinicians make unstructured risk assessments and use AUDIT-C with Indigenous Australian clients. We also aimed to determine the accuracy of unstructured drinking risk assessments relative to AUDIT-C screening. Finally, we aimed to explore whether client demographics influence unstructured drinking risk assessments.

Methods

We performed cross-sectional analysis of a large clinical dataset provided by 22 Aboriginal Community Controlled Health Services in Australia. We examined instances where clients were screened with unstructured assessments and with AUDIT-C within the same two-monthly period. This aggregated data included 9884 observations. We compared the accuracy of unstructured risk assessments against AUDIT-C using multi-level sensitivity and specificity analysis. We used multi-level logistic regression to identify demographic factors that predict risk status in unstructured assessments while controlling for AUDIT-C score.

Results

The primary variables were AUDIT-C score and unstructured drinking risk assessment; demographic covariates were client age and gender, and service remoteness. Clinicians made unstructured drinking risk assessments more frequently than they used AUDIT-C (17.11% and 10.85% of clinical sessions respectively). Where both measures were recorded within the same two-month period, AUDIT-C classified more clients as at risk from alcohol consumption than unstructured assessments. When using unstructured assessments, clinicians only identified approximately one third of clients drinking at risky levels based on their AUDIT-C score (sensitivity = 33.59% [95% CI 22.03, 47.52], specificity = 99.35% [95% CI 98.74, 99.67]). Controlling for AUDIT-C results and demographics (gender and service remoteness), clinicians using unstructured drinking risk assessments were more likely to classify older clients as being at risk from alcohol consumption than younger clients.

Conclusions

Evidence-based screening tools like AUDIT-C can help clinicians ensure that Indigenous Australian clients (and their families and communities) who are at risk from alcohol consumption are better detected and supported.

Introduction

While Aboriginal and Torres Strait Islander peoples (hereafter ‘Indigenous Australians’) are more likely to abstain from drinking than their non-Indigenous counterparts [1], they experience a greater burden of disease from alcohol consumption [2]. A long history of socio-economic disadvantage and discrimination stemming from British colonisation and then from discriminatory policies from Australian governments have made addictions and health problems more likely for Indigenous Australians [3, 4].

Indigenous Australians die from alcohol-related causes at more than five (5.5) times the rate of non-Indigenous Australians [2]. Alcohol consumption also places strain on Indigenous Australian communities through contributions to chronic diseases and disabilities (e.g., fetal alcohol spectrum disorders, and disabilities caused through injury) [5,6,7] and interpersonal violence [8, 9]. Brief intervention and/or treatment can help people reduce their consumption [10], but at-risk individuals must first be detected [11]. Structured screening tools such as the Alcohol Use Disorders Identification Test consumption questions (AUDIT-C) [12] can help clinicians systematically determine which clients are at risk from drinking alcohol and may require support [13]. But, in practice, many clinicians do not use formal screening tools when making drinking risk assessments.

Aboriginal Community Controlled Health Services are required to report the proportion of Indigenous Australian clients that are assessed for drinking risk (using any means) to the Australian government [13]. We refer to these assessments as ‘unstructured drinking risk’ assessments as clinicians can use any methodology to establish risk. While a clinician could choose to perform a formal screening assessment, they could also simply ask clients if they believe themselves to be at risk, or they could rely on subjective impressions [13]. Unstructured drinking risk assessments made in primary health settings have been found to be inaccurate for general populations [14,15,16]. But the degree of inaccuracy has never been quantified for Indigenous Australian clients. While many clinicians are systematic in their assessments, at the aggregate level it is not clear how unstructured drinking risk assessments are made, and what factors might bias these assessments. Clinicians might identify at-risk individuals in part based on whether clients violate perceived norms (e.g., if they drink more than peers). Thus, client demographics such as age and gender could be factors which bias unstructured drinking risk assessments.

In this paper we explore the accuracy of unstructured drinking risk assessments relative to AUDIT-C screening. We aimed to determine how frequently clinicians make unstructured risk assessments and use AUDIT-C with Indigenous Australian clients. We also aimed to determine the accuracy of unstructured drinking risk assessments relative to AUDIT-C screening. Finally, we aimed to explore whether client demographics (age, gender, and remoteness) influence unstructured drinking risk assessments. Using a large clinical dataset provided by 22 Aboriginal Community Controlled Health Services [17], we extracted all clinical sessions where the results of unstructured drinking risk assessments and client AUDIT-C score were both reported in the same two-month reference period. We examine the sensitivity and specificity of unstructured drinking risk assessments using AUDIT-C as the reference test. Using multi-level logistic regression, we explore whether demographic factors can explain why clinicians making unstructured assessments determine some users to be at risk but not others.

Methods

This study was performed as part of a broader project to test whether training and support can increase AUDIT-C screening rates at Aboriginal Community Controlled Health Services [18]. The results of the primary outcomes from that project have been published elsewhere [17]. As this work is exploratory no hypotheses or methods specific to the research question have been pre-registered.

Ethical approval

Approval was obtained from eight ethics committees across Australia: the Aboriginal Health and Medical Research Council of NSW Ethics Committee (NSW; project 1217/16), Central Australian Human Research Ethics Committee (project CA-17-2842), Human Research Ethics Committee of Northern Territory Department of Health and Menzies School of Health Research (project 2017-2737), Central Queensland Hospital and Health Service Human Research Ethics Committee (project 17/QCQ/9), Far North Queensland Human Research Ethics Committee (project 17/QCH/45-1143), The Aboriginal Health Research Ethics Committee, South Australia (SA; project 04-16-694), St Vincent’s Hospital Melbourne Human Research Ethics Committee (project LRR 036/17) and Western Australian Aboriginal Health Ethics Committee (WA; project 779).

Dataset

Data were routinely collected from 22 Aboriginal Community Controlled Health services’ clinical practice management software (‘Communicare’) [17, 18]. Services were recruited who served at least 1000 unique Indigenous Australian clients per year. The full details of service recruitment have been published elsewhere [18]. The dataset included every clinical session for Indigenous Australian clients. To prevent potential confounding, we only used data from the baseline period of the broader study—prior to the commencement of a training and support program (aimed at increasing AUDIT-C screening rates) which was the primary focus of the broader trial [17, 18]. As wait-list control services had a longer baseline period more data were retained from that arm of the trial. Data were extracted for the period starting on the 29th of August 2016 and ending on the 13th of August 2019.

Instruments

Demographics included client age (continuous) and gender, and service remoteness (ordinal; based on service location and Australian Bureau of Statistics classifications) [19]. We used the following strata for classifying remoteness: ‘urban’ (major cities and inner regional), ‘regional’ (outer regional and remote), and ‘remote’ (very remote) [19].

Unstructured drinking risk

Clinicians indicated client drinking risk status using one of the following categories: ‘Ex-drinker’, ‘Non-drinker’, ‘Within safe drinking limits’, or ‘Unsafe—needs intervention’. This variable is used as a key performance indicator for Aboriginal Community Controlled Health Services [13]. The Australian government does not restrict how clinicians make these assessments [13].

AUDIT-C

AUDIT-C is a valid tool for detecting risky drinking and is frequently used with Indigenous Australians [13, 17, 20,21,22]. AUDIT-C is comprised of the first three questions from the 10-item Alcohol Use Disorders Identification Test (AUDIT) [23]. The first item is “How often do you have a drink containing alcohol?”. Responses are on a five-point scale ranging from “Never” to “4 + times per week”. The second item is “How many drinks containing alcohol do you have on a typical day when you are drinking?”. Responses to the second item are on a five-point scale ranging from “1–2” to “10 or more”. The final item is “How often do you have six or more drinks on one occasion?”. Responses are on a five-point scale and range from “Never” to “Daily or almost daily”. Each five-point scale is converted to a score from 0 to 4 (Table 1). In accordance with Australian national standards for Aboriginal health services, clients were classified as at-risk from alcohol consumption if their total AUDIT-C score was 3 or more for females, or four or more for males [13].

Table 1 AUDIT-C scoring table

Reporting of risk assessments

Clinicians recorded their risk assessments directly into Communicare. Health professionals could use a variety of templates to input data. Sometimes AUDIT-C or an unstructured assessment could be performed on their own. On other occasions, templates would direct clinicians to perform both assessments, such as in the commonly used ‘Adult Health Check’ or ‘Pre-consult Examination’ templates. The content of these forms varies over time due to modifications made by Communicare, or due to edits performed by individual services. For example, at the start of data collection, the Adult Health Check by default only included the unstructured assessment. But at a later stage the standard Adult Health Check form asked clinicians to first make an unstructured assessment, and then to ask AUDIT-C questions. The extracted data did not tell us the ordering in which the two assessments were collected. Communicare automatically calculates AUDIT-C risk for clients and displays the result to clinicians. There is nothing preventing clinicians from changing their unstructured risk assessments based on feedback later gained from AUDIT-C.

Data analysis

We used R version 4.1.2 (2021-11-01) [24] for our analyses. To ensure accurate transcription of results, we prepared this manuscript using the library ‘papaja’ [25]. We aggregated the dataset such that each row summarises screening activity across a two-monthly data-extraction period for a given client. We then extracted all sessions where unstructured risk, and AUDIT-C assessments were made within the same data-extraction period. Where multiple risk assessments (of the same kind) were made for a client during a single data-extraction period, the client was judged to be at risk by that assessment if half or more returned positive results. We retained the average AUDIT-C score per client over each reference period for use as a continuous variable in regressions.

Sensitivity and specificity for unstructured drinking risk assessments using AUDIT-C screening as the reference test were estimated using logistic regression [26]. As data were clustered by clients and services, we used mixed-effects models to estimate sensitivity and specificity which included random intercepts for clients and for services using the R package ‘lme4’ [27]. We derived 95% confidence intervals using the delta method function from the ‘car’ package [28]. We visualised the sensitivity and specificity of unstructured drinking risk assessments against all possible AUDIT-C thresholds using the libraries ‘ggplot2’ [29] and ‘plotROC’ [30].

To explore whether demographic factors were linked to unstructured risk assessments, we fit a series of mixed-effects logistic regressions. These multi-level models include fixed effects which estimate the effect of observed variables as well as random effects which model the effects of the unobserved characteristics of cluster variables. As observations were nested within clients who were nested within services, we included random intercepts for each client and for each service. We estimated 95% confidence intervals using the Wald approximation. In the first model we test whether AUDIT-C score significantly (\(\alpha\) < 0.05) predicts clients being found at risk during unstructured risk assessments. In the second model we introduce the proportion of assessments made during the same visit as a covariate. We examined this covariate because if unstructured risk assessments are more sensitive when both assessments were performed on a single occasion, then clinicians might be adjusting their assessments based on AUDIT-C score which would confound our findings. In model 3 we additionally test for client age, gender and remoteness. In a fourth model we add an interaction between AUDIT-C score and client age. We tested for this interaction as we found a large main effect of age and because the kinds of drinking risk exhibited (single occasion vs lifetime risk) varies by age among Indigenous Australians [1]. We test whether each model significantly improved upon the previous model’s fit with Likelihood ratio tests [27]. Intraclass-correlation coefficients (ICC) for each model were estimated with the ‘performance’ library [31]. ICCs describe the percentage of variance attributable to the random effects (i.e., to heterogeneity among clients and services) [31].

Results

Observations

During the reference period, we observed 231,154 clinical sessions. During this period, AUDIT-C was performed on approximately one in nine clinical occasions (10.85%). Unstructured risk assessments were more frequently conducted: in approximately one in six sessions (17.11%). Across all clinical sessions, clients were more likely to be found to be at risk on occasions when their drinking was assessed using AUDIT-C (39.11%), than when unstructured risk assessments were used (8.77%). We summarised screening activity over two-monthly data extraction periods and analysed cases where both AUDIT-C and an unstructured risk assessment were conducted during the same two-monthly period.

We observed 9,884 (7.99%) instances where both AUDIT-C and an unstructured risk assessment were recorded in the same two-monthly extraction period. These data were provided by 18 services (the other four services did not record both an unstructured risk assessment and an AUDIT-C result for any client in a single extraction period). There were 6,380 unique client IDs. The mean number of observations per client ID was 1.55 (\(SD\) = 1.36). Demographics for this sample are presented in Table 2. On about half of occasions (52.7%) clinicians performed unstructured risk assessments and the AUDIT-C on the same occasion. On these occasions, both items were usually featured on the same health check template in their practice management software (84.3%).

Table 2 Service and client characteristics for occasions where AUDIT-C score and an unstructured risk rating were recorded

Comparing AUDIT-C and unstructured drinking risk assessments

Unstructured risk assessments were at-odds with AUDIT-C results in more than one quarter of cases (28.74%). This level of disagreement is substantial and statistically significant \({\chi }^{2}\)(1) = 2623.34; \(p\) < 0.001; McNemar’s test [32]. These disagreements resulted in a greater than three-fold difference in the identified rate of risky drinking. Based on their AUDIT-C results, clients should have been classed at risk in 39.29% of periods. But using unstructured assessments, clinicians only identified clients as at risk in 11.66% of periods. Unstructured assessments showed poor sensitivity relative to classifications made with AUDIT-C (33.59% [95% CI 22.03, 47.52]), but high specificity (99.35% [95% CI 98.74, 99.67]). This means that clinicians using unstructured assessments failed to identify most people drinking at risky levels (based on AUDIT-C results). Clients who were rated as drinking ‘within safe drinking limits’ from unstructured assessments recorded a wide range of AUDIT-C scores, many of which are indicative of high-risk drinking (Fig. 1). More than half of males (60.61%) and females (55.59%) who were rated as drinking within safe limits by clinicians using unstructured assessments should have been classed as at risk based on their AUDIT-C scores.

Fig. 1
figure 1

Density plot of AUDIT-C score by unstructured drinking risk rating. Sessions where clients were rated as non-drinkers by clinicians in unstructured assessments and by AUDIT-C were excluded. The area to the right of the dashed line are sessions which would be rated as risky based on AUDIT-C thresholds. Most current drinkers rated as drinking within safe limits by clinicians using unstructured assessments were classified as at risk by AUDIT-C

The lack of sensitivity in unstructured assessments could mean that clinicians fundamentally disagree with AUDIT-C risk assessments. Perhaps clinicians are targeting higher cut-offs for at risk drinking. To explore this, we examined whether higher risk cut-offs can bring unstructured clinical assessments into better agreement with AUDIT-C. We estimated the sensitivity and false positive rates for unstructured risk assessments against AUDIT-C, using the full range of AUDIT-C scores as risk thresholds. Figure 2 shows that unstructured risk assessments only approached acceptable sensitivity and specificity when females and males scored 11 + on AUDIT-C. This means unstructured risk assessments only became reliable for clients at the highest levels of consumption.

Fig. 2
figure 2

Sensitivity and specificity were estimated for unstructured risk assessments using AUDIT-C as the reference test by gender. Varying cut-offs were used to determine AUDIT-C risk (visible along each curve). These AUDIT-C cut-offs are visible as numbers along the curve. To account for clustering, sensitivity and specificity were derived from a series of multi-level logistic regressions with random intercepts for clients and services

Predictors of unstructured risk ratings

To identify factors that might lead to inconsistencies between unstructured risk assessments and AUDIT-C scores, we performed a series of multi-level logistic regressions. Our data were clustered: there were multiple observations per service, as well as per client. Accordingly, we included random intercepts for both service and client ID.

The results of our regression analyses are presented in Table 3. Findings were robust to clustering by client (Additional file 1: Table S1). In the first model we identified a strong positive relationship where 1-unit increases in AUDIT-C substantially increased the odds of clients being identified as being at risk during unstructured risk assessments \(\text{OR}\) = 1.87 [95% CI 1.77, 1.98]. Controlling for whether AUDIT-C and unstructured assessments were performed on the same occasion did not change the relationship between AUDIT-C and risk status (Model 2). Including client demographics improved model fit (Model 3). Specifically, a trend was detected where older clients were more likely to be identified as risky drinkers controlling for their AUDIT-C score (OR = 1.11 [95% CI 1.03, 1.19] for every 10-year increase in client age; Model 3). Including the interaction between AUDIT-C and client age further improved model fit (Model 4). The older the client, the stronger the relationship between client AUDIT-C and being identified as drinking at risk in unstructured risk assessments (Fig. 3). Across all models, substantial variation in risk assessments was attributable to clustering by service and client (\(ICC\) \(\approx\) 45.4%). There was not a statistically significant interaction between AUDIT-C and client gender, or AUDIT-C and service remoteness (Additional file 1: Tables S2 and S3 respectively).

Table 3 Multi-level logistic regression models predicting the odds of clients being found at risk in unstructured assessments
Fig. 3
figure 3

The predicted probability of being found at risk from unstructured risk assessments by AUDIT-C score and age based on Model 4. The ribbons represent 95% confidence intervals. AUDIT-C was a stronger predictor of being identified as an at-risk drinker during unstructured assessments for older clients. Model 4 controlled for remoteness, gender, and whether AUDIT-C and the unstructured risk assessment were performed in the same clinical session

Discussion

We aimed to explore the accuracy of unstructured drinking risk assessments relative to AUDIT-C screening for Indigenous Australian clients attending Aboriginal Community Controlled Health Services (ACCHSs). While AUDIT-C is already used with Indigenous Australian clients, we demonstrated that it is much more common for clinicians to make unstructured risk assessments. This is problematic as we also demonstrated that when clinicians rely on unstructured assessments, clinicians did not identify most people who were at risk from drinking alcohol (based on their AUDIT-C score). We found that unstructured drinking risk assessments might be biased by client age: Clinicians were more responsive to elevated drinking for older clients than for younger clients. But this did not explain the large disparity between unstructured risk assessments and AUDIT-C screening results. As unstructured assessments tend to vastly underestimate drinking risk, we support the increased adoption of validated screening tools like AUDIT-C as aids for clinicians in assessing whether their Indigenous Australian clients are at risk from drinking alcohol.

We anticipated that the accuracy of unstructured drinking risk assessments might be different at services for Indigenous peoples than at mainstream services. Some Indigenous clients need clinicians to tailor their questioning around drinking to accommodate language and cultural differences [33]. But our findings demonstrated that unstructured drinking risk assessments are similarly effective across Indigenous and non-Indigenous contexts. One study of general practitioners (GPs; in mainstream settings) found that only 26.5% [16] of at-risk clients were detected using unstructured assessments. Our estimate for clinicians at ACCHSs was similar (33.59%).

It is not clear what factors influence unstructured risk assessments. In our sample, the link between drinking (AUDIT-C score) and being detected as at risk was stronger for older clients than younger clients. Perhaps the normalisation of heavy episodic drinking among younger Australians [34] contributed to some clinicians overlooking risky drinking as a phase, and not a pressing health concern. Alternatively, many diseases caused by drinking take time to develop; perhaps clinicians’ tendency to identify more older clients as at risk from drinking reflects clinical priorities which emphasise the treatment of current problems over the prevention of future ailments. Alternatively, older clients could have been more likely to have co-morbid conditions (e.g., diabetes) for which clinicians considered alcohol consumption a greater risk to patient health. These differences could also be explained by the relationships clinicians have with clients of different ages. Clinicians could have better rapport with older clients and thereby be better able to ask sensitive questions, and to discuss risk taking behaviours.

We found that the accuracy of unstructured risk assessments markedly improved for higher AUDIT-C risk cut-offs. This could indicate that clinicians at ACCHSs are using higher drinking risk thresholds in unstructured assessments than those recommended by national guidelines [13, 35]. Some general practitioners in non-Indigenous settings have expressed concerns that AUDIT-C risk thresholds are too sensitive [36]. Perhaps some clinicians are exclusively targeting Alcohol Use Disorders rather that unhealthy drinking. While the negative effects of alcohol dependence and harmful drinking can be obvious to clinicians, it is still important that hazardous drinking is addressed [37]. The links between risky drinking and health problems are well validated and important [35]. Brief interventions can help people reduce their consumption [10], thereby helping to prevent the occurrence (or exacerbation) of a range of conditions such as hypertension, diabetes, or various cancers [35].

Indigenous Australians tend to experience a heavier disease burden from chronic illnesses than others [38]. And, staff at ACCHSs provide care for more complex conditions than seen at many other services [39]. Given the competing demands faced by staff at ACCHSs [39], addressing lower-risk hazardous drinking may be challenging. Not all consultations offer good opportunities to talk with clients about alcohol consumption. Clients may become annoyed when clinicians ask about their drinking rather than address their presenting concerns [40]. Longer appointment times could help clinicians in screening for alcohol problems [41], but this could harm waiting times or require more staff. In many ACCHSs, Aboriginal Health Practitioners and nurses regularly perform preventative health assessments [42] and develop individualised care plans. Some screening using evidence-based tools could also be completed prior to consultation by the clients themselves in the waiting room using computer-based, visual, interactive surveys [33, 43, 44] which could also include brief interventions [45]. But fully automated tools might not be suitable for Indigenous Australian clients with lower computer literacy, or those who would feel more comfortable receiving less direct feedback delivered by clinicians in conversation.

Beyond resource constraints, clinicians have reported discomfort in talking to their clients about drinking (in mainstream settings) [46]. Some clinicians see addressing hazardous drinking to be the role of specialists or their clients’ families [40]. Drinking may be an especially sensitive topic for Indigenous Australians as heavy drinking has at times been used to stereotype Indigenous Australians as ‘drunks’ [33, 47]. Australian government policies have at times contributed to the stigmatisation of drinking by unilaterally restricting the sale of alcohol in various Indigenous Australian communities [47]. These sensitivities can make conversations about drinking difficult. But, for these reasons evidence-based screening tools may be especially useful in guiding conversations about drinking. Additionally, regular screening with structured assessments like AUDIT-C could normalise conversations about drinking thereby reducing stigma over time. Given the poor sensitivity of unstructured assessments, we strongly recommend the increased uptake of evidence-based screening tools such as AUDIT-C for use with Indigenous Australian clients.

Service administrators should encourage health workers to use AUDIT-C with Indigenous Australian clients instead of unstructured risk assessments where possible. Training and support for service staff can help improve uptake of AUDIT-C [17]. Training could also help health professionals in understanding what AUDIT-C results mean for their clients and how they should respond to them. In particular, based on our findings, health professionals should ensure that they do not allow younger clients with positive AUDIT-C screening results to slip through the cracks.

Finally, while AUDIT-C is a useful tool for clinicians, clinical experience and judgement are also important. Previous authors have raised questions about whether the AUDIT-C is appropriate for use with Indigenous Australian clients in remote settings [33]. Formal validation of the AUDIT-C for use with Indigenous Australians is needed. Some clients might not understand the wording of AUDIT-C items or may find answering difficult if they shared alcohol with others and did not pay attention to what they drank as an individual [33, 48]. Some Indigenous Australians might also find direct questioning based on AUDIT-C items intrusive [33]. For these situations clinicians may need to adapt AUDIT-C phrasing as needed [49], or to obtain the relevant information through conversational approaches [45]. If the basic AUDIT-C content is covered (which establishes the quantity and frequency of regular consumption, and the frequency of heavy drinking occasions), we would expect these assessments to still be effective in establishing drinking risk.

Limitations

The accuracy of our findings relies on accurate record keeping at participating services. Since 2017 the Australian government has changed reporting requirements at ACCHSs to include the numbers of clients for which AUDIT-C was conducted [13]. Thus, the frequency of AUDIT-C assessments at ACCHSs may now be higher than what is reported here [17]. The order that clinicians performed AUDIT-C and unstructured assessments could be important in cases where clinicians performed both assessments on single occasions. However, controlling for instances where both assessments were performed during the same clinical session did not meaningfully change the relationship between AUDIT-C and finding clients at risk from drinking with unstructured assessments. This might suggest clinicians generally do not change prior unstructured assessments based on subsequent AUDIT-C results. Screening behaviour might vary between clinicians who preferred AUDIT-C to using unstructured assessments. We did not have access to clinician IDs which would be required to examine this, or to model clustering by clinician. We encourage future work which clarifies to what degree clinical preferences drive screening test performance. A trial where two clinicians separately assess the same clients and are randomised to either use AUDIT-C or subjective judgement could eliminate potential confounds and provide a stronger level of evidence. It is possible that repeated screening with AUDIT-C reduced its sensitivity (to true drinking risk) as has been demonstrated in samples of veterans in North America [50]. A longitudinal study comparing repeated AUDIT-C screening results to biomarkers associated with heavy drinking (e.g., blood pressure and liver enzymes) would be useful in clarifying whether repeated screening affects the accuracy of AUDIT-C screening among Indigenous Australians.

Conclusion

Unstructured drinking risk assessments are commonly made at Aboriginal Community Controlled Health Services. Most people drinking at risky levels (based on AUDIT-C) are not identified when clinicians use unstructured assessments. Increasing use of AUDIT-C would help detect substantially more clients at risk from alcohol consumption. Detection of hazardous consumption provides opportunities to engage clients in conversation on the effects of alcohol consumption on their health.

Availability of data and materials

Data for this project is stored at the University of Sydney based at Drug Health Service, KGV Building, Missenden Road, Camperdown New South Wales, 2050 Australia.

References

  1. Conigrave JH, Lee SWKSK. Drinking risk varies within and between Australian Aboriginal and Torres Strait Islander samples: A meta-analysis to identify sources of heterogeneity. Addiction (Abingdon, England). 2020;115(10):1817–30.

    PubMed  Google Scholar 

  2. Australian Institute of Health and Welfare. Alcohol, tobacco & other drugs in Australia. Australian Institute of Health and Welfare; 2020.

    Google Scholar 

  3. Gracey M, King M. Indigenous health part 1: determinants and disease patterns. Lancet. 2009;374:65–75.

    PubMed  Google Scholar 

  4. Human Rights and Equal Opportunity Commission. Bringing them home: Report of the national inquiry into the separation of Aboriginal and Torres Strait Islander children from their families. Sydney: Commonwealth of Australia; 1997.

    Google Scholar 

  5. Fitzpatrick JP, Latimer J, Carter M, Oscar J, Ferreira ML, Carmichael Olson H, et al. Prevalence of fetal alcohol syndrome in a population-based sample of children living in remote Australia: the Lililwan Project: Fetal alcohol syndrome—remote Australia. J Paediatr Child Health. 2015;51:450–7.

    PubMed  Google Scholar 

  6. Pozzato I, Tate RL, Rosenkoetter U, Cameron ID. Epidemiology of hospitalised traumatic brain injury in the state of New South Wales, Australia: a population-based study. Aust N Z J Public Health. 2019;43:382–8.

    Google Scholar 

  7. Esterman A, Thompson F, Fitts M, Gilroy J, Fleming J, Maruff P, et al. Incidence of emergency department presentations for traumatic brain injury in Indigenous and non-Indigenous residents aged 15 over the 9-year period 2007 in North Queensland, Australia. Inj Epidemiol. 2018;5:40.

    PubMed  PubMed Central  Google Scholar 

  8. West C, Muller R, Clough AR, Fitts MS. Have alcohol management plans reduced violence against women in Cape York, Australia? Violence Against Women. 2018;24:1658–77.

    PubMed  Google Scholar 

  9. Ramamoorthi R, Jayaraj R, Notaras L, Thomas M. Alcohol-related violence among the Australian Aboriginal and Torres Strait Islanders of the Northern Territory: prioritizing an agenda for prevention-narrative review article. Iran J Public Health. 2014;43:539.

    PubMed  PubMed Central  Google Scholar 

  10. Kaner E, Beyer F, Muirhead C, Campbell F, Pienaar E, Bertholet N, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane database of systematic reviews. Wiley; 2018.

    Google Scholar 

  11. World Health Organization. Global strategy to reduce the harmful use of alcohol. Geneva: World Health Organization; 2010.

    Google Scholar 

  12. Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a brief screen for alcohol misuse in primary care. Alcohol Clin Exp Res. 2007;31:1208–17.

    Google Scholar 

  13. Australian Institute of Health and Welfare. AIHW national Key Performance Indicators database: user guide reporting period ending 30 June 2017. Australian Institute of Health and Welfare; 2017.

    Google Scholar 

  14. Reid ALA, Webb GR, Hennrikus D, Fahey PP, Sanson-Fisher RW. General practitioners’ detection of patients with high alcohol intake. BMJ. 1986;293:735–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  15. Bryant J, Hobden B, Forshaw K, Oldmeadow C, Walsh J, Sanson-Fisher R. How accurately do general practitioners detect concurrent tobacco use and risky alcohol consumption? A cross-sectional study in Australian general practice. Aust J Prim Health. 2018;24:378.

    PubMed  Google Scholar 

  16. Paul C, Yoong SL, Sanson-Fisher R, Carey M, Russell G, Makeham M. Under the radar: a cross-sectional study of the challenge of identifying at-risk alcohol consumption in the general practice setting. BMC Fam Pract. 2014;15:74.

    PubMed  PubMed Central  Google Scholar 

  17. Conigrave JH, Harrison KH, Lee KSK, Dobbins T, Hummerston B, Hayman N, et al. Support can increase use of the AUDIT-C in Australian Aboriginal Community Controlled Health Services: a cluster randomised trial. Addiction. 2021;116(9):2304–15.

    PubMed  Google Scholar 

  18. Harrison KH, Lee KK, Dobbins T, Wilson S, Hayman N, Ivers R, et al. Supporting Aboriginal Community Controlled Health Services to deliver alcohol care: Protocol for a cluster randomised controlled trial. BMJ Open. 2019;9:e030909.

    PubMed  PubMed Central  Google Scholar 

  19. Australian Bureau of Statistics. Australian standard geographical classification (ASGC). Australia: Australian Bureau of Statistics Canberra; 2006.

    Google Scholar 

  20. Calabria B, Clifford A, Shakeshaft AP, Conigrave KM, Simpson L, Bliss D, et al. Identifying Aboriginal-specific AUDIT-C and AUDIT-3 cutoff scores for at-risk, high-risk, and likely dependent drinkers using measures of agreement with the 10-item Alcohol Use Disorders Identification Test. Addict Sci Clin Pract. 2014;9:17.

    PubMed  PubMed Central  Google Scholar 

  21. Lee KSK, Conigrave J, Wilson S, Perry J, Callinan S, Room R, et al. Short screening tools for risky drinking in Aboriginal and Torres Strait Islander Australians: modified AUDIT-C and a new approach. Addict Sci Clin Pract. 2019. https://doi.org/10.1186/s13722-019-0152-6.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Clifford A, Shakeshaft A. Evidence-based alcohol screening and brief intervention in Aboriginal Community Controlled Health Services: Experiences of health-care providers: brief intervention in Aboriginal health. Drug Alcohol Rev. 2011;30:55–62.

    PubMed  Google Scholar 

  23. Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived Alcohol Use Disorders Identification Test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res. 2005;29:844–54.

    PubMed  Google Scholar 

  24. R Core Team. R: A language and environment for statistical computing [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2020. https://www.R-project.org/

  25. Aust F, Barth M. papaja: Create APA manuscripts with R Markdown [Internet]. 2020. https://github.com/crsh/papaja

  26. Coughlin SS, Trock B, Criqui MH, Pickle LW, Browner D, Tefft MC. The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test. J Clin Epidemiol. 1992;45:1–7.

    CAS  PubMed  Google Scholar 

  27. Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015;67:1–48.

    Google Scholar 

  28. Fox J, Weisberg S. An R companion to applied regression [Internet]. Third. Thousand Oaks CA: Sage; 2019. https://socialsciences.mcmaster.ca/jfox/Books/Companion/

  29. Wickham H. ggplot2: Elegant graphics for data analysis [Internet]. Springer-Verlag New York; 2016. https://ggplot2.tidyverse.org

  30. Sachs MC. plotROC: A tool for plotting ROC curves. J Stat Softw Code Snippets. 2017;79:1–9.

    Google Scholar 

  31. Lüdecke D, Ben-Shachar MS, Patil I, Waggoner P, Makowski D. performance: an R package for assessment, comparison and testing of statistical models. J Open Source Softw. 2021;6:3139.

    Google Scholar 

  32. McNemar Q. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika. 1947;12:153–7.

    CAS  PubMed  Google Scholar 

  33. Lee KSK, Chikritzhs T, Wilson S, Wilkes E, Gray D, Room R, et al. Better methods to collect self-reported alcohol and other drug use data from Aboriginal and Torres Strait Islander Australians: indigenous substance use data. Drug Alcohol Rev. 2014;33:466–72.

    PubMed  Google Scholar 

  34. Byrd KM. Binge drinking in and out of college: An examination of social control and differential association on binge drinking behaviors between college students and their non-college peers. Sociol Spectr. 2016;36:191–207.

    Google Scholar 

  35. National Health and Medical Research Council. Australian guidelines to reduce health risks from drinking alcohol. 2020.

  36. Tam CWM, Zwar N, Markham R. Australian general practitioner perceptions of the detection and screening of at-risk drinking, and the role of the AUDIT-C: a qualitative study. BMC Fam Pract. 2013;14:121.

    PubMed  PubMed Central  Google Scholar 

  37. Brady M, Dawe S, Richmond R. Expanding knowledge among Aboriginal service providers on treatment options for excessive alcohol use. Drug Alcohol Rev. 1998;17:69–76.

    CAS  PubMed  Google Scholar 

  38. Al-Yaman F. The Australian Burden of Disease Study: Impact and causes of illness and death in Aboriginal and Torres Strait Islander people, 2011. Public Health Res Pract. 2017. https://doi.org/10.17061/phrp2741732.

    Article  PubMed  Google Scholar 

  39. Larkins S, Geia LK, Panaretto K. Consultations in general practice and at an Aboriginal community controlled health service: do they differ? 2006. https://www.rrh.org.au/journal/article/560/

  40. Brady M, Sibthorpe B, Bailie R, Ball S, Sumnerdodd P. The feasibility and acceptability of introducing brief intervention for alcohol misuse in an urban Aboriginal medical service. Drug Alcohol Rev. 2002;21:375–80.

    PubMed  Google Scholar 

  41. Weller DP, Litt JCB, Pols RG, Southgate DO, Harris RD, Ali RL. Drug and alcohol related health problems in primary care what do GPs think? Med J Aust. 1990;156:43–8.

    Google Scholar 

  42. Australian Government Department of Health. Medicare benefits schedule. http://www.mbsonline.gov.au/;

  43. Lee KSK, Conigrave JH, Callinan S, Wilson S, Room R, Perry J, et al. Asking about the last four drinking occasions on a tablet computer as a way to record alcohol consumption in Aboriginal and Torres Strait Islander Australians: a validation. Addict Sci Clin Pract. 2019;14:15.

    PubMed  PubMed Central  Google Scholar 

  44. Lee KSK, Conigrave JH, Al Ansari M, Wilson S, Perry J, Zheng C, et al. Acceptability and feasibility of a computer-based application to help Aboriginal and Torres Strait Islander Australians describe their alcohol consumption. J Ethn Subst Abuse. 2021;20:16–33.

    PubMed  Google Scholar 

  45. Haber PS, Riordan BC, Winter DT, Barrett L, Saunders J, Hides L, et al. New Australian guidelines for the treatment of alcohol problems: an overview of recommendations. Med J Aust. 2021;215:315–6.

    PubMed  Google Scholar 

  46. Roche AM, Guray C, Saunders JB. General practitioners’ experiences of patients with drug and alcohol problems. Addiction. 1991;86:263–75.

    CAS  Google Scholar 

  47. Hunter E, Brady M, Hall W. National recommendations for the clinical management of alcohol-related problems in Indigenous primary care settings. Canberra, ACT: Commonwealth Department of Health and Aged Care; 1999.

    Google Scholar 

  48. Islam M, Oni H, Lee KK, Hayman N, Wilson S, Harrison K, et al. Standardised alcohol screening in primary health care services targeting Aboriginal and Torres Strait Islander peoples in Australia. Addict Sci Clin Pract. 2018;13:5.

    PubMed  PubMed Central  Google Scholar 

  49. Conigrave J, Conigrave K, Wilson S, Lee K. Indigenous Australian drinking risk: comparing risk categorisations based on recall of recent drinking occasions to AUDIT-C screening in a representative sample. Drug Alcohol Rev. 2021;41(3):616–24.

    PubMed  Google Scholar 

  50. Lapham GT, Rubinsky AD, Williams EC, Hawkins EJ, Grossbard J, Chavez LJ, et al. Decreasing sensitivity of clinical alcohol screening with the AUDIT-C after repeated negative screens in VA clinics. Drug Alcohol Depend. 2014;142:209–15.

    PubMed  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the 22 services that took part in this study. We would also like to thank Kristie Harrison, Beth Hummerston, José Padarian Campusano, Rob Assan, Jimmy Perry, Monika Dzidowska, Teagan Weatherall, Taleah Reynolds, and Summer Loggins for their contributions.

Funding

This work was supported by the National Health and Medical Research Council (NHMRC) through a Project Grant (#1105339), the Centre of Research Excellence in Indigenous Health and Alcohol (#1117198), and a practitioner Fellowship for K Conigrave (#1117582). P Haber was supported by a practitioner fellowship from the Medical Research Future Fund (MRFF #1155320).

Author information

Authors and Affiliations

Authors

Contributions

JC and KC conceived the research question and analysis plan. KC, KL, and PH contributed to the conception of the broader project. KC and KL were part of the team that facilitated data collection and liaised with Aboriginal Community Controlled Health Services. JC performed the statistical analyses and wrote the first manuscript draft. MD contextualised findings for Indigenous Australians and helped with interpretation of results. JV helped contextualise and interpret findings as they related to staff and clients at Aboriginal Community Controlled Health Services. All authors contributed in writing, editing and preparing the final manuscript.

Corresponding author

Correspondence to James H. Conigrave.

Ethics declarations

Ethics approval and consent to participate

Approval was obtained from eight ethics committees across Australia: the Aboriginal Health and Medical Research Council of NSW Ethics Committee (NSW; project 1217/16), Central Australian Human Research Ethics Committee (project CA-17-2842), Human Research Ethics Committee of Northern Territory Department of Health and Menzies School of Health Research (project 2017-2737), Central Queensland Hospital and Health Service Human Research Ethics Committee (project 17/QCQ/9), Far North Queensland Human Research Ethics Committee (project 17/QCH/45-1143), The Aboriginal Health Research Ethics Committee, South Australia (SA; project 04-16-694), St Vincent’s Hospital Melbourne Human Research Ethics Committee (project LRR 036/17) and Western Australian Aboriginal Health Ethics Committee (WA; project 779).

Consent for publication

Not applicable.

Competing interests

JV is employed by Aboriginal Health Council SA, the peak body for Aboriginal Community Controlled Health Services across South Australia. KC works one day a week at an Aboriginal Community Controlled Health Service which is not part of the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1

. The odds of clients being found at risk in unstructured assessments. One observation used per client (the first). Table S2. The odds of clients being found at-risk using unstructured screening by age, gender, AUDIT-C score, remoteness, same occasion screening, and the interaction between AUDIT-C and gender. Table S3. The odds of clients being found at-risk using unstructured screening by age, gender, AUDIT-C score, remoteness, same occasion screening, and the interaction between AUDIT-C and service remoteness.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Conigrave, J.H., Lee, K.S.K., Haber, P.S. et al. More than three times as many Indigenous Australian clients at risk from drinking could be supported if clinicians used AUDIT-C instead of unstructured assessments. Addict Sci Clin Pract 17, 23 (2022). https://doi.org/10.1186/s13722-022-00306-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13722-022-00306-5

Keywords