Article Text

Download PDFPDF

Evaluation of community coalition training effects on youth hospital-admitted injury incidence in Victoria, Australia: 2001–2017
  1. Janneke Berecki-Gisolf1,
  2. Bosco Rowland2,
  3. Nicola Reavley3,
  4. Barbara Minuzzo4,
  5. John Toumbourou2,5
  1. 1Monash University Accident Research Centre, Monash University, Clayton, Victoria, Australia
  2. 2Faculty of Health, Deakin University, Geelong, Victoria, Australia
  3. 3Centre for Mental Health, The University of Melbourne School of Population and Global Health, Melbourne, Victoria, Australia
  4. 4Communities That Care Ltd, Parkville, Victoria, Australia
  5. 5Centre for Adolescent Health, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
  1. Correspondence to Dr Janneke Berecki-Gisolf, Monash University Accident Research Centre, Monash University, Clayton, VIC 3800, Australia; janneke.berecki-gisolf{at}monash.edu

Abstract

Background Injuries are one of the three leading causes of morbidity and mortality for young people internationally. Although community risk factors are modifiable causes of youth injury, there has been limited evaluation of community interventions. Communities That Care (CTC) offers a coalition training process to increase evidence-based practices that reduce youth injury risk factors.

Method Using a non-experimental design, this study made use of population-based hospital admissions data to evaluate the impact on injuries for 15 communities that implemented CTC between 2001 and 2017 in Victoria, Australia. Negative binomial regression models evaluated trends in injury admissions (all, unintentional and transport), comparing CTC and non-CTC communities across different age groups.

Results Statistically significant relative reductions in all hospital injury admissions in 0–4 year olds were associated with communities completing the CTC process and in 0–19 year olds when communities began their second cycle of CTC. When analysed by subgroup, a similar pattern was observed with unintentional injuries but not with transport injuries.

Conclusion The findings support CTC coalition training as an intervention strategy for preventing youth hospital injury admissions. However, future studies should consider stronger research designs, confirm findings in different community contexts, use other data sources and evaluate intervention mechanisms.

  • safe Community
  • injury diagnosis
  • epidemiology

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

View Full Text

Statistics from Altmetric.com

Introduction

Commonly defined as any intentional or unintentional damage to the body, injuries are one of the three leading causes of morbidity and mortality in young people.1 Road and traffic injuries are the most common cause of death for children between ages 10–14 and 15–19 years, respectively.1 Internationally and in Australia, injury rates are increasing.1 2 In addition to physical consequences, injuries have a flow-on effect on the healthcare and welfare systems, through increased health service needs and reduced work capacity, respectively. Given the prevalence and consequences, it is important to implement and evaluate public health interventions to reduce injuries.3 If the negative sequelae of injuries are to be reduced, implementing and evaluating public health interventions that identify and reduce modifiable risk factors that prevent injuries in young people should be a public health priority.4

While many interventions focus on reducing proximal safety hazards, a wide range of distal risk factors for injuries in children and young people have been identified.3 Prominent examples include: socioeconomic disadvantage,5 6 community hazards,7 community violence,8 poor parenting skills,9 child behaviour problems,10 alcohol and other drug use11 and peer violence.6 Alcohol and other drug use are among the major modifiable risk factors for injury for young people.6 12–14 Significant reductions in youth injuries have been associated with policies that restrict the availability of alcohol.14–17 Dominant community interventions, namely the WHO ‘safe community’ approach to coordinating community efforts to enhance safety and reduce injury, have not shown consistent injury prevention effects, potentially due to the limited risk factors they target.18

In the late 1990s, Australia observed rising rates of adolescent health risk behaviour problems associated with drug and alcohol use. Cross-national comparisons indicated that the Australian rate of adolescent alcohol and other drug use was twice as high as the same-aged peers in the USA.19 20 In this context, it was considered important to investigate whether there were feasible and effective community-led intervention alternatives to reduce adolescent alcohol and drug use. A number of studies in that period recommended the implementation of Communities That Care (CTC) as a means of improving adolescent health.21–23

Developed in the USA, CTC is a framework to guide community coalitions to improve child and adolescent health using an evidence-based prevention approach.17 24–26 The framework is organised into five standardised phases: phase 1: recruitment and orientation of community leaders and stakeholders to the CTC process; phase 2: formation of a local coalition to guide decision making; phase 3: use of epidemiological data to prioritise risk factors and protective factors (that modify the effect of risk factors, for example, community opportunities and bonds) to be targeted for preventive action; phase 4: selection of appropriate evidence-based intervention programmes targeting identified risk and protective factors and behaviours; and phase 5: implementation, monitoring and evaluation of selected programmes on targeted risk factors and behaviours. After a cycle is complete, based on their local data, a community can choose to repeat the five phases, either focusing on the same risk and protective factors and outcome behaviours or the community may identify new priorities (described below as phase 6).

Currently in Australia, there are 18 communities that have used the CTC framework. Pilot evaluations have indicated reductions in adolescent injury risk factors including alcohol and other drug use and behaviour problems.24 Although prior studies have evaluated CTC for impacts on injury risk factors, there have been no prior studies examining effects on injury. The aim of the present study was to determine the effect of the CTC approach on hospital-treated injury incidence among children and adolescents. In keeping with the theory of the CTC framework,25 it was hypothesised that the greatest beneficial effects would be observed at the end of one full cycle of CTC implementation (phase 5).

Method

​Participating communities

Fifteen Victorian communities using the CTC framework were included in the study (table 1). These were both regional (n=10) and major city communities (n=5). More detailed information about the communities that participated in the CTC programme has been given previously24 26; summary statistics of the local government areas are provided in the online supplementary appendix table A1. An overview of the recruitment and phases implemented in participating communities, between 2001 and 2017, is provided in table 1. During the data collection period, completion of one full cycle of the CTC framework (phase 5), was achieved by nine municipalities. Two municipalities reached phase 6, the second cycle, and this was achieved from 2006.

Table 1

Communities That Care programme roll-out in Victoria: timing of phases 1–5 (completion) and 6 (second cycle)

​Hospital admission injury data

Hospital admission injury data were obtained through the Victorian Injury Surveillance Unit at the Monash University Accident Research Centre. Data were population-based injury hospital admissions data, which is part of the Victorian Admitted Episodes Dataset (VAED). The VAED is a state-wide collection of data pertaining to admissions to Victorian hospitals (public and private); the VAED was established in July 1987. Data are coded to the International Classification of Diseases, Australian Modification (ICD-10-AM).

Hospital admission injury data were collected at the Statistical Area Level 2 (SA2; based on the area of residence of the person admitted to hospital) in Victoria and included public and private hospitals. SA2 areas are defined based on suburb and locality boundaries to represent communities that interact together socially and economically.27 These data were used to calculate annual per capita injury rates and trends at the SA2 level; injury rates were also grouped into three subcategories: all injury admissions; unintentional injuries; and transport injuries (injury admissions with ICD-10-AM cause coded as transport: V00-V99). Sensitivity analyses were run for unintentional injuries, with sport-related injuries removed in a comparative model, to evaluate the possible effects of increased sports participation (ie, unmeasured changes in exposure).

​Hospital injury time period

To align with implementation of CTC in the 15 communities, injury admissions were selected as admissions between 1 January 2001 and 31 December 2017. Only data with an injury code as the first diagnosis were used. This included all ‘community acquired’ injuries (ICD-10-AM codes S00-T75 or T79) but not medical/surgical injuries. In children aged up to 14 years, injury admissions are mostly due to falls (47%), hit/struck/crush injuries (17%), transport (9%) and cutting/piercing injuries (5%).28 Only incident cases were selected; that is, cases were excluded where they referenced a follow-up visit or transfer to another unit within the same hospital or to another hospital. Patients who were not Victorian residents were excluded. As the study was focused on youth injury rates, persons aged 35 years and over were excluded; the 20–34 year age group was not of direct interest in this study but included as a reference group to account for fluctuations in hospital admissions due to factors unrelated to the CTC programme (eg, state policies and national economic trends).

​Matching injury data and CTC phase implementation

Data on the timing, progress and the implementation of CTC phases for the 15 communities using the CTC framework were provided to the Monash University Accident Research Centre prior to the analysis (shown in table 1). Injury trend data at the municipal level, for the years 2001–2017, were linked to the respective CTC community and stage of phase implementation.

​Primary study outcomes

There were three primary outcomes of the study. These were municipal (SA2) rates of hospital admission for all injury, unintentional injury and transport injury. Rates were calculated as the annual number of injury admissions per 100 000 persons.

​Control variables

Factors controlled, at the SA2 level, in the analysis were community socioeconomic status based on the Australian Bureau of Statistics (ABS) 2011 population Census data29 and remoteness (based on the Australian Statistical Geography Standard).30 Victorian residential population data was used to calculate injury rates per population. This was obtained from the ABS. The data were stratified by calendar year, SA2, age in 5-year bands and sex.

​Comparison communities

To determine the effect of the CTC programme on youth hospital injury admission rates, non-participating communities were the comparison group. This included all of the State of Victoria: participating communities at baseline (phase 0) were combined with non-participating communities to form the comparison group. Only those aged 0–34 years were included in the analysis.

​Analytical strategy

The analyses were carried out using SAS software, V.9.4. To examine the effect of the implementation of CTC on youth hospital injury admission rates, CTC phase implementation was coded as follows: phase 0 was allocated to baseline, as outlined above. Phases 1–4 represented the respective phases of implementation of the CTC framework (described above). Phase 5 represented the implementation stage for one full cycle of the CTC framework; phase 6 represented the beginning of a second cycle of CTC implementation.

Unadjusted rates of hospital injuries, between 2001 and 2017, were computed first. This was done for the whole of the State of Victoria and broken down by age group. Rates were also calculated by age group and CTC phase implementation stage. The effect of the CTC programme on admitted injury rates in each SA2 over time was then determined, using negative binomial modelling. The unit of analysis was SA2 areas in Victoria: SA2 areas were specified in the ‘repeated subject’ statement of the model (Proc Genmod, SAS). The outcome of the model was the number of injury admissions in the SA2. Injury admission trends are impacted by hospital admission policy changes and other data artefacts. Therefore, the relative effect of the CTC on children (vs adults) was analysed. An interaction term of phase and age group was introduced to determine the relative effect of CTC on different child age groups; this interaction term was the key explanatory variable. The effect sizes of the interaction terms are exponentiated to generate IRRs. For this, the 20–35 year age group served as a reference group to account for non-CTC-related fluctuations in hospital admission rates. Control variables were calendar year (categorical variable), age group, sex, community disadvantage and remoteness. Repeated measures were used to account for repeated (yearly) trends in rates of the primary outcome in each SA2. The model was offset with the log of the population in the SA2.

​Sensitivity analysis

To further verify the results of the analysis, several additional analyses were carried out. First, sports injury were included in the unintentional injury data. In the main analysis, sports were taken out as these could reflect an increase in sports participation, which is a favourable outcome. The effect of this is examined by reanalysing the unintentional injury data with sports injury included. Second, the unintentional injury modelling was rerun, including only municipalities that participated in the CTC programme, regardless of whether they reached phase 5 during the study period. This analysis tested the effect of including Victorian municipalities that did not participate in the CTC in the baseline data. Third, the analysis was rerun using medical injuries as outcome, instead of community injuries. Medical injuries are extracted as admissions with a first-listed ICD-10-AM diagnosis code in the range of T80–T88: ‘Complications of surgical and medical care, not elsewhere classified’. One would expect the CTC programme to have no effect on the incidence of medical injuries. Finally, the analysis was rerun on a combined dataset of medical and community injury data: the effect of the CTC on injuries was measured as the interaction effect between injury type (medical vs community) and CTC participation phase. It was expected that phases 5 and 6 were associated with a relative reduction in community injuries.

Results

Table 2 presents unadjusted annual injury admissions from 2001 to 2017 for the whole of Victoria, between the ages of 0 and 34 years. For each age group, over the 17-year period, the number of injuries were greater in 2017, compared with 2001. However, for all age groups, it should be noted that there was a sharp decrease in injury admissions in 2013; this coincides with a Victorian hospital admissions policy change impacting on which types of admissions are captured in these data.31 Between 2001 and 2017, unadjusted injury admission rates remained relatively stable in the age groups 0–4, 5–9, 10–14 and 15–19 years. However, there was a decrease in admission rates for the 20–34 year age group.

Table 2

Overview of age-group specific injury admissions and rates, for ages 0–34 years, Victoria 2001–2017

Table 3 presents an overview of unadjusted injury admission cases, and rates per 100 000 of the population for each CTC phase, and broken down by age group. These rates show trend increases from phase 0 onwards, with a slight trend for reduced rates at phase 5 in 0–14 year age groups.

Table 3

Injury admission rates per age group, per Communities That Care (CTC) implementation phase, Victoria 2001–2017

The unadjusted crude admission rate for communities categorised at phase 0 (not having implemented CTC project) was 1433 annual injury admissions per 100 000 (100k) population; this is the average across the full age range (0–34 years). In contrast, the unadjusted rates were greater in CTC implementation phase 5 (1694 injury admissions per 100 000) and phase 6 (2097 injury admissions per 100 000) on average across all age groups.

The results of adjusted multivariate modelling are shown in table 4 for all injury admissions, unintentional injuries and transport injuries. Values represent the incident rate ratios: the effect sizes of the interaction terms are exponentiated to generate these. Values less than 1 indicate a decrease, compared with the reference group; values greater than 1 represent an increase, compared with the reference group. Statistical significance (p<0.05) is indicated in bold type. Table 4 only shows the interaction effect: the full model and the univariate models are given in the online supplementary appendix, table A2.

Table 4

Multivariate results of injuries for interaction between CTC phase and age group

​All injury admissions

Compared with the age group of 20–34 years, statistically significant reductions in ‘all injury’ admissions were observed at phase 5 CTC for age groups 0–4 years (RR 0.88; 95 CI 0.79 to 0.98)) only. There were non-significant reductions in the age groups 5–9, 10–14 and 15–19 years, compared with the 20–34 age group. Statistically significant relative reductions in injury admissions were observed in phase 6; in all age groups (0 –19 years, compared with 20–34 years).

​Unintentional injuries

Statistically significant relative reductions in unintentional injury admissions (sports-related injuries excluded) were observed in the age group 0–4, 5 years at CTC phase 5, compared with the 20–34 age group. Statistically significant reductions were observed in all age groups (0 to 19 years) when a community was in phase 6 (implementing a new cycle of CTC).

​Transport injuries

There were no clear patterns of association between CTC implementation (phase 5) and rates of transport-related injury admissions in the age groups analysed. In the second cycle (phase 6), a relative reduction was observed in age groups 0–4 and 5–9 years. The age group 15–19 years, however, showed a (non-significant) increase in injury admission rates at phase 6, compared with the age group 20–35 years.

​Sensitivity analysis

Analysing a combined dataset of medical injuries and community injuries, there was a statistically significant interaction effect between injury type (community vs medical) and CTC phase, adjusting for age, sex, socioeconomic index for area, remoteness and year (table 5). Phase 5 (vs phase 0) was associated with a significant relative reduction in community injuries versus medical injuries.

Table 5

Multivariate results for modelling the interaction between CTC phase and injury cause group: medical versus community

The unintentional injury model, including sports injury, is very similar to the model of unintentional injury with sports injuries excluded: results are shown in the online supplementary appendix table A3. Including only communities that participated in the CTC programme resulted in a stronger injury reductive effect of CTC completion: this effect was statistically significant in age groups 0–14 years, compared with the 20–34 year age group. Phase 6 was also associated with a relative reduction in injury admissions per population in this model (online supplementary appendix, table A4).

The effect of CTC completion on medical injuries in ages 0–19 years (compared with 20–34 years) was not statistically significant (online supplementary appendix, table A5). A significant relative reduction in medical injuries in the age group 0–4 years was observed in the implementation phase (1–4, compared with baseline).

Discussion

This is the first study to evaluate the impact of CTC on injuries in children and young people and one of few to evaluate a community intervention’s impact on youth hospital injury admissions. In keeping with the hypotheses, the study identified reductions in all injury admissions in children when communities were completing the first cycle of CTC (phase 5) and second cycle of CTC (phase 6) (table 4); however, depending on the methodology used, not all associations were statistically significant. The most pronounced effects were observed in the age group 0–4 years. A significant reduction was observed at phase 5 when using medical injury as reference group (ie, testing the relative effect of the CTC on community-acquired injuries vs medical injuries: table 5).

Pilot evaluations of the implementation of CTC in four Australian communities have indicated reductions in adolescent injury risk factors including alcohol and other drug use and behaviour problems.24 Although prior studies have evaluated CTC for impacts on injury risk factors, the current study is the first to evaluate effects on child and adolescent injuries. The findings of this study support the notion that while the CTC framework can be used to reduce alcohol and drug use and its associated risk factors, it could also simultaneously reduce hospital admission injuries. If systematically applied to numerous municipalities, the framework could be used to substantially reduce the burden on healthcare and welfare systems. The current findings are particularly important as injuries are leading causes of mortality and morbidity in young people.3

Community coalitions that aim to reduce community injury rates operate in a number of countries.32 33 Similar to the CTC approach,17 25 these coalitions work across sectors and in a variety of settings to prevent and reduce injury. However, there is limited evidence for reduction of injury rates by such interventions as these often focus on removal of injury hazards and are poorly evaluated. The CTC coalition training is designed to expand local investment in evidence-based programme in schools, and family and community services.24–26 By repeating valid epidemiological child and youth surveys, CTC coalitions monitor and continually improve efforts to reduce injury risk factors including poor parenting,9 child behaviour problems,10 alcohol and other drug use11 and peer violence.6 Given that CTC is implemented using a common manualised approach,25 it is likely that the current findings could generalise to CTC implementation in other nations and jurisdictions.20 34 The current findings suggest that youth injury outcome measures should be incorporated into future CTC evaluations.

The CTC process uses a youth survey to identify priority prevention targets.24 Similarly, youth surveys have been advocated in instruments such as the Youth Risk Behaviour Surveillance System (www.cdc.gov/healthyyouth/data/yrbs/index.htm). These surveys have been used to guide injury intervention delivery in communities. Such surveys have also been important for monitoring and surveillance. However, if the findings of this study can be replicated, future research should examine the extent the CTC youth survey offers comparative advantages in guiding injury intervention, compared with other forms of monitoring and surveillance.

While the study did provide evidence of a reduction in hospital injury admissions, the exact mechanism as to how this may be achieved is not clear. The CTC process uses local data to identify local priorities. Based on this information, local communities develop their priorities and create their own action plan.17 While each community targeted alcohol and drug outcomes, a variety of different interventions were implemented across the various CTC sites. Some interventions such as reducing youth alcohol supply were common across communities, while the implementation of evidence-based school and parent programme varied by CTC community.24 The current finding of injury prevention effects for children aged 0–4 years may arise through enhanced parent education and reduced behaviour problems and alcohol and drug use in older siblings. Future research should examine if there are specific interventions that contribute differentially to injury prevention.

Strengths of the current study include the use of a large epidemiologically valid injury database. While the non-experimental design increases naturalistic (external) validity, a substantial limitation is that the phase 6 communities were not recruited in the randomised trial. This limitation increases the potential for factors such as community leadership to have contributed to injury prevention effects and may mean that the association is not a true secondary outcome of the CTC prevention approach. A further limitation is that the study used only coded admissions and no other source of injury data to cross validate injury reports. The study also did not examine variation in CTC programme implementation, which is likely to have impacted on both primary and secondary outcomes. Finally, the study was designed to identify relative effects by using reference groups: the completion phase versus baseline; children versus adults; and community injury versus medical injury. This relies on a specific effect of the CTC on the group of interest and no effect on the reference group. Given the CTC programme focus on alcohol and drug outcomes, it is likely that adults (and adult injury rates) were also affected. This may have led to an underestimate of the relative effect of the CTC on child injury in this study. Further research with larger sample sizes should investigate these factors.

Notwithstanding the limitations of this study, the findings provide the first evidence that there may be an association of the CTC community coalition approach and a reduction in youth injury hospital admissions. While the findings will need to be replicated, and stronger study designs, including testing of mediation models, should be employed, CTC coalition training as an intervention strategy for preventing youth injury hospital admissions is showing signs of promise.

What is already known on the subject

  • Community coalitions that aim to reduce injury rates operate in several countries. There have been few evaluations of the effects of such interventions on rates of injury.

What this study adds

  • This evaluation is the first to associate the Communities That Care coalition training process with reductions in hospital injury admissions in youth.

References

View Abstract

Footnotes

  • Contributors All authors contributed to the conceptualisation of the study, interpretation of the findings and drafting and revising of the manuscript.

  • Funding We acknowledge funding support from the National Health and Medical Research Council (APP1087781), Australian Research Council (LP100200755), State Government of Victoria (Department of Justice and Regulation, VicRoads and Transport Accident Commission) and Ian Potter Foundation (GRANT ID 20170371).

  • Competing interests The following authors served in the not-for-profit company Communities That Care Ltd that was evaluated in this paper: Rowland (current chief executive officer (CEO)), Reavley, Minuzzo (directors) and Toumbourou (director and ex-CEO).

  • Patient consent for publication Not required.

  • Ethics approval Victorian Injury Surveillance Unit has ethical approval for custody, use and dissemination of Victorian hospital data on injury (Monash University Human Ethics Committee project 21427).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement Data are available on reasonable request.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.