Article Text
Abstract
Objective Implementation of effective population-level injury prevention interventions requires broad multiagency partnerships. Different stakeholders address this from varying perspectives, and potential conflicts in priorities need to be addressed for such partnerships to be effective. The researcher-led National Guidance for Australian football Partnerships and Safety (NoGAPS) project involved the engagement and participation of seven non-academic partners, including government health promotion and safety agencies; peak sports professional and advocacy bodies and health insurance organisations.
Design The partnership's ongoing development was assessed by each partner completing the Victorian Health Promotion Foundation Partnership Analysis Tool (VPAT) annually over 2011–2015. Changes in VPAT scores were compared through repeated measures analysis of variance.
Results Overall, mean total VPAT scores increased significantly over the 5-year period (125.1–141.2; F5,30=4.61, p=0.003), showing a significant improvement in how the partnership was functioning over time. This was largely driven by significant increases in several VPAT domains: ‘determining the need for a partnership’ (F5,30=4.15, p=0.006), ‘making sure the partnership works’ (F5,30=2.59, p=0.046), ‘planning collaborative action’ (F5,30=5.13, p=0.002) and ‘minimising the barriers to the partnership’ (F5,30=6.66, p<0.001).
Conclusion This is the first study to assess the functioning of a multiagency partnership to address sport injury prevention implementation. For NoGAPS, the engagement of stakeholders from the outset facilitated the development of new and/or stronger links between non-academic partners. Partners shared the common goal of ensuring the real-world uptake of interventions and research evidence-informed recommendations. Effective multiagency partnerships have the potential to influence the implementation of policies and practices beyond the life of a research project.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Introduction
Implementation of effective solutions to population-level health and safety issues requires a broad multiagency approach,1 ,2 especially if interventions are to be sustained as ongoing practice.3 The World Health Organisation (WHO) defines a partnership as ‘a collaborative relationship between two or more parties based on trust, equality, and mutual understanding for the achievement of a specified goal’ (p. 1).4 Partnerships between researchers and stakeholders, including government departments and non-government agencies, are necessary to positively impact on public health and injury issues.5–9 Multilevel approaches are particularly important when designing and implementing prevention strategies,10 including those for injury prevention.3 ,9 ,11 Partnerships need to be sustained to ensure long-term injury prevention gains.12 However, research into which features of partnerships are most likely to achieve sustainability is scarce. In sports injury prevention, for example, fewer than 4% of studies describing the efficacy/effectiveness of exercise training programmes have considered programme maintenance factors.13
The ability of any partnership to operate effectively and meet defined targets depends on the ‘extent to which the perspectives, resources, and skills of its participating individuals and organisations contribute to and strengthen the work of the group’ (p. 187).14 Partnerships addressing public health problems can be difficult to sustain,5 particularly when varying stakeholder perspectives, with potentially conflicting priorities, exist.15 Measuring the performance of partnerships is critical to determine whether a partnership approach is working and achieving desired outcomes.16 Although evaluation of a partnership can involve an assessment of whether key targets have been reached,17 for some partnerships those targets might only be realised in the long term. Most partnership evaluation research has examined the ability of the partnership to function as an entity.5 ,14 Important factors for partnership effectiveness include active participation of members, member diversity, collaboration among member agencies, trust and respect between partners and having clear procedures for managing conflict and power differentials.5 ,16 ,18 An effective partnership evaluation can provide accountability to stakeholders and support the continuous improvement of the collaborations.19
Several challenges to evaluating partnership progress exist, including attributing successful outcomes to partnership arrangements and determining whether observed benefits outweigh the costs of partnership. The Partnership Continuum20 is useful for conceptualising different levels of a partnership and provides a framework for evaluating health promotion partnerships.1 It can be used to guide the identification of needs of partnership members along an engagement continuum that ranges from informal networking through to formal collaboration, with the latter representing the deepest level of engagement and synergy.
The National Guidance for Australian football Partnerships and Safety (NoGAPS)21 project is a multiagency partnership approach to the development of practical guidelines to help community sporting organisations adopt a sustainable approach to safety and to implement specific injury prevention interventions. The larger NoGAPS project aimed to develop and evaluate the strategic implementation of an evidence-based sports safety programme in community-Australian Football (AF),21 and was the first to bring together a range of stakeholder groups to improve community sport safety in Australia. The aim of this paper is to describe the evolution of the stakeholder partnership over the 5-year NoGAPS project. Differences in outcome expectations across partners, depending upon their own major operational focus, were expected. Nonetheless, it was hypothesised that these expectations would change during the project, as the partners were exposed to, and encouraged to engage with each other and the staged research activity and outputs.
Methods
The main focus of the NoGAPS partnership was on preventing injuries in community-AF. Additionally, most partners were interested in developing a robust process for scale-up to other sports. Full details of the partnership rationale, the specific research and implementation questions addressed and the evaluation plan have been published.21 The NoGAPS project was jointly initiated by researchers and the partners in response to a funding call by the National Health and Medical Research Council (NHMRC). The research team developed the funding application and scientific research plan, in response to an identified sport injury prevention need presented by the Australian Football League (AFL). Six other partners were approached to participate because of their key national/state roles in sport injury prevention. All agreed to participate. Table 1 describes these partner agencies.
Participants who contributed to the results presented in this paper were the agency-nominated representatives of the seven partners involved throughout the NoGAPS project. Membership of the partnership group was restricted to organisations. No players, coaches or others were included, though these individuals were engaged throughout the project.22
Ethics approval was obtained from the Monash University Human Research Ethics Committee. Anonymity was guaranteed for all agencies.
The development of the partnership was evaluated over a 5-year period from February 2011 to March 2015 using the Victorian Health Promotion Foundation Partnership Analysis Tool (VPAT).20 The VPAT was based on the Partnership Continuum and designed to help groups reflect on established partnerships and monitor their effectiveness. It reflects theory about how community partnerships can positively influence health. It has previously been used in community-based projects in Victoria, Australia23 and to explore the development of sports safety policy by a multiagency partnership.24
Formal whole-of-partnership meetings, involving the research team and partner representatives, were held biannually to discuss interim research findings and inform ongoing programme and partnership development (figure 1). During these face-to-face meetings, partners were able to have direct input into the design of the injury prevention programme content and implementation plan in real time, as it evolved. Each meeting also included planning of whole-of-partnership actions for the forthcoming 6 months.
The first VPAT administration was before the first whole-of-partnership meeting (February 2011) and it was readministered in April 2011 to identify any immediate changes following the first partner meeting. It was then administered annually in 2012–2015, before the first whole-of-partnership meeting each year (figure 1).
Total scores (possible range 35−175) were categorised into the three recommended VPAT levels indicating the degree of partnership functionality (table 1).20 The VPAT Partnership Checklist20 was then used to assess the partners’ perceptions across seven domains: (1) determining the need for a partnership; (2) choosing partners; (3) making sure partnerships work; (4) planning collaborative action; (5) implementing collaborative action; (6) minimising the barriers to partnership and (7) reflecting on and continuing the partnership. Items within each VPAT domain were rated on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), then summed to give an overall domain score representing partnership function (table 2). Higher scores indicated greater agreement with the VPAT concepts of a successful partnership. Descriptive analyses were used to summarise checklist domain scores and aggregated checklist scores both within and across partners. Repeated measures analysis of variance was used to compare total and domain scores over time. The least significant difference (LSD) was used to undertake post-test multiple comparisons of significant trends. One partner did not complete the last survey and their most recent response was carried forward to the final time point. All analyses were performed in the statistical package R (R Core Team 2013, http://www.r-project.org, V.3.1.2).
Results
Across partners, the median total VPAT score (table 2, solid line in figure 2) increased over time and the range of scores across agencies was less variable. The mean total VPAT scores increased significantly over the 5-year period (F5,30=4.61, p=0.003). Post-hoc comparisons demonstrated significant differences in the mean total VPAT scores between the first and fourth surveys (LSD 12.30, 95% CI 1.25 to 23.32; p=0.03), the first and fifth surveys (LSD 14.43, 95% CI 3.40 to 25.47; p=0.01) and the first and sixth surveys (LSD 16.30, 95% CI 5.25 to 27.32; p=0.005).
Table 3 shows that, across all partners, mean VPAT domain scores increased significantly over the 5-year period for the following four domains: domain 1: ‘determining the need for a partnership’ (F5,30=4.15, p=0.006); domain 3: ‘making sure the partnership works’ (F5,30=2.59, p=0.046); domain 4: ‘planning collaborative action’ (F5,30=5.13, p=0.002) and domain 6: ‘minimising the barriers to the partnership’ (F5,30=6.66, p<0.001).
Although there were improvements in all domains across surveys, there was some variability in change in VPAT scores across domains. Nonetheless, these results suggest that the partnerships had strengthened over the 5-year NoGAPS project, notably in many aspects not related to the initial research that brought the partners together in the first place. Online supplementary file 1 shows trends in the individual items within each domain.
Supplemental material
Discussion
To the best of our knowledge, this is the first study to bring together a range of stakeholder groups in a formal partnership to address sports injury prevention. Government investment in sports injury prevention has been limited and therefore the funding and in-kind contributions provided by the partners to this project represented major new investments in this area. While some partners had previously worked together, this project brought together industry-wide representation to develop a coordinated and strategic approach to sports safety. Discussion of the VPAT results during the whole-of-partnership meetings encouraged partners to examine the reason for the partnership and evaluate a number of its features. This evaluation of partnership functioning was useful for identifying concerns related to communication, roles and responsibilities, shared interests and trust.
The ability of any partnership to operate effectively and meet targets depends on the ability of the participating individuals and organisations to contribute to and strengthen the work of the partnership. Understanding the partners’ perspectives and any potentially conflicting priorities provides important information on how well a partnership is functioning and the ability of the partnership to influence policy and practice. This is one of very few studies to describe the views of different partners about a multiagency and cross-sectoral injury prevention partnership and how this changes over time.
A partnership between researchers and policy officers from governmental health departments has previously been shown to have strong benefits for falls prevention.8 There has also been a call for governmental health agencies to be a lead agency in cross-sectoral injury prevention efforts more widely.9 However, very few studies have sought to understand the processes involved in the formation of such partnerships to address injury prevention and an even smaller number have investigated partnerships specifically aimed at sports injury prevention.24 In the context of general sports injury prevention, previous sports safety efforts have largely been undertaken in isolation, by either the sports or the health sectors but rarely together, and this may well have limited their success.25 To our knowledge, this is one of the first studies worldwide to assess the functioning of a multiagency partnership, crossing both sport and health sectors, created specifically to address sports injury prevention.
The NoGAPS partnership was initiated as a research project through one-to-one contact of the research team with individuals from the partner agencies and this is reflected in the fact that the ‘choosing partners’ domain was stable and collaborative action was consistently high. Although the partners had all agreed to participate in this collaborative research initiative, they did not meet as a whole team until April 2011. Comparison of the VPAT scores before and after that whole-of-partnership meeting showed that bringing everyone together for the first time contributed to a very large improvement in the functioning of the partnership. This was not unexpected, but ongoing annual VPAT evaluations demonstrated that the partnership strength grew each year. Overall, the partners began with a shared common goal of ensuring the real-world uptake of evidence-informed sports injury prevention. They identified the need for trust, mutual respect and a desire to work and communicate with each other, as important factors in an effective partnership. Lower baseline VPAT domain scores relating to the partners’ roles and responsibilities, organisational priorities and communication within the partnership improved over the 5-year period.
The need for attention to communication, roles and responsibilities, shared interests and trust as important influences on partnership functioning have previously been reported in the literature.1 ,14 ,26 Open communication among partners can help the partnership to focus on a common objective and helps to increase trust and sharing of resources between members.27 The observed VPAT trends indicate that the partners perceived improvements in the collective decision-making processes over the 5 years, presumably through interactions at the regularly scheduled whole-of-partnership meetings.
Despite this, the partners were unconvinced that strategies were in place to enhance the skills of the partnership over time. Apart from the regularly scheduled whole-of-partnership biannual meetings and frequent dissemination of research findings from the research team, there were no formal processes instituted to facilitate collaboration or action to address partnership deficiencies. Specific strategies to enhance the partnership functioning, such as using partnership brokers or workforce training in collaborative skills,28 could be used to address this.
A strength of this partnership evaluation was that it was conducted annually over 5 years. Understanding the changes in relationships between individuals and organisations is essential for both adoption and sustainability of a partnership. This study used the VPAT to show change over time and demonstrates that this tool is sensitive enough for these purposes. The strength of the relationships that an organisation develops will also depend on the level of organisational support and opportunities for interaction and collaboration with other partners. Group interaction analysis may be useful for this in the future.29
Several limitations of this study need to be acknowledged. The partnership was instigated for a specific research aim and the NHMRC Partnership Project funding opportunity was used to leverage funding and in-kind support for the project from each partner. Each had a strong stake in the project to succeed, but the partnership could have been influenced by the NoGAPS funding and contractual arrangements. It was the needs of the research project that initiated the annual whole-of-partnership meetings, which then mediated the partnership growth and goals of the partnership. The surveys relied on self-reported perceptions of the partnership and the views expressed from the organisational representatives may not have been the same as those of their colleagues. Moreover, the validity of the VPAT is not known. For two partners, the representative who completed the VPAT changed and this may have influenced within-organisation trends. This study focused on the functioning of the partnership and, while satisfaction of the stakeholders with the partnership was considered, other outcomes of effective partnerships, such as the sustainability of the partnership and changes in their policies and practices, were not measured. Finally, the reasons postulated for the improvements in the partners’ perceptions need to be interpreted with caution. During the 5-year partnership period, no specific processes were put in place to facilitate collaboration or action to address partnership deficiencies. In the absence of any specific strategies to enhance the partnership functioning or evaluation of how partner relationships outside of NoGAPS changed over time, the reasons for changes in the partners’ perceptions during the project are unknown.
It is not yet known if the partnership will be sustained, or the extent to which the sports injury prevention programme it developed will be able to be maintained. The trends in VPAT item 7.4 (supplemental file) give some suggestion that the partners may have become concerned about the availability of resources to continue the partnership as the funded project neared its end. It was not clear if this decline in the VPAT item score related to the continuation of the partnership group itself, or was more about the maintenance of the injury prevention programme. There would be value in reassessing the partnership 12 months after the formal project end, to identify determinants of, and barriers towards, its sustainability.
In addition to the promising VPAT score changes, there have been other demonstrable successes arising from collaborative effort on the part of the research team and the partner organisations. An evidence-informed exercise training programme to prevent lower limb injuries has been developed30 and is now available through the AFL's website (http://www.aflcommunityclub.com.au/index.php?id=1905). In 2015, the AFL formally endorsed the sports safety programme, committing to including it in future national coach education programmes. New learnings about how to target sports injury prevention programmes specifically for their implementation context, including engaging the community in developing an optimal delivery plan also arose.22
In conclusion, effective multiagency partnerships have the potential to influence implementation of injury prevention policies and practices beyond the life of a research project. Sports injury is a multifactorial public health problem requiring a multiagency approach to implement effective preventive solutions across all levels of sports.3 The lack of a strategic, coordinated approach to sports safety has contributed to a recognised limited adoption of policy and poor levels of implementation of research evidence and interventions to date.3 ,15 ,21 ,25 ,31
Further investment in sports safety partnerships should focus on management and action to address the identified deficiencies for the benefit of all partners and could enhance the effectiveness of the partnership. How well any partnership functions will influence its potential to contribute to, and directly influence the policy and practices of organisations delivering sports safety messages and policy solutions. The development of this NoGAPS partnership has already informed the research process, improved the knowledge of stakeholders and developed connections to help ensure the real-world uptake of interventions and research evidence recommendations.
What is already known on the subject
Development and implementation of effective population-level injury prevention interventions requires broad multiagency partnerships.
Different stakeholders address this from varying perspectives, and potential conflicts in priorities need to be addressed from the outset for such partnerships to be effective.
What this study adds
This is the first study to assess the functioning of a multiagency partnership to address sports injury prevention intervention implementation in the sport and recreation setting.
Engagement of stakeholders from the outset in a research-driven partnership facilitates the development of new and/or stronger links between non-academic partners. Researchers and stakeholder agencies then share a common goal of ensuring the real-world uptake of interventions and research evidence-informed recommendations.
Farm bike deaths in New Zealand
More than 100 children are injured on quad and farm bikes each year in New Zealand and 3–6 die. Farm bikes lead to more child deaths than any other recreational activity in New Zealand except swimming. Still, the law does not prevent children from riding these bikes. It is argued that an outright ban on children being on quad bikes could effectively bar children from farms.
References
Footnotes
Twitter Follow Caroline Finch at @CarolineFinch and Alex Donaldson at @AlexDonaldson13
Contributors CFF, BJG, JC, DGL and AD all contributed to the conception of the overall NoGAPS project and the interpretation of the findings. CFF and AD specifically designed the subcomponent of the project reported in this paper. AM undertook the statistical analysis of the data. CFF and AWS contributed to the writing of the manuscript. All authors contributed to editing of the manuscript for intellectual input and approved the final version of the manuscript prior to submission.
Funding This study was funded by a National Health and Medical Research Council (NHMRC) Partnership Project Grant (ID 565907) with additional support (both cash and in kind) from the project partner agencies: the Australian Football League; Victorian Health Promotion Foundation; NSW Sporting Injuries Committee; JLT Sport, a division of Jardine Lloyd Thompson Australia Pty Ltd; the Department of Planning and Community Development; Sport and Recreation Victoria Division and Sports Medicine Australia National and Victorian Branches. Author AD's salary was funded by this research grant. CFF was supported by an NHMRC Principal Research Fellowship (ID1058737). BJG was supported by an NHMRC Career Development Fellowship (ID1048731). JC was supported by a NHMRC practitioner fellowship (ID1058493). The Australian Centre for Research into Injury in Sport and its Prevention is one of the International Research Centres for the Prevention of Injury and Protection of Athlete Health supported by the International Olympic Committee.
Competing interests None declared.
Ethics approval University Human Research Ethics Committee.
Provenance and peer review Not commissioned; externally peer reviewed.