Article Text

PDF

Review of evaluations of educational approaches to promote safe storage of firearms
  1. K S McGee1,
  2. T Coyne-Beasley2,
  3. R M Johnson3
  1. 1Department of Maternal and Child Health, University of North Carolina at Chapel Hill, School of Public Health, Chapel Hill, North Carolina
  2. 2Department of Pediatrics and Internal Medicine, University of North Carolina at Chapel Hill, School of Medicine, and University of North Carolina Injury Prevention Research Center, Chapel Hill, North Carolina
  3. 3Department of Health Behavior and Health Education, School of Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
  1. Correspondence to:
 Kara S McGee, World Health Organization, Department of Injuries and Violence Prevention, NMH/VIP, 20 Avenue Appia, CH-1211 Geneva 27, Switzerland;
 mcgeek{at}who.int

Abstract

Objective: To systematically review evaluation studies of educational interventions promoting safe firearm storage.

Methods: Medline, ERIC, PsycINFO, Criminal Justice Periodicals Index, Cumulative Index of Nursing and Allied Health Literature, and Sociofile were searched. The references from each potentially eligible study were checked, and experts in the field were contacted for additional reports. In addition, an internet search was performed to identify programs not published in the conventional literature. Sources relevant to safe firearm storage promotion were selected and evaluated.

Results: Seven studies met inclusion criteria: adult subjects, program description was included, and firearm storage outcomes were measured. One was a randomized controlled trial and the other six were one group pre-test and/or post-test. The studies were classified into the following categories based on the intervention strategies used: (1) counseling and firearm safety materials (n=3); (2) counseling/educational message (n=3); and (3) firearm safety materials distribution (n=1).The outcomes were safe firearms storage (firearms locked up and unloaded or removal from home) after intervention. Four studies, three using counseling and materials distribution, reported improved storage after the interventions.

Conclusions: It is not yet clear what types of interventions, or which specific intervention components, prompt gun owners to securely store their weapons. Increased understanding of gun storage behaviors and stronger evaluation designs will aid further understanding of this important issue.

  • firearms/guns
  • health behavior
  • intervention studies

Statistics from Altmetric.com

Firearm related injuries are a serious problem in the United States. In 2000, 672 children (ages 0–15) were killed and an additional 4845 were seriously injured from firearm gunshots.1 The fact that US youth have considerable access to firearms in their homes2–4 likely contributes to the firearm injury problem.5–7 Over one third of households with children contain firearms, and in about 10% of those homes firearms are stored both loaded and unlocked.4,8,9 It follows, then, that reducing youth access to firearms through certain storage practices is an important strategy for injury prevention.10 The American Academy of Pediatrics, the American Medical Association, the American Academy of Family Physicians, and the United States Preventive Services Task Force support safe firearm storage in homes with youth.11

Safe firearm storage promotion programs take place in clinical and community settings, and primarily rely on educational messages, free or discounted gunlock distribution, or a combination of the two to encourage parents to lock up and unload household firearms.12 The degree to which such programs are successful at eliciting behavior change is unclear. In this paper we systematically review safe firearm storage promotion programs to assess their overall effectiveness.

METHODS

In order to be included in this review, intervention studies had to meet the following criteria: (1) the program was targeted to a defined adult population; (2) a description of the intervention was available; and (3) outcomes, including storing firearms unloaded, locked up in a lock box, gun safe, secured with a trigger or gunlock, or removal of firearm(s) from the home, were measured. Studies were further limited to US settings and English language publications.

In order to identify studies, using the keywords “firearms” and “safety”, the following electronic databases were searched in August 2001 for the period indicated: Medline (1966–2001), ERIC (1966–2001), PsycINFO (1966–2001), Criminal Justice Periodicals Index (1990–2001), Cumulative Index of Nursing and Allied Health Literature (1982–2001), and Sociofile (1974–2001). Additionally, the reference lists of the identified documents were searched for eligible programs. In order to identify literature not published in scientific journals, an internet search was performed. Using the search engine “Google” we did an exact phrase search for “safe firearm storage”. Once programs were identified on the internet, a staff member was interviewed via telephone to obtain further information.

RESULTS

Seven studies met inclusion criteria. Three other studies were identified during the literature search but were not included because there was not an evaluation component in the programs. Six programs were identified through the internet search. Telephone interviews with program administrators revealed that no evaluation has been completed, therefore, these programs were not included in the review. The studies were classified into the following categories based on the intervention strategies used: (1) counseling and materials distribution (n=3)13–15; (2) counseling/educational message (n=3)16–18; and (3) materials distribution (n=1).19 Counseling/educational message programs were characterized by provision of information about the dangers of having a gun in the home and the importance of either removing guns from the home, or storing them unloaded and locked up. Materials distribution programs included dissemination of gun safety devices only. Counseling and materials distribution interventions entailed both dissemination of firearm safety information and distribution of either a safe storage device,14,15 or a safe storage device coupon.13 Results are summarized in table 1.

Table 1

Characteristics and results of studies promoting safe firearm storage

Counseling and materials distribution interventions

Only one study using the counseling and materials distribution intervention strategy was a randomized controlled trial. Grossman et al targeted families visiting a physician’s office.13 If gun ownership was reported, those in the intervention group were given counseling, safe storage information, and a coupon to purchase an extrinsic safety device. Those who did not own guns were given counseling and a pamphlet. Control group participants received usual care. Outcomes included self report of acquisition of safe storage devices, removal of guns from the home, and acquisition of guns. There were no differences between intervention and control group participants with respect to gun acquisition and removal of guns from the home. Only 8% of the intervention group purchased a trigger lock.

Coyne-Beasley et al conducted a community based intervention targeting adult gun owners in North Carolina.14 Participants received a tailored educational message delivered by a health professional, gun safety information, and a free keyed cable gun lock. Law enforcement officers instructed participants on how to secure the lock on their particular firearm. Self report surveys before and after intervention were conducted. Outcomes measured were: number of gun(s) locked up in a compartment and/or unloaded, whether ammunition was locked up and stored separately from guns, and gun lock use. Statistically significant findings included an increase in the percentage of those who were using gun locks and storing guns in a locked compartment.

Horn conducted a community based program targeting randomly selected adult gun owners in two rural towns in Alaska.15 Participants received a gun safe and trigger lock along with a safety message. The outcomes measured, use of the gun safe and/or trigger lock, were assessed during an unannounced home visit with visual inspection. On follow up, 78% of the participants were using the gun safe and 30% of the participants were using trigger locks.

Counseling/educational message interventions

Three studies utilized the counseling/educational message intervention strategy.16–18 Brent et al targeted parents whose adolescents were suffering from major depression and were participating in a randomized clinical psychotherapy trial.16 During the intake interview, parents with a gun in the home received an educational message about the risk of firearms in the home and were given recommendations for removal and safe storage of firearms. The outcomes measured were self report of gun removal and gun acquisition. Of those who had guns at intake, 27% reported removing them from the home.16 Unfortunately, 17% of those who did not own a gun at baseline acquired one over the two year follow up period.

Oatis et al conducted an intervention at a pediatric clinic targeting patients’ parents.17 Parents received an educational message based on the STOP program20 of the American Academy of Pediatrics which encourages removal of guns from the home, and if removal is not considered an acceptable option, storing guns unloaded and locked up. Outcomes measured were self reported change in gun ownership and firearm storage. There were no statistically significant changes in firearm ownership or storage practices.

Kruesi and colleagues targeted adults whose children were being seen at an emergency department for a mental health assessment.18 Parents received an educational message about limiting youth access to firearms and other lethal means for suicide. The outcomes measured were storing guns in a locked compartment or with a trigger lock, and removing guns from the home. The study found a significant association between exposure to the intervention and behavior change.

Materials distribution interventions

Only one study used the material distribution intervention strategy. Coyne-Beasley and Johnson distributed free keyed cable gun locks to law enforcement officers who wanted one.19 The outcome of interest, use of the device, was measured via anonymous self report. The majority (65%) reported that they were not using the gun lock. The primary reason given for not using the gun locks was a perceived inability to access firearms quickly in case of an emergency or home invasion.

DISCUSSION

Reducing access to household firearms through safe storage could reduce the number of firearm injuries to youth, especially unintentional injury and suicides. Educating the public is a strategy for changing firearm storage practices.12 Therefore, in this review we examined the effectiveness of safe firearm storage promotion programs. After an extensive search, we found only seven such programs that had been evaluated. Unfortunately, there is little evidence that those programs are effective at eliciting behavior change (table 1).

The easy conclusion to draw is that evaluations of safe firearm storage promotion programs have a multitude of methodological problems, including weak study designs, potentially biased sampling procedures, and small sample sizes (table 1). Only one of the seven studies employed a randomized controlled trial design.13 Most of the studies included in this review are one group, pre-test/post-test designs, which makes it difficult to draw solid conclusions about their success. Most outcomes were measured via a self reported survey of participants at some time period before and after intervention; therefore, reporting bias is possible. Some of the programs collected data in a clinical setting so some participants might misreport firearm storage methods or there may be a tendency to conceal unsafe practices in aiming to give a socially desirable response. Some of the studies reviewed here also report positive changes in firearm storage practices after intervention but failed to test for statistical significance of these findings.15,16

There are clear shortcomings in the methodological quality of the evaluation studies of safe firearm storage promotion programs. However, we would be remiss if our only conclusion was that these programs have not been established as being effective only because they have not had rigorous enough evaluations. When a given intervention strategy is working, inklings of success often shine through despite the weakest methods. Additionally, even the strongest studies in this review produced null results.13 Thus, it is likely that the approach of safe storage promotion programs needs to be re-examined.

Nevertheless, there are some lessons to be learned from unique components of the interventions reviewed here. For example, the “Love Our Kids, Lock Your Guns” program was preceded by a multimedia campaign and included a counseling session and demonstration of the use of the safety device that was provided to participants.14 In addition, participants self selected into the program and therefore, may have been motivated to change their storage behaviors. The program evaluated by Horn was unique because in addition to including an educational message and providing safety devices, the intervention took place in the homes of participants, focus groups were utilized to identify gun owners’ attitudes and preferences, and the outcome was measured via an unannounced home visit to assess safety device usage.15 These unique aspects may have influenced the finding that 78% of participants were using the gun safe at follow up.

Limitations

There were six safe storage promotion programs identified during the internet search that have not been evaluated or are in the process of being evaluated. For example, the National Shooting Sports Foundation’s “Project HomeSafe” has distributed over 400 000 free gun locks in recent years,21 but an evaluation of the program has not been completed (personal communication, Dee Dee Sarff, 7 June 2001). Similarly, the US Department of Justice, the Ad Council and the National Crime Prevention Council’s “Unload and Lock” nationwide, multimedia public service advertising campaign has no plans for program evaluation.22 Additionally, the Harborview Injury Prevention and Research Center in Seattle, Washington is conducting a case-control study of a safe gun storage campaign promoting the sale and use of handgun lock boxes.23 Evaluation of the program via random digit dial telephone survey is currently being conducted (personal communication, LuAnn D’Ambrosio, 16 May 2001). These programs may show some effectiveness in changing firearm storage behaviors, but without completed evaluations we have no information about the degree to which they are worthwhile. Additionally, among those safe firearm storage promotion programs that have been evaluated, many are not available in the peer reviewed academic literature, making it difficult to identify and include them in this review. Therefore, we would like to call for increased evaluation, better evaluation, and greater visibility of completed evaluations for safe firearm storage promotion programs. This will aid greatly in planning and designing future programs.

Recommendations for future research

While some of the studies reviewed here offer some evidence that safe firearm storage promotion programs are effective in improving storage practices, improved methodologies for future interventions will lead to clearer answers. Following is a list of potential improvements:

  • Use of control groups to account for such things as the effect of self selection or phenomenon that may occur during the study period.

  • Measure outcomes such as injury incidence as well as behavior.

  • Measure outcomes objectively when possible.

  • Use statistical tests to compare changes in pre-tests and post-tests.

Additionally, program designers need to build evaluations into their program plans and completed programs should consider conducting evaluations, especially where large scale gun lock distributions have taken place. However, there are still some unresolved issues to consider in designing safe firearm storage promotion programs and these should be considered in future research. Issues of particular importance for firearm safety counseling are the content and delivery of the safety message: what messages are most effective, what should be said, who should deliver the message, how it should be delivered, and who is the best person to receive the safety message. In addition, many programs distributed safety devices that have not been formally tested. Program planners should consider that there have been no published evaluations of gun and trigger locks, which vary considerably in quality; indeed some locks have been recalled due to malfunction. Furthermore, thought should be given to the fact that some safety devices, such as lock boxes or gun safes, are preferred and may prompt safer storage practices. Finally, there are several studies that show that gun owners who have received firearm safety training are either more likely24,25 or neither more nor less likely26,27 to store their firearms loaded and unlocked. These findings are relevant in designing and evaluating educational approaches to safe firearm storage.

Key points

  • Firearm related injuries are a serious problem in the US.

  • US youth having access to firearms in their homes likely contributes to the firearm injury problem.

  • Reducing youth access to firearms through certain storage practices is an important strategy for injury prevention.

  • The degree to which safe firearm storage promotion programs are successful is unclear.

  • This review of safe firearm storage promotion programs suggests that there is little evidence that these programs are effective at eliciting improved firearm storage behaviors.

  • Improved methodologies for future interventions are needed and will lead to clearer answers about what prompts gun owners to securely store their firearms.

CONCLUSIONS

Based on the findings in this review we are at the early stages of understanding what types of interventions, or which components of interventions, prompt gun owners to securely store their firearms. Improved understanding of attitudes, beliefs, gun storage behaviors, improved study design and consideration of evaluation methods in program planning will aid further understanding of this important issue.

Acknowledgments

We thank Carol Runyan and Carolyn Halpern for their comments on early drafts of this paper.

REFERENCES

View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.