Article Text

PDF

Effect of recall on estimation of non-fatal injury rates: a community based study in Tanzania
  1. C Moshiro1,2,
  2. I Heuch3,
  3. A N Åstrøm1,
  4. P Setel4,
  5. G Kvåle1
  1. 1Centre for International Health, University of Bergen, Norway
  2. 2Muhimbili University College of Health Sciences, Dar es Salaam, Tanzania
  3. 3Department of Mathematics, University of Bergen, Norway
  4. 4Adult Morbidity and Mortality Project, Tanzanian Ministry of Health and University of Newcastle upon Tyne, UK (at time of research); MEASURE Evaluation, Carolina Population Center, University of North Carolina at Chapel Hill (present)
  1. Correspondence to:
 Ms Candida Moshiro
 Centre for International Health, University of Bergen, Armauer Hansen Building, N-5021 Bergen, Norway; candida.moshirostudent.uib.no

Abstract

Study objective: To investigate the effect of recall on estimation of non-fatal injury rates in Tanzania.

Design: Retrospective population based survey.

Setting: Eight branches in an urban area and six villages in a relatively prosperous rural area in Tanzania.

Subjects: Individuals of all ages living in households selected by cluster sampling.

Main outcome measures: Estimated non-fatal injury rates calculated at each of the 12 recall periods (one to 12 months before the interview).

Results: Out of a population of 15 223 persons, 509 individuals reported 516 injuries during the preceding year. Of these 313 (61.5%) were males and 196 (38.5%) females. The data showed notable declining incidence rates from 72 per 1000 person-years when based on a one month recall period to 32.7 per 1000 person-years for a 12 month recall period (55% decline). The decline was found for injuries resulting in fewer than 30 days of disability whereas rates for severe injuries (disability of 30 days or more) did not show a consistent variation with recall period. Decline in injury rates by recall period was higher in rural than in urban areas. Age, sex, and education did not notably affect recall.

Conclusions: Longer recall periods underestimate injury rates compared with shorter recall periods. For severe injuries, a recall period of up to 12 months does not affect the rate estimates. It is essential that a recall period of less than three months be used to calculate injury rates for less severe injuries.

  • recall
  • under-reporting
  • developing country
  • Tanzania

Statistics from Altmetric.com

Injuries are becoming a major cause of mortality and morbidity in less developed countries. The relative contribution of injuries to disability adjusted life years is expected to rise from 15% in 1990 to 20% in 2020 with the largest increase expected to occur in sub-Saharan Africa.1 Most studies on the incidence of injuries are based on health facility data. Self reported data obtained through community based surveys play an important part in the study of injury morbidity in less developed countries due to incompleteness and low utilisation of health facilities.2–4 However, one major limitation of such studies is recall bias.

A number of studies have investigated the effect of recall period on the estimates of injury rates for non-occupational5–9 and occupational injuries.10,11 A study in the United States examined the effect of recall in estimating injury rates among children and adolescents with a reference period of 12 months.6 The largest declines in injury rates were observed for the 0–4 year old children and for minor injuries. Similarly, Mock et al investigated the effect of recall bias on annual injury rates in a household survey in Ghana.7 They found a remarkable decline in injury rates from a one month recall to a 12 month recall, which was influenced by severity of injury but not by age, gender, and locality. A population based study in Brazil compared retrospective and prospective data collection methods among preschool children. Use of diaries prospectively resulted in five times as many injuries reported than the recall method, particularly for injuries not requiring medical care.9 In the United States, injury rates for farmers were compared using two months’, 12 months’, and 10 years’ recall. The results showed that a recall period of more than two months was likely to underestimate injury rates.12 Most of the studies on effect of recall on injury rates have been conducted in developed countries. A review of literature produced only one study from sub-Saharan Africa on time effects in recall of injuries.7

In this paper, we investigate the effect of recall on estimates of annual injury rates as an initial step in analysing data from a survey that measured injury morbidity in an urban and a rural location of Tanzania. The effects of recall are also examined for various subpopulations and by severity of injury.

METHODS

Study site

A community based survey was conducted within the Adult Morbidity and Mortality Project (AMMP) study areas in the United Republic of Tanzania. AMMP is a health and demographic surveillance system operating in six districts of Tanzania. Its aim is to measure rates and causes of morbidity and mortality.4 Since 1992, the areas are prospectively monitored through repeated censuses to ascertain the population at risk. Deaths are recorded through an active reporting system and cause of death is determined by verbal autopsy.4,13 The survey on injuries was conducted in Dar es Salaam city (an urban area) and Hai District (a rural area).

Dar es Salaam city lies on the east coast of Tanzania. The AMMP demographic surveillance population is situated in two of the three municipalities covering three areas: Ilala, Keko, and Mtoni. The three areas contain eight branches including approximately 63 330 persons in 15 269 households living in urban and periurban areas of the city. Hai District lies on the south western slopes of Mount Kilimanjaro in northern Tanzania. The AMMP demographic surveillance area in Hai covers 51 out of 61 villages in the district and around 62% of the total district population (159 906 persons in 40 238 households). Agriculture, livestock keeping, and commercial mining are the main economic activities. Details of the study population have been described elsewhere.4,13,14

Sampling procedure and participation rates

Urban area

A cluster sample of 2000 households was drawn from eight branches of the urban area. Information was sought on all individuals residing in the households. In total, 9200 individuals were eligible for study of whom 8188 (89.0%) participated in the survey. The reasons for non-participation were: not found at home 191 (2.1%), travelled 231 (2.5%), moved 497 (5.4%), house could not be traced 76 (0.8%), and died 13 (0.1%). Only four individuals refused to participate. No marked differences were found in demographic characteristics between those who participated and those who did not, except for slight differences in the age distribution in which participants were more likely to be aged between 5 and 14 years.

Rural area

A two stage cluster sampling method was adopted in selecting the study sample. In the first stage, six out of 51 villages were selected to represent different levels of socioeconomic status and injury mortality. Information on socioeconomic status and injury mortality for the villages was extracted from existing AMMP data. A random selection of 2000 households was drawn from all households of the selected villages in the second stage. The resulting sampling fraction was approximately the same for the six villages. All individuals in the selected households were included in the survey. In total, 7655 individuals constituted the sample. Of these, 7035 (91.9%) participated in the survey. Reasons for non-response were: not found at home, 27 (0.4%); moved, 119 (1.6%); house could not be traced, six (0.1%); died, 26 (0.3%); and for 442 (5.8%) individuals, their households were not covered. Comparison of demographic characteristics between respondents and non-respondents revealed no noticeable differences.

Ethical clearance and informed consent

Ethical clearance for this study was given by the Tanzania Commission for Science and Technology and the Regional Committee for Medical Research Ethics in Norway. During fieldwork, interviewers explained the aims of the study and sought informed verbal consent from each family to be included. For children below age 15, parents or guardians were interviewed; for adolescents aged 15–18, consent was obtained from both the parent and the child.

Operational definitions

Injury

An injury was included in this study if it had occurred in the past one year and resulted in losing one or more days of “normal” activity—for example, not being able to work or go to school.

Severity of injury

The number of days with restricted activity or disability days was considered as a measure of severity of injury. In this paper, we have used the groups <30 disability days and ⩾30 days to represent minor and severe injuries respectively.

Data collection

The survey tool was translated into Swahili (the local language), back translated into English, and pre-tested for comprehension before use in the field. Data collection took place from September to December 2002. Two questionnaires were used in the study. Questionnaire 1 recorded information on whether an individual had an injury during the past one year. A list of injuries (broken bones, cuts or sprains, burns, dental, or other injuries) or injury events (transport accidents, falls, sports activities, snake or other animal bite, electric current, near drowning, struck by object, attempted suicide, or other injuries) was read out to the respondents. The head of household was interviewed to elicit information about the household members. When the head of household was not available, the spouse or any other responsible person was taken as an interviewee.

Questionnaire 2 was used to record information concerning the description of the injury, the circumstances in which the injury occurred, and whether the injury was intended or not. Variables included were month and year, cause of the injury, place of occurrence, length of disability, and health facility use. Efforts were made to interview the injured person if an adult, otherwise we interviewed an informed member of the injured person’s household.

Data analysis

Using the date in which the interview and injury took place, the time interval since the injury occurred was calculated in months. Since only the month and year were reported for the injury, the timing of the injury was assumed to be at the midpoint of the reported month. The calculated recall intervals range from one to 12 months. Injuries reported during the calendar month in which the interview took place were assigned an interval of 0 months. Assuming the interviews and injuries occurred at the midpoint of the month, then the intervals one to 12 cover an average period of one month whereas the interval 0 covers a period of two weeks. The intervals 0 and 1 were combined, resulting in a mean period of 1.5 months.

Going back in time, the estimated injury incidence rates were calculated for each recall month as the number of injuries reported for that recall period divided by the number of person-years. The person-years were calculated successively for more distant recall periods by multiplying the population at risk at each recall interval with a relevant proportion of a year. There were few individuals who had more than one injury episode in the preceding year. In such cases, only the most recent injury was included in the analysis.

Statistical analyses were performed using STATA (version 7, Stata Corporation, College Station, TX, USA). Incidence rates and their 95% confidence intervals were calculated assuming a Poisson sampling distribution. To assess the change in incidence rates by recall period, we used a Poisson regression model.15 Since the relationship between recall period and the estimated incidence rates was not linear, recall period was included in the model as a categorical variable with four categories; first recall month, second recall month, from three to seven months’ recall, and from eight to 12 months’ recall. Interactions between the effect of recall period and demographic characteristics such as area, education, age, and sex were examined to determine whether change in injury rates with recall period varied between the subpopulations. A separate analysis was carried out taking into account the clustered nature of the data in the analysis. However, the standard errors did not change very much, so we report results that did not include adjustments for clustering.

RESULTS

A total of 509 injuries occurred to 15 223 people during the year preceding the interview. Of these, 62% were to males, 40% to people from the urban area, and 64% were to individuals below 35 years of age.

Overall annual injury incidence was 72.0 per 1000 person-years for a one month recall period and 32.7 person-years using a one year recall period. Table 1 shows that for a one month recall period, the rates were significantly higher in the rural compared to urban area (p<0.001) and twice as high in males as in females (p<0.001). The estimated rates were highest among those aged above 59 years and also highest among those who had primary education only. Figure 1 shows the overall estimated annual injury incidence rates by recall period. The largest difference was observed between the first and second recall month, where it dropped from 72 per 1000 person-years to 46 per 1000 person-years respectively.

Table 1

 Annual non-fatal injury rates per 1000 person-years at different recall periods by demographic characteristics

Figure 1

 Overall annual injury rates per 1000 person-years by severity of injury and recall period (n = 15 223).

Injury rates decreased more rapidly with a longer recall period in the rural than in urban area (p = 0.01; table 1). In trying to explain the differences in recall patterns for the urban and rural area, we analysed the declines within the urban area by comparing the urban and periurban areas. The decline in injury rates for the urban and periurban areas was similar (p = 0.44). Injury rates were higher in males than in females across recall periods. However, the drop in injury rates with increasing recall period did not differ significantly in males and females (p = 0.25). Similar results were observed after adjusting for urban or rural residence.

Injury rates among different age groups varied across the four recall periods and they all tended to decrease with recall period (table 1). The tendency to decrease did not differ significantly between the age groups (p = 0.79), even after adjusting for urban or rural residence. Although the difference in reported injury rates in recall period 1 compared with period eight to 12 months was higher among those with primary education, the tendency of the rates to decrease was not significantly different between the education categories after allowing for locality (p = 0.85).

Injury rates by recall period for minor and severe injuries are shown in fig 1. The decline was seen to be stronger in minor injuries whereas for severe injuries there was no consistent pattern in injury rates for the different recall periods (p<0.001 for differences in rates of decline). For minor injuries resulting in fewer than 30 days of disability or restricted activity, the estimated annual injury rates declined by 81% from a one month to a eight to 12 month recall period. Variations in estimated rates by location for minor and severe injuries are indicated in table 2. The decline of minor injury rates from the one month to the eight to 12 month recall period was 84% and 75% for the rural and urban area respectively (p = 0.21).

Table 2

 Annual injury rates per 1000 person-years by recall period and severity of injury (n = 15 223)

DISCUSSION

In this study, estimated annual injury rates varied with recall period, with shorter periods giving higher estimated rates than longer periods. This decline was observed for minor injuries only whereas no consistent decline was seen for severe injuries. This has great implications when estimating the magnitude of non-fatal injuries in a population.

Studies using interviewing techniques to ascertain injuries retrospectively through self or proxy report may be subject to recall bias.6,16 In surveys, there are two types of memory errors: loss of memory, that is failing to recall and therefore under-reporting events; and telescoping, the tendency to recall events as having occurred more recently than they actually did.6,7,16 In our study, there was an increase in estimated rates in the 12th month of recall in comparison with the 10th or 11th month of recall. Possibly events that happened more than a year ago were being reported as occurring a year ago. However, the interviewers noted that the list of injuries and injury events was effective in aiding recall. Severe injuries will be under-represented in the first recall period, since reporting of injuries with disability duration of more than 30 days will be incomplete. This may explain the dip observed in the severe injury rate in the first recall period.

It is clear that sensitive events such as domestic violence, rape, or attempted suicide would be under-reported in such a study because of social stigma or fear of criminal implications. In many instances, an individual would be reporting for the other members of the household. There is a possibility that the respondent would not be aware of all the injury incidents for the other members or would not report them accurately. In our study, information on type of respondent was not recorded from the whole study sample and therefore we could not assess the extent of memory decay by type of respondent.

Despite the limitations, our study still sheds some light on recall patterns of non-fatal injuries in a developing country. The overall estimated injury incidence was 72 and 32.7 per 1000 person-years for a one month and a 12 month recall period respectively, representing a decline of 55%, with the largest decrease being between the first and second month. Our findings differ from those reported from Ghana,7 where the rate of decline was 72%. However, it is not quite clear how the problem with injuries in the first recall month was handled in the study in Ghana. The 55% decline from our study is slightly higher than the 40% decline reported from the United States.6 As Mock and colleagues indicated,7 it might be assumed that there was greater memory decay in the African data due to a lower level of formal education. However, we found a similar decline in estimated annual injury rates among those with and without formal education.

Comparisons with other studies are difficult due to differences in injury definition and classification of injury severity. The Tanzania Household Budget Survey of 2000/2001 conducted on a national representative sample of 22 584 households recorded information on illness or injury in the four weeks before the interview.17 Among children aged less than 15 years and adults aged 15 years and above, 2.5% and 5% respectively reported to have been injured. This is quite high compared with our finding of about 1% in the above age groups. Although the former survey included all injuries irrespective of whether they were serious or not, our findings are probably an underestimate of the actual burden. In this study, the definition of injury did not refer to medical treatment since access to care is limited in developing countries. Comparison with other studies needs to be done with caution.

As expected, long recall periods were more likely to affect minor injuries than severe injuries. The most significant determinant of memory decay reported in other studies was the severity of the injury,5–8,11 although the various studies used different ways of classifying injury severity. From our study, the decline in estimated injury rates was significantly different for the rural and urban area, with those residing in the rural area having a greater tendency of memory decay. However, within the urban area, there were no differences in decline between the urban and periurban parts of the city. It is thus possible that basic cultural differences between population groups may account for the urban-rural contrast in memory decay. Although the decline in injury rates was higher in the rural area for transport injuries and cuts, this did not explain the overall urban-rural differences. Our finding contrasts with results from Ghana where they found no difference in recall by urban-rural residence.7

Key points

  • Long recall periods were more likely to affect non-severe injuries.

  • Memory decay is not influenced by age, gender, and education.

  • Recall of injury events is poor among people living in rural area.

  • Short recall period is useful for estimating annual incidence rates for non-fatal injuries.

We found a 57% decline in estimated rates for children aged 0–4 years, with no notable differences in the decline of the rates in the other age groups. This is contrary to findings from other studies. In the American study, the decline in injury rates for children aged <5 years was 70% whereas for adolescents aged 14–17 years it was 41%.6 In Ghana, although memory decay was highest for children aged <5 years and aged 10–14 years (75% decline), there were no marked differences between all age groups.7

Several studies have recommended using a one to three month recall period to minimise recall bias.6–8 However, such a short recall period requires having large sample sizes to ensure accurate estimates. In developing countries, surveys are useful for estimating both severe and non-severe injuries since health service data are usually incomplete. Although long recall periods underestimate injury rates especially for minor injuries, they can also be useful in investigating associations between injuries and different risk factors.10 For this particular purpose, it can be concluded that a one year recall period may be appropriate for assessing associations with both minor and severe injuries. However, for reliable estimation of the actual magnitude of non-fatal injury rates, a shorter recall period should be considered.

Acknowledgments

The first author is supported by the Norwegian State Educational Loan fund. This work was partly funded by the Norwegian Research Council. The efforts of our research assistants are acknowledged and appreciated. The study was done at Centre for International Health in University of Bergen in collaboration with the Adult Morbidity and Mortality Project (AMMP). AMMP is a project of the Tanzanian Ministry of Health, funded by the UK Department for International Development (DFID), and implemented in partnership with the University of Newcastle upon Tyne (UK). This publication is, in part, an output of AMMP; the views expressed are not necessarily those of DFID. David Whiting, Yusuf Hemed, Robert Mswia, and Gregory Kabadi were especially helpful in conducting the study in Tanzania. Finally, we thank all of the respondents from AMMP areas in Hai and Dar es Salaam, who have been participating in demographic surveillance since 1992.

REFERENCES

View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.