Objective: The purpose of this study was to assess the range of information relevant to bicyclist injury research that is available on routinely completed emergency department medical records.
Methods: A retrospective chart review of emergency department medical records was conducted on children who were injured as bicyclists and treated at an urban level I pediatric trauma center. A range of variables relevant to bicyclist injury research and prevention was developed and organized according to the Haddon matrix. Routinely completed free text emergency department medical records were assessed for the presence of each of the targeted elements. In addition, medical records of seriously injured patients (for whom a more structured medical record is routinely used) were compared to free form records of less seriously injured patients to identify differences in documentation that may be related to the structure of the medical record.
Results: Information related to previous medical history (96% of records), diagnosis (89%), documentation of pre-hospital care (82%), and child traumatic contact points (81%) were documented in the majority of medical records. Information relevant to prevention efforts was less commonly documented: identification of motor vehicle/object involved in crash (58%), the precipitating event (24%), the location of the crash (23%), and documentation of helmet use (23%). Records of seriously injured patients demonstrated significantly higher documentation rates for pre-hospital care and child traumatic contact points, and significantly lower documentation rates for previous medical history, child kinematics, main body parts impacted, and location of injury event.
Conclusions: Routinely completed free text emergency department medical records contain limited information that could be used by injury researchers in effective surveillance. In particular information relating to the circumstances of the crash event that might be used to design or target prevention efforts is typically lacking. Routine use of more structured medical records has the potential to improve documentation of key information.
Statistics from Altmetric.com
Bicyclist injury remains one of the leading causes of death and acquired disability for children in the United States.1 In 1998, nearly 362 000 child bicyclists sought care for injuries in emergency departments in the United States.2 Effective sources of surveillance data on bicyclist injuries are not easily available. Police accident reports and hospital trauma registries are often used to track injury trends, but many bicyclist injuries are not reported to police,3 and the minority of children treated in the emergency department for bicycle related injuries are admitted to the hospital.3 The emergency department has been identified as a crucial site for identifying new and emerging trends in injury4 and has long been a source for injury surveillance for the United States Consumer Product Safety Commission (CPSC).5 Therefore, the emergency department medical record is a potentially ideal source for surveillance information on bicyclist, as well as other types of injuries.
Advisory groups from the National Center for Injury Prevention and Control and the American Academy of Pediatrics have called for the prospective, standardized collection of key clinical data elements for patients in the emergency department.5,6 Government agencies, such as the Centers for Disease Control and Prevention, have recognized the importance of emergency department surveillance of traumatic injuries and have published recommendations for data elements to be obtained on emergency department patients for these conditions.7 As more programs are utilizing information from the emergency department medical record to design and evaluate injury prevention programs,8 it is important to assess the information present in routinely completed emergency department medical records. The purpose of this study was to assess the range of information potentially relevant to the prevention of bicyclist injuries that is routinely documented on a free text emergency department medical record. In addition, we sought to explore potential benefits associated with the use of a more structured medical record by determining differences in patterns of documentation between free text and structured medical records.
Experts in medicine, engineering, crash investigation, injury surveillance, and epidemiology generated a comprehensive listing of 31 data elements relevant to bicyclist injury research and prevention that could likely be reported by history. This expert group, which included the authors and experts from the United States CPSC, used the Haddon matrix9 to categorize the various elements identified. The Haddon matrix is a public health tool designed for the development of injury countermeasures and includes nine cells that divide the time sequence of an event into three stages (pre-event, event, and post-event) and the principal factors of the injury into three components (the agent of injury, the person, and the environment). The 31 elements identified were categorized into the nine Haddon matrix cells as demonstrated in table 1.
A retrospective chart review was conducted on emergency department records of children ages 5–18 years who sought care for bicycle related injuries in the emergency department of an urban level one pediatric trauma center between March 1995 and July 1998. This center serves as the primary source of emergency medical care for children of west and southwest Philadelphia, a predominantly poor, minority population. In addition, it is a major referral center for children from southeastern Pennsylvania and southern New Jersey. Cases were identified through an existing emergency department based injury surveillance system that utilized surveys of pre-hospital care providers and children to obtain information regarding the circumstances of injury.10 Participants were enrolled in accordance with a study protocol approved by the Institutional Review Board of the hospital.
Components of the emergency department based medical record that were reviewed included all physician and nursing notes, triage sheets, and, if applicable to the case, semistructured trauma team evaluations and inter-hospital transport team records. The semistructured evaluation forms include prompts for information such as previous medical history, pre-hospital care information, mechanism of injury, and exact location of injury. For each emergency department medical record, the documentation was reviewed for information on the 31 elements and the presence or absence of each element was determined. In order to ensure consistency in determining the documentation of elements, one clinician/researcher (AD) abstracted all of the records. Another researcher with experience in medical record coding (EM) independently reviewed 20% of the records in order to ensure the reliability of data abstraction.
The proportion (with 95% confidence intervals) of medical records that had documented information was determined for each of the 31 data elements. Analyses were conducted on an individual element level and as grouped in each of the cells of the Haddon matrix. A consecutive sample of at least 260 cases was necessary to estimate 95% confidence intervals of ± 3% to 6% on point estimates of data completion ranging from 10%–50%.
In addition, medical records of seriously injured children for whom the trauma team was alerted (“trauma-stat”) were compared to records of children who were not trauma-stat patients. Differences in documentation patterns were assessed using the χ2 or exact test as indicated.
Altogether 278 cases of injured child bicyclists were identified from March 1995 to July 1998. The study sample was identified from a cohort of injured pediatric bicyclists who were 74% male and 74% African-American. The study sample included a range of injury severity with over 25% of children having sustained clinically significant injuries (maximum abbreviated injury scale score ≥2) and 29% were admitted to the hospital from the emergency department. A total of 268 of 278 records assessed had all components of the emergency department medical record [triage sheet, nurse notes, physician notes, trauma evaluation sheets (for trauma-stat patients only), and interhospital transfer records (if child was transferred from another hospital)] available for review. The assessment of inter-rater reliability of the medical record abstraction revealed excellent overall agreement (88% agreement, κ= 0.71, p<0.0001). The majority of 31 elements (96%) had >80% agreement as to whether the element was documented or not. Only 24 of the 31 categories had sufficient variability to calculate the κ statistic. Of those elements with sufficient variability, 63% had a κ indicating moderate or better agreement (κ≥0.4). All of those elements with κ<0.4, however did have >80% agreement.
Element level analysis
The proportion of medical records containing each of the 31 targeted data elements is presented in table 2. Elements most commonly documented (present in over 80% of records) included: previous medical history, diagnosis, indication as to whether pre-hospital care was given, and child traumatic contact points (documentation of minor injuries—for example, an abdominal wall contusion, that may provide insight into the mechanism of more serious injuries—for example, a handlebar related liver laceration). Of note, several elements that would be considered central to effective injury surveillance were not routinely documented. These included identification of motor vehicle/object involved in crash (58%), the precipitating event (24%), the location of the crash (23%), and documentation of helmet use (23%). Several of the elements were not present in any records at all (risk taking behavior of child, conspicuity of child, conspicuity of bike, fit of bike for child, condition of the road, and surface the child landed on after the crash).
Haddon cell groupings
Table 3 further presents the per cent completion rates of data elements grouped by Haddon matrix cell. Overall, the Haddon matrix cells with the highest completion rates were the post-event/child information (56%) and the post-event/environmental information (54%). Pre-event/child information was present 22% of the time. Cells pertaining to bicycle characteristics were not well documented (≤3%) in any time phase of the matrix.
Records of trauma-stat patients (n= 41) demonstrated significantly better (p<0.05) completion rates for documentation of pre-hospital care, description of pre-hospital care and child traumatic contact points. Records of trauma-stat patients demonstrated significantly worse (p<0.05) completion rates for documentation of previous medical history, child kinematics, main body parts impacted, and exact address of the incident (table 4). All other data elements had similar documentation rates between the trauma-stat and non-trauma-stat groups.
While the emergency department is uniquely positioned as a source of injury surveillance data, this study demonstrated that medical records routinely completed during the care of children after bicyclist trauma frequently lacked information that is important to injury surveillance and prevention efforts. Because the primary purpose of the medical record is to document care of the patient, documentation of more medically relevant information was generally better than documentation of information regarding the location and circumstances of the event.
Previous emergency department based injury surveillance systems have relied on questionnaires or surveys in addition to the medical record to gather this type of data. However, these systems have been plagued by low inclusion rates, staff objections to increased workload, and bias in inclusion rates based on injury severity.11,12 These limitations commonly lead to a lack of sustainability in these surveillance systems.13 Use of the medical record as the primary source of surveillance data collection would alleviate many of these limitations and more effectively integrate data collection into the routine workings of the ED.
The documentation of selected trauma history elements improved with the use of the semistructured trauma flow sheet. One hypothesized reason for the increased frequency of some elements is that there are prompts posed on these semistructured forms that probe physicians and nurses to include this information on the record. For example, items such as motor vehicle involvement, bicycle helmet use, pre-hospital care, and child traumatic contact points are prompted for in the “trauma-stat” flow sheet. A previous study has shown formatted histories for emergency department visits were associated with higher physician satisfaction with the documentation process.14 A similar study of ambulatory care providers found that the structured medical record form improved provider performance and recording of the process of care.15 The decreased documentation of other elements may be inherent to the trauma-stat patient population. Often, parents of these more seriously injured children are not immediately available to provide a previous medical history or exact address of the incident. This possibility points to the need to link emergency department records of seriously injured children to inpatient medical data or trauma registries to complete the picture of the incident.
The data for this study were gathered by retrospective chart review, which limits our conclusions to the availability of written documentation. We do not know if a physician or nurse asked for the information but did not document it on the medical chart. However, injury surveillance and research is often done from chart abstraction and therefore any information asked but not documented is realistically inaccessible.
Previous research has demonstrated that injury circumstance information can be collected in an emergency department if its importance is highlighted. The Canadian Hospitals Injury Reporting and Prevention Program (CHIRPP) was developed as a national injury surveillance system in order to assist in the identification of emerging hazards as well as provide information that is useful in developing injury prevention programs. Emergency department staff use specialized data collection forms to obtain information about the injury event. The emergency department medical record is also used to provide information for the surveillance system. Studies have used these data to identify injury risks and the data have also been used to assist in the development of prevention programs.16
Injury information collected in the emergency department is important not only to identify injury trends and hazards but also for designing and evaluating injury prevention programs. Information about the location of the crash, for example, could help community program developers to appropriately target injury prevention programs. In order to develop programs and evaluate their effectiveness in the community, a sustainable and reproducible system of routinely collected and standardized data on injury circumstances and modifiable factors leading to injury must be created. The use of a semistructured emergency department record could provide this important injury surveillance information for patients with a range of injuries from the most severe trauma patients to the patients with minor injuries. Information on the entire spectrum of injury would be valuable to learn more regarding how the circumstances of an injury event impact the resulting severity of the injury.
The emergency department has been identified as an important site for injury surveillance.
The emergency department medical record serves as a source of injury surveillance information for the United States CPSC National Electronic Injury Surveillance System.
Current emergency department medical record documentation is insufficient to provide non-medical bicyclist injury surveillance data.
Structured medical records encourage documentation and their expanded use should be explored in order to improve the quality of emergency department injury surveillance data.
Future work should compare documentation on a semistructured emergency department medical record with a free form emergency department medical record on the entire spectrum of emergency department treated injuries in order to determine the ability of the medical record to serve the dual purpose of documentation of clinical care and collection of injury surveillance data. In addition, future studies should assess the collection of data relevant to other types of injury and in other hospitals, both trauma and non-trauma centers.
The authors would like to acknowledge and thank Allyson Kreshak and Douglas Holt for their work on the Injury Circumstance Evaluation study. We would like to thank The Children's Hospital of Philadelphia Emergency Department and TraumaLink: The Interdisciplinary Pediatric Injury Control Research Center for their support of this work. In addition, we would like to thank the Consumer Product Safety Commission personnel who assisted with creating the ideal trauma history.
This work was funded by in part by the Agency for Healthcare Research and Quality (formerly known as Agency for Healthcare Policy and Research) Grant number 5 U01 HD32828 as part of the Emergency Medical Services for Children Program and the Robert Wood Johnson Foundation as part of the Injury Free Coalition for Kids.
Portions of the paper were presented during a poster presentation at the American Academy of Pediatrics annual meeting in October 2000 in Chicago, IL.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.