Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 13, Number 2—February 2007
Research

Code-based Syndromic Surveillance for Influenzalike Illness by International Classification of Diseases, Ninth Revision

On This Page
Methods
Results
Discussion
Cite This Article
Figures
Figure 1
Figure 2
Figure 3
Figure 4
Tables
Table 1
Table 2
Table 3
Table 4
Table 5
Downloads
Article
RIS [TXT - 2 KB]
Article Metrics
Metric Details
117
citations of this article
EID Journal Metrics on Scopus
Related Articles
Influenza A(H5N1) Virus in Traveler
Evidence of H5N1 Influenza Spillover Infections in Horses, Mongolia
Review of AIV Infection during Pregnancy
More articles on Influenza
Author affiliations: *Walter Reed Army Institute of Research, Silver Spring, Maryland, USA; †Air Force Institute for Operational Health, Brooks City Base, Texas, USA;

Cite This Article

Abstract

With the spread of avian influenza, use of automated data streams to rapidly detect and track human influenza cases has increased. We performed correlation analyses to determine whether International Classification of Diseases, Ninth Revision (ICD-9), groupings used to detect influenzalike illness (ILI) within an automated syndromic system correlate with respiratory virus laboratory test results in the same population (r = 0.71 or 0.86, depending on group). We used temporal and signal-to-noise analysis to identify 2 subsets of ICD-9 codes that most accurately represent ILI trends, compared nationwide sentinel ILI surveillance data from the Centers for Disease Control and Prevention with the automated data (r = 0.97), and found the most sensitive set of ICD-9 codes for respiratory illness surveillance. Our results demonstrate a method for selecting the best group of ICD-9 codes to assist system developers and health officials who are interpreting similar data for daily public health activities.

Inevitable annual cycles of influenza and other respiratory pathogens pose a significant threat to work and productivity (1–3). Epidemics can have dramatic economic and medical ramifications, such as the influenza pandemic of 1918 (4,5). During the last few years we have witnessed the emergence of severe acute respiratory syndrome (SARS) and new pathogenic avian influenza strains. These events have brought respiratory illnesses to the attention of the general public; most recently, the highly publicized potential for pandemic influenza due to recombinant influenza strains has generated tremendous public anxiety. Moreover, lingering fears about influenzalike illness (ILI) symptoms related to bioterrorism have further accentuated the need for improved early detection of respiratory disease outbreaks.

This atmosphere of concern motivated an intense effort to develop new surveillance methods (6). Public health officials are now augmenting traditional disease surveillance, e.g., laboratory-based methods, with nontraditional analysis of electronic medical records for more timely monitoring of infectious disease patterns. The Centers for Disease Control and Prevention (CDC), along with many health departments, universities, and government organizations, has participated in research and development of syndromic surveillance systems. Some of these systems have been designed for local surveillance in a single metropolitan area, while others cover broad geographic areas, including multiple jurisdictions (7,8).

Since 2001, the Department of Defense (DOD) has been using the Electronic Surveillance System for the Early Notification of Community-based Epidemics (ESSENCE) for syndromic surveillance of active duty military and their beneficiaries (9,10). This system captures patient ambulatory data coded according to the International Classification of Diseases, Ninth Revision (ICD-9), from all permanent military treatment facilities (MTFs) that treat active duty personnel, retirees, and their family members worldwide. It provides a large amount of data for surveillance, with >300,000 average weekly outpatient visits to primary care and emergency facilities for any reason. The system automatically performs daily analysis of visits classified in each of 8 syndrome groups, such as respiratory and gastrointestinal illnesses and fever.

Military basic training sites have historically experienced frequent respiratory epidemics among troops in crowded housing (11–14), and active surveillance for ILI is conducted year-round. To improve early detection of such epidemics and in response to pandemic and bioterrorism concerns, an automated ILI surveillance report was also incorporated into ESSENCE in 2002 (9).

Critics of syndromic surveillance have voiced apprehension about the use of nontraditional data and the ability of these systems to detect outbreaks (15–17). Skepticism about ICD-9 data in particular revolves around whether data coded at the time of visit accurately reflects true illness, given the potential for coding of nonspecific symptoms and unconfirmed diagnoses and for provider or coder variations in code selection (18). We sought to evaluate the effectiveness of using ESSENCE as an early detection system for ILI and to determine the most parsimonious set of ICD-9 codes to use for ILI surveillance. We compared the ICD-9–based ILI data in ESSENCE to data from the laboratory-based DOD Global Influenza Surveillance Program and the sentinel reports from CDC’s US Influenza Sentinel Providers Surveillance Network. We compared diagnostic codes from ESSENCE both individually and as a group to the volume of positive respiratory specimens and weekly sentinel reports. Through trend, correlation, and signal-to-noise analysis, we identified a subset of diagnostic codes that best corresponds with influenza patterns.

Methods

ESSENCE Data Collection

ESSENCE captures outpatient visit data recorded as ICD-9 codes at or shortly after the patient encounter (10). A central, secure-link electronic database allows for daily submission of data, although reporting time from the MTFs averages from 1 to 4 days. Data entry practices vary by location, but each MTF is set up to batch-send data to the central database on a daily basis; in most locations, 80% of all ICD-9 codes are received within 4 days. The ESSENCE server collects de-identified data from the central database every 8 hours; at each time of collection, ESSENCE is refreshed with newly submitted data from MTFs. With each cycle, data are grouped by ICD-9 codes, recounted, and republished into syndromes, including ILI. Most syndromes are published as daily counts, but the ILI syndrome is grouped as weekly data. The published data for the ILI syndrome is also updated and republished every 8 hours, but the initial publication of the weekly data does not occur until a full week (running Sunday to Saturday) is completed.

We created our original ILI syndrome group by reviewing the ICD-9 code and listing and choosing those that could represent potential ILI cases. According to this classification, visits are counted as ILI if their diagnostic code is either fever, an included acute respiratory code, or unspecified viral illness. The 29 codes in the original ILI group are listed in Table 1. Each week ESSENCE calculates the percentage of visits for ILI among the total number of outpatient primary care and emergency department visits.

Direct Comparison of Respiratory Specimens Matched to Outpatient Visits

The DOD Influenza Surveillance program, located at the Air Force Institute for Operational Health at Brooks Air Force City-Base, Texas, collects specimens and screens for a variety of viral respiratory pathogens, including influenza A and B, respiratory syncytial virus, adenovirus, and herpes simplex virus (19,20). All MTFs are encouraged to submit specimens on a year-round basis, but sentinel sites are specifically directed to submit 6–10 specimens per week during the official influenza season, week 40 in the first year through week 20 in the second year (generally October through early May). The program guidelines state that specimens should only be obtained from patients meeting a clinical case definition of ILI, which at the time of this study was a fever ≥100.5°F (38°C) and either a cough or sore throat (20).

We matched individual specimens with outpatient clinic visits that occurred within a 5-day range around the date of specimen collection by using a unique patient code that links the records but does not identify the patient. This analysis included encounters for active duty personnel, dependents, and retirees during the 2-year period of June 2002 to June 2004, but was limited to visits to US Air Force MTFs because we had the ability to link laboratory and outpatient encounter records at these locations. Specimens were first matched to a visit that occurred on the same day that the specimen was collected; those specimens that matched were excluded from subsequent match attempts. Remaining specimens were then sequentially matched to visits 1 day earlier, 1 day later, 2 days earlier, and 2 days later than the date listed as date collected. Upon each iteration of this process, specimens were excluded from the remaining potential match pool if successfully matched to a visit. The purpose of this window approach is to obtain as many matches as possible and allow for some discrepancy between the visit date and the date of collection.

For each encounter linked to a specimen, we selected a single ICD-9 code per individual specimen. Some specimens had more than 1 encounter on the day matched, so we used the following algorithm for selection of the ICD-9 code: if 1 of the ICD-9 codes present was from the ILI syndrome list, it was selected. In cases in which patients had multiple ILI diagnoses, the more specific (for influenza first and other diseases second) or severe code was used, e.g., if both pneumonia and throat pain were included, pneumonia was selected; if pneumonia and influenza with pneumonia were included, influenza with pneumonia was selected (Table 1). If no ILI codes were used for the visit, the code closest to an infectious respiratory diagnosis was used; we gave priority to infectious disease or respiratory codes first, to general symptoms second, to other diagnoses third, and “V codes” (supplementary classification of factors influencing health status and contact with health services) last. We then measured the frequency of positive viral specimens by ICD-9 code.

Trend Analysis of Unmatched Syndromic ICD-9 Codes and DOD Influenza Specimens

A second analysis compared DOD-wide positive specimens from the DOD Global Influenza Surveillance Program to ICD-9 data without matching from October 2000 through December 2004. We extended the date range for this analysis because more data were available for the DOD-wide population. We compared the trend of the DOD-wide specimens to the trends of each individual ICD-9 code in the ILI set, as well as additional codes frequently used in association with the collection of viral specimens in the matched Air Force analysis. We selected individual codes that had trends similar to that of the specimens and evaluated trends for groupings of 3–10 ICD-9 codes. We then measured the association between individual and grouped ILI codes with the positive viral specimens through both standard and lagged correlation analysis. We calculated lagged correlation coefficients by shifting the ICD-9 data by three 1-week increments both forward and backward, while holding the positive specimens constant.

We also performed signal-to-noise analysis of individual codes. First, we defined the influenza season as weeks in which the weekly count of positive specimens was greater than the mean of positive specimens for the study period. We then calculated means and standard deviations of the daily counts for each ICD-9 code. We defined signal as the mean during the influenza season minus the mean during the noninfluenza period and noise as the standard error during the noninfluenza period. The ratio of signal-to-noise evaluated whether individual codes would provide a good signal during the influenza season.

We used 4 separate criteria to select the best performing ICD-9 codes: individual code trend; high correlation coefficient (>0.6 preferable); high signal-to-noise ratio (≥1.5 preferable); and a substantial percentage of positive specimens for either all pathogens (>35%) or influenza virus (>20%). Codes fitting these specifications were retained for further analysis. Because the signal from codes used less often might be lost when combined with more frequently used codes, we created 2 new groupings, 1 with high-volume codes (ILI-large) and 1 with low-volume codes (ILI-small). We defined high-volume codes as being used >50× per day on average or >75,000× during the 4-year study period.

Assessment of Daily Algorithm Performance on ICD-9 Data

We performed another analysis to assess the utility of running daily statistical algorithms on the ESSENCE ILI group, in a way similar to algorithms run on the other 8 syndrome groups. ILI is currently reported as a weekly percentage of visits without statistical alerts. Outbreak detection in ESSENCE is based on a mixed time-series model that combines regression and exponentially weighted moving average (EWMA) algorithms (10,21,22). The number of patient visits is related not only to the previous day’s count but also to specific day of the week. The model treats holidays and weekends differently from the days following them. It reduces, or smoothes, artificial peaks in the data, which result not from true epidemics but from surges in patient visits after clinic closures, so that these peaks do not cause frequent false alarms. Likewise, the model accounts for fewer persons seeking care on weekends or during holidays, so these fluctuations do not affect the predictions. For this analysis, we ran the mixed EWMA and regression model on daily counts of the original ESSENCE ILI group, as well as on counts of the new ILI-large and ILI-small groups.

Weekly ILI Trend Comparison between CDC Sentinel Surveillance and DOD ICD-9 Data

From October through May, providers within the US Influenza Sentinel Providers Surveillance Network submit weekly reports to CDC of the total number of patients seen and the number of those patients with ILI (23). CDC calculates and reports weekly percentages by region. In this system, ILI is defined as a “fever (temperature of ≥100°F (37.8°) plus either a cough or a sore throat, in the absence a known cause other than influenza.” To confirm the results we found in our comparison of DOD surveillance systems, we analyzed the trends and correlation between weekly DOD-wide ESSENCE ILI groupings and nationwide CDC data during 3 influenza seasons: 2001–02, 2002–03, and 2003–04.

Statistical Analysis

We used Stata version 8.0 (Stata Corporation, College Station, TX, USA) and SAS versions 8.2 and 9 (SAS Institute, Cary, NC, USA) for the direct comparison of specimen data and patient visits and SAS versions 8.2 and 9 for statistical modeling and analysis. The ESSENCE-mixed EWMA and regression models were designed by using SAS macros. This research protocol was approved by the Institutional Review Board at the Walter Reed Army Institute of Research.

Results

During the study period, 7,389 Air Force specimens were taken for the matched analysis. We found an ICD-9–coded visit within the 5-day window surrounding the sample collection date for 6,236 (84.4%), with most of those specimens matching on the exact day (5,267, 84.5%). Of the 6,236 specimens with a match, 339 patients (5.4%) had >1 visit recorded: 321 had 2 visits, 12 had 3 visits, and 1 patient had 4 visits for the same day. Tables 2 and 3 show a breakdown of how the match worked, including multiple visits and multiple ICD-9 codes per visit. We gave preference to the highest order diagnosis for 68 patients who had multiple ILI diagnoses. For the 96 patients who had multiple visits without an ILI code, we selected the closest diagnosis to an infectious disease or 1 depicting respiratory symptoms.

Tables 4 and 5 show the number of specimens associated with each ICD-9 code, as well as the percentage of those specimens that tested positive for any viral respiratory pathogen and for influenza virus. We found many of the ILI codes to either be infrequently used with a viral specimen or to have a low percentage of positive specimens. Four codes not in the original ILI group (otitis media, acute suppurative otitis media, acute sinusitis, and acute tonsillitis) were frequently used with the collection of viral specimens.

For the unmatched DOD-wide analysis, we found 15,914 samples taken during the study period, of which 6,340 (39.8%) were positive for any viral respiratory pathogen, and 2,210 (13.9%) were positive for influenza A or B. Temporal analysis showed that as a group, the original ILI syndrome follows the same seasonal pattern as that for positive specimens. Individual ICD-9 code trends for influenza, fever, unspecified viral infection, otitis media, and upper respiratory infection (multiple sites) correlated well with those of the positive specimens (Tables 3, 4). Codes that did not correlate with positive specimen trends included acute tonsillitis and throat pain.

Many individual codes that correlated well with the positive specimens also tended to have high signal-to-noise ratios (Table 5). Moreover, the percentage of positive specimens associated with many of these codes also tended to be high. Based on the results of these 3 tests and their individual trends, we selected 14 ICD-9 codes for ILI surveillance. We used the frequency of individual code use during the 4-year analysis period to group 10 of the 14 codes into the ILI-large group and the other 4 into the ILI-small group, as indicated in Tables 4 and 5.

Figure 1

Thumbnail of Lagged correlation analysis between individual codes from the International Classification of Diseases, Ninth Revision (ICD-9), and unmatched positive respiratory specimens from October 2000 to December 2004. Each of the individual ICD-9 codes that had high correlation and signal-to-noise ratio when compared with positive influenza laboratory specimens taken during the same time frame (Table 5) were compiled into new large and small influenzalike illness (ILI) groups (large codes we

Figure 1. Lagged correlation analysis between individual codes from the International Classification of Diseases, Ninth Revision (ICD-9), and unmatched positive respiratory specimens from October 2000 to December 2004. Each of the individual ICD-9...

Lagged correlation analysis found that the codes of both subsets tend to peak at the same time as the number of positive specimens (Figure 1). However, the ILI-Small group codes, while still peaking centrally, tended to have curves slightly skewed to the right in the lagged correlation plot, indicating that they may be more likely to follow, rather than predict, the increases in ILI visits.

Figure 2

Thumbnail of Weekly trends among unmatched visits coded by International Classification of Diseases, Ninth Revision (ICD-9), and specimens positive for any viral respiratory pathogen from October 2000 to December 2004. Based on correlation to positive cultures and signal-to-noise ratios, new large and small influenzalike illness (ILI) categories were created. The number of positive specimens is depicted on the left y-axis and compared to the number of visits for the original, new large and new s

Figure 2. Weekly trends among unmatched visits coded by International Classification of Diseases, Ninth Revision (ICD-9), and specimens positive for any viral respiratory pathogen from October 2000 to December 2004. Based on correlation...

After establishing the new small and large ILI groups, we found that the weekly temporal trends closely follow those of positive respiratory specimens (Figure 2). Correlation coefficients of the weekly data were 0.72 (p<0.0001), 0.71 (p<0.0001), and 0.86 (p<0.0001) for the original, ILI-large, and ILI-small groups, respectively.

Figure 3

Thumbnail of Newly created groups of International Classification of Diseases, Ninth Revision (ICD-9), codes for influenzalike illness (ILI) based on correlation to positive cultures and signal-to-noise ratios were run with anomaly detection algorithms. Two groups, large and small, were created with ICD-9 codes that had an average use of &gt;50× per day in the large group with the remainder in the small group. Daily counts of the codes in the Large and Small syndromic groups were plotted from Oc

Figure 3. Newly created groups of International Classification of Diseases, Ninth Revision (ICD-9), codes for influenzalike illness (ILI) based on correlation to positive cultures and signal-to-noise ratios were run with anomaly detection algorithms....

We ran the EWMA/regressive model on 4 years of daily DOD outpatient data in each of the 3 comparison groups (Figure 3). Multiple seasonal outbreaks of respiratory illness were identified with alerts for all groupings. The daily algorithm triggered alerts much more frequently on the ILI-small group than on the large group; the algorithm for the small grouping tended to be more responsive to smaller fluctuations in the data.

Figure 4

Thumbnail of Percentage of visits for influenza-like illness (ILI) using both the large and small syndrome groups among military outpatient visits nationwide compared with Centers for Disease Control and Prevention (CDC) sentinel clinician reports from October 2001 through December 2004. Data are grouped weekly from Sunday through Saturday. CDC data are only obtained during the influenza season. ESSENCE, Electronic Surveillance System for the Early Notification of Community-based Epidemics.

Figure 4. Percentage of visits for influenza-like illness (ILI) using both the large and small syndrome groups among military outpatient visits nationwide compared with Centers for Disease Control and Prevention (CDC) sentinel clinician...

Direct comparison of the nationwide US Influenza Sentinel Providers Surveillance Network with the ESSENCE ILI groupings showed very similar trends during each of the previous 3 seasons (Figure 4). Further analysis showed that CDC data were very strongly correlated with data from the ILI-small group; with correlation coefficients 0.97 (p<0.0001), 0.87 (p<0.0001), and 0.99 (p<0.0001) for the 2001–02, 2002–03, and 2003–04 seasons, respectively. Correlation coefficients for the ILI-large group were also very strong, although not quite as high: 0.88 (p<0.0001), 0.77 (p<0.0001), and 0.93 (p<0.0001), respectively.

Discussion

In our experience with ESSENCE, the ILI surveillance report has been 1 of the most useful components. Military public health officials, and now some civilian health departments, use ESSENCE to monitor the ILI grouping for early signs of the influenza season and other common febrile respiratory outbreaks. In a similar manner, CDC now monitors ILI by using the same DOD data within the BioSense system. This study shows that the DOD outpatient ICD-9 data are indeed useful and accurate for routine influenza surveillance.

Critical analysis of the ICD-9 codes within ESSENCE ILI group showed that approximately half of the codes were associated with specimens positive for respiratory pathogens, including influenza. Temporal trends confirmed that most codes followed the same trends over time as positive specimens. Codes with low correlation to positive specimens and different temporal trends have been removed from the group to produce more parsimonious groups. The less-specific ILI-large group may be more useful for the initial detection of influenza season and for detecting other respiratory illnesses that initially cause similar symptoms, whereas the ILI-small group is more specific but also more likely to signal slightly later than the large group because providers should use these codes cautiously until influenza cases have been confirmed. However, both groupings have been shown to be useful indictors of an impending influenza season.

ESSENCE should produce reports of ILI activity faster than both the laboratory-based DOD Global Influenza Surveillance Program and the CDC sentinel ILI system because it is able to collect and analyze data more rapidly than specimens and provider reports can be processed. The weekly data are reported in ESSENCE immediately on completion of a full week, whereas the DOD laboratory data have an inherent lag time because of the time required for specimen shipping, laboratory testing, analysis, and reporting. The CDC sentinel reporting system similarly lags behind because of the passive nature of data collection and additional time required to compile and post results. The automated data collection also allows for the potential to analyze data more frequently than the current weekly standard. Our analysis successfully identified seasonal outbreaks by using a combination algorithm on daily data, based on aggregated data for a given day. The algorithm runs every 8 hours (more or less frequently depending on administrator settings) and recalculates on the basis of newly received data. Daily detection algorithms can be instituted on the large and small groups simultaneously to best detect ILI outbreaks.

The results of this study support previous findings on the ability of automated systems to capture the same trends as traditional surveillance. The Minnesota Department of Health found that an ILI grouping of ICD-9 data from a health maintenance organization in the Minneapolis–St. Paul area correlated with reported deaths from pneumonia and influenza (24). Ambulatory ICD-9 codes were also successfully used for surveillance of respiratory illnesses in Massachusetts and were highly correlated with hospital admissions that had a lower proportion of discharged patients with a diagnosis of respiratory illness (25). Our study also supports evidence that using nontraditional electronic data for syndromic surveillance may enable health providers to recognize and detect the influenza season faster than with traditional means. In a similar study of nontraditional data, the New York City Department of Health and Mental Hygiene reported that their syndromic system, based on chief complaints at emergency departments, detected the first citywide signs of influenza activity sooner than laboratory- and sentinel-based surveillance (26).

We have established that ICD-9–based surveillance that uses the ILI-large and ILI-small groups is an effective tool for influenza surveillance. We suggest that health agencies use these syndrome groups as a model for developing similar systems. However, we strongly emphasize that developers perform critical analysis of the individual codes collected in their data and carefully consider not only the clinical basis for code inclusion but also which diagnoses are more likely to cause background “noise” rather than contribute to the signal. Our own evaluation illustrates the importance of such critical review, as we found that both throat pain and acute tonsillitis had more noise than signal. Asthma and chest pain are included in other syndromic systems (24); however, in the DOD data, these tend to occur year-round with fairly high volume and contribute more noise than signal in the DOD ambulatory data. Studies of systems that use such broad categories for ILI surveillance have yielded lower correlation of ICD-9 data with mortality and laboratory-based data (24). Data sources differ dramatically in population coverage, quality and accuracy, and most important, in their ability to reflect true disease patterns. Our method for defining and assessing syndrome groupings for ICD-9–based surveillance should assist developers in parsing, analyzing, and interpreting their own data.

Ms Marsden-Haug is currently the training and outreach manager for the Northwest Center for Public Health Practice (NWCPHP). She works with NWCPHP regional partners in public health practice to identify areas for collaboration on workforce development projects.

Top

References

  1. Flahault A, Dias-Ferrao V, Chaberty P, Esteves K, Valleron AJ, Lavanchy D. FluNet as a tool for global monitoring of influenza on the Web.JAMA. 1998;280:1330–2. DOIPubMedGoogle Scholar
  2. Hyer RN, Howell MR, Ryan MA, Gaydos JC. Cost-effectiveness analysis of reacquiring and using adenovirus types 4 and 7 vaccines in naval recruits.Am J Trop Med Hyg. 2000;62:613–8.PubMedGoogle Scholar
  3. Likos AM, Neville J, Gaydos JC. Influenza outbreak and response preparedness in the Air National Guard.Mil Med. 2002;167:929–33.PubMedGoogle Scholar
  4. Influenza vaccines.Wkly Epidemiol Rec. 2002;77:230–9.PubMedGoogle Scholar
  5. Luk J, Gross P, Thompson WW. Observations on mortality during the 1918 influenza pandemic.Clin Infect Dis. 2001;33:1375–8. DOIPubMedGoogle Scholar
  6. Henning KJ. What is syndromic surveillance?MMWR Morb Mortal Wkly Rep. 2004;53(Suppl):5–11.PubMedGoogle Scholar
  7. Loonsk JW. BioSense—a national initiative for early detection and quantification of public health emergencies.MMWR Morb Mortal Wkly Rep. 2004;53(Suppl):53–5.PubMedGoogle Scholar
  8. Mandl KD, Overhage JM, Wagner MM, Lober WB, Sebastiani P, Mostashari F, Implementing syndromic surveillance: a practical guide informed by the early experience.J Am Med Inform Assoc. 2004;11:141–50. DOIPubMedGoogle Scholar
  9. Global Emerging Infections System [homepage on the Internet]. ESSENCE: Electronic Surveillance System for the Early Notification of Community-based Epidemics [cited 2006 Mar 15]. Available from: http://www.geis.fhp.osd.mil/GEIS/SurveillanceActivities/ESSENCE/ESSENCE.asp
  10. Lewis MD, Pavlin JA, Mansfield JL, O’Brien S, Boomsma LG, Elbert Y, Disease outbreak detection system using syndromic data in the greater Washington DC area.Am J Prev Med. 2002;23:180–6. DOIPubMedGoogle Scholar
  11. Gray GC, Callahan JD, Hawksworth AW, Fisher CA, Gaydos JC. Respiratory diseases among U.S. military personnel: countering emerging threats.Emerg Infect Dis. 1999;5:379–85.PubMedGoogle Scholar
  12. McNeill KM, Vaughn BL, Brundage MB, Li Y, Poropatich RK, Gaydos JC. Clinical presentations for influenza and influenza-like illness in young, immunized soldiers.Mil Med. 2005;170:94–7.PubMedGoogle Scholar
  13. Naval Health Research Center. Febrile respiratory illness surveillance [cited 2005 May 9]. Available from http://www.nhrc.navy.mil/geis
  14. Ryan M, Gray G, Hawksworth A, Malasig M, Hudspeth M, Poddar S. The Naval Health Research Center Respiratory Disease Laboratory.Mil Med. 2000;165(Suppl 2):32–4.PubMedGoogle Scholar
  15. Sosin DM. Syndromic surveillance: the case for skillful investment.Biosecur Bioterror. 2003;1:247–53. DOIPubMedGoogle Scholar
  16. Stoto MA, Schonlau M, Mariano LT. Syndromic surveillance: Is it worth the effort?Chance. 2004;17:19–24.
  17. Voss S. Picture of health: the emerging science of syndromic surveillance.Homeland First Response.2004;2:18–25.
  18. Centers for Disease Control and Prevention. Syndrome definitions for diseases associated with critical bioterrorism-associated agents [cited 2005 Sep 20]. Available from http://www.bt.cdc.gov/surveillance/syndromedef/pdf/syndromedefinitions.pdf
  19. Air Force Institute for Operational Health [homepage on the Internet]. Influenza report [cited 2005 May 1]. Available from http://www.brooks.af.mil/afioh/Health%20Programs/rsrh_influenza_report.htm
  20. Canas LC, Lohman K, Pavlin JA, Endy T, Singh DL, Pandey P, The Department of Defense laboratory-based global influenza surveillance system.Mil Med. 2000;165(Suppl 2):52–6.PubMedGoogle Scholar
  21. Burkom HS, Elbert Y, Feldman A, Lin J. Role of data aggregation in biosurveillance detection strategies with applications from ESSENCE.MMWR Morb Mortal Wkly Rep. 2004;53(Suppl):67–73.PubMedGoogle Scholar
  22. Lombardo J, Burkom H, Elbert E, Magruder S, Lewis SH, Loschen W, A systems overview of the Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE II).J Urban Health. 2003;80(Suppl 1):i32–42.PubMedGoogle Scholar
  23. Centers for Disease Control and Prevention. Flu activity: reports and surveillance methods in the United States [cited 2005 Dec 20]. Available from http://www.cdc.gov/flu/weekly/fluactivity.htm
  24. Miller B, Kassenborg H, Dunsmuir W, Griffith J, Hadidi M, Nordin JD, Syndromic surveillance for influenzalike illness in ambulatory care network.Emerg Infect Dis. 2004;10:1806–11.PubMedGoogle Scholar
  25. Lazarus R, Kleinman K, Dashevsky I, Adams C, Kludt P, DeMaria AJr, Use of automated ambulatory-care encounter records for detection of acute illness clusters, including potential bioterrorism events.Emerg Infect Dis. 2002;8:753–60.PubMedGoogle Scholar
  26. Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D. Syndromic surveillance in public health practice, New York City.Emerg Infect Dis. 2004;10:858–64.PubMedGoogle Scholar

Top

Figures
Tables

Top

Cite This Article

DOI: 10.3201/eid1302.060557

1Current affiliation: Tacoma–Pierce County Health Department, Tacoma, Washington, USA

2Current affiliation: US Census Bureau, Suitland, Maryland, USA

3Current affiliation: Uniformed Services University of the Health Sciences, Bethesda, Maryland, USA

Table of Contents – Volume 13, Number 2—February 2007

EID Search Options
presentation_01 Advanced Article Search – Search articles by author and/or keyword.
presentation_01 Articles by Country Search – Search articles by the topic country.
presentation_01 Article Type Search – Search articles by article type and issue.

Top

Comments

Please use the form below to submit correspondence to the authors or contact them at the following address:

Julie Pavlin, 5615 Bradley Blvd, Bethesda, MD 20814, USA;

Send To

10000 character(s) remaining.

Top

Page created: June 29, 2010
Page updated: June 29, 2010
Page reviewed: June 29, 2010
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external