Publications

E

OBJECTIVE: Children evaluated in the emergency department for possible appendicitis are often admitted for observation, despite the widespread availability of accurate diagnostic studies, particularly computed tomography (CT). We sought to establish effective and efficient strategies for using CT to diagnose and manage children with possible appendicitis. DESIGN: Retrospective chart review and decision analysis. Setting. Emergency department of a large, urban tertiary care pediatric teaching hospital. PATIENTS: All patients admitted from January 1996 to August 1997 for suspected appendicitis. METHOD OF ANALYSIS: Three modeled strategies were empirically applied to the retrospective cohort of patients admitted for observation. Outcomes and costs under the modeled strategies were compared with those under current practice. The three strategies were: 1) to obtain CT scans on all patients and discharge those with normal findings; 2) to obtain CT scans and admit all patients; 3) to selectively obtain CT scans on those patients with a peripheral white blood cell count >10 000/mm(3) (10 x 10(9)/L) and admit all. The sensitivity and specificity of CT for diagnosing appendicitis were determined empirically from the data. A sensitivity analysis was performed. MAIN OUTCOME MEASURES: The number of preoperative inpatient observation days, total hospital costs, and the rates of both missed appendicitis and negative laparotomies. RESULTS: Of 609 patients hospitalized for possible appendicitis, 287 went directly to the operating room and 14 patients had known perforation and abscess. Three hundred eight children were observed and comprised the study cohort. Of the cohort, 112 (36.4%) underwent appendectomy and 26 (23.2%) of these had a normal appendix at pathology. Three patients were discharged from the hospital after observation and were subsequently readmitted with appendicitis (missed appendicitis). Among the 75 patients who had CT performed, the sensitivity and specificity of CT were both 97%. Under the current practice strategy, the cohort collectively accumulated 487 inpatient observation days and incurred a per patient cost of $5831. All three CT strategies would have reduced the total number of inpatient observation days, operations, negative laparotomies, as well as the per patient cost. The strategy of obtaining CT scans on all patients and then admitting them had the lowest rate of missed appendicitis. The additional cost of preventing each case of missed appendicitis under this strategy compared with the strategy of obtaining CT scans and sending home those with negative findings was $150,304. Even at the lowest reported sensitivity and specificity of CT in the literature, the ordering of the three strategies remained constant and continued to reduce total cost per patient. CONCLUSION: Compared with current practice, diagnostic strategies using CT could reduce costs and improve diagnosis, management, and outcomes for children with appendicitis.
Pena, Taylor, Fishman, Mandl. Effect of an imaging protocol on clinical outcomes among pediatric patients with appendicitis. Pediatrics. 2002;110:1088–93.
OBJECTIVE: In 1998, we implemented a clinical imaging protocol in which children with suspected appendicitis underwent ultrasonography (US) followed by computed tomography (CT). We sought to determine the impact of the US-CT protocol on changes in perforation and negative appendectomy rates. METHODS: Children with unequivocal presentations for appendicitis went to the operating room without entering the imaging protocol. Using a modified time series design, we analyzed a prospective and retrospective cohort of consecutive patients who were admitted from the emergency department for suspected appendicitis. The perforation and negative appendectomy rates were computed for the periods before and after implementation of the imaging protocol and adjustment for time trends was made. RESULTS: A total of 1338 children were identified. Eight hundred ten (60.5%) children had equivocal clinical findings. A total of 920 patients were admitted for suspected appendicitis before the protocol was implemented; 526 (57.2%) of the 920 children had appendicitis, and 186 (35.4%) of them had perforation. A total of 91 (14.7%) of 617 had negative appendectomies. After the protocol was implemented, 418 patients were admitted for suspected appendicitis; 328 (78.5%) had appendicitis with 51 (15.5%) perforated. There were 14 (4.1%) of 342 cases of negative appendectomies. After implementation of the imaging protocol, the perforation rate decreased from 35.4% to 15.5%, and the negative appendectomy rate decreased from 14.7% to 4.1%. After secular time trends were adjusted for, the imaging protocol continued to have a strong association with a reduction in perforation rate and negative appendectomy rate. CONCLUSION: The implementation of an imaging protocol using US and CT resulted in a marked decrease in the perforation and negative appendectomy rates in children with suspected appendicitis.
OBJECTIVE: To determine the impact of reduced postpartum length of stay (LOS) on primary care services use. METHODS. DESIGN: Retrospective quasiexperimental study, comparing 3 periods before and 1 period after introducing an intervention and adjusting for time trends. SETTING: A managed care plan. INTERVENTION: A reduced obstetrical LOS program (ROLOS), offering enhanced education and services. PARTICIPANTS: mother-infant dyads, delivered during 4 time periods: February through May 1992, 1993, and 1994, before ROLOS, and 1995, while ROLOS was in effect. INDEPENDENT MEASURES: Pre-ROLOS or the post-ROLOS year. OUTCOME MEASURES: Telephone calls, visits, and urgent care events during the first 3 weeks postpartum summed as total utilization events. RESULTS: Before ROLOS, LOS decreased gradually (from 51.6 to 44.3 hours) and after, sharply to 36.5 hours. Although primary care use did not increase before ROLOS, utilization for dyads increased during ROLOS. Before ROLOS, there were between 2.37 and 2.72 utilization events per day; after, there were 4.60. Well-child visits increased slightly to.98 visits per dyad, but urgent visits did not. CONCLUSION: This program resulted in shortened stays and more primary care use. There was no increase in infant urgent primary care utilization. Early discharge programs that incorporate and reimburse for enhanced ambulatory services may be safe for infants; these findings should not be extrapolated to mandatory reduced LOS initiatives without enhancement of care.
Halamka, Mandl, Tang. Early experiences with personal health records. J Am Med Inform Assoc. 2008;15:1–7.
Over the past year, several payers, employers, and commercial vendors have announced personal health record projects. Few of these are widely deployed and few are fully integrated into ambulatory or hospital-based electronic record systems. The earliest adopters of personal health records have many lessons learned that can inform these new initiatives. We present three case studies--MyChart at Palo Alto Medical Foundation, PatientSite at Beth Israel Deaconess Medical Center, and Indivo at Children's Hospital Boston. We describe our implementation challenges from 1999 to 2007 and postulate the evolving challenges we will face over the next five years.
Zimolzak, Spettell, Fernandes, Fusaro, Palmer, Saria, Kohane, Jonikas, Mandl. Early detection of poor adherers to statins: applying individualized surveillance to pay for performance. PLoS One. 2013;8:e79611.
BACKGROUND: Medication nonadherence costs $300 billion annually in the US. Medicare Advantage plans have a financial incentive to increase medication adherence among members because the Centers for Medicare and Medicaid Services (CMS) now awards substantive bonus payments to such plans, based in part on population adherence to chronic medications. We sought to build an individualized surveillance model that detects early which beneficiaries will fall below the CMS adherence threshold. METHODS: This was a retrospective study of over 210,000 beneficiaries initiating statins, in a database of private insurance claims, from 2008-2011. A logistic regression model was constructed to use statin adherence from initiation to day 90 to predict beneficiaries who would not meet the CMS measure of proportion of days covered 0.8 or above, from day 91 to 365. The model controlled for 15 additional characteristics. In a sensitivity analysis, we varied the number of days of adherence data used for prediction. RESULTS: Lower adherence in the first 90 days was the strongest predictor of one-year nonadherence, with an odds ratio of 25.0 (95% confidence interval 23.7-26.5) for poor adherence at one year. The model had an area under the receiver operating characteristic curve of 0.80. Sensitivity analysis revealed that predictions of comparable accuracy could be made only 40 days after statin initiation. When members with 30-day supplies for their first statin fill had predictions made at 40 days, and members with 90-day supplies for their first fill had predictions made at 100 days, poor adherence could be predicted with 86% positive predictive value. CONCLUSIONS: To preserve their Medicare Star ratings, plan managers should identify or develop effective programs to improve adherence. An individualized surveillance approach can be used to target members who would most benefit, recognizing the tradeoff between improved model performance over time and the advantage of earlier detection.
Reis, Kohane, Mandl. An epidemiological network model for disease outbreak detection. PLoS Med. 2007;4:e210.
BACKGROUND: Advanced disease-surveillance systems have been deployed worldwide to provide early detection of infectious disease outbreaks and bioterrorist attacks. New methods that improve the overall detection capabilities of these systems can have a broad practical impact. Furthermore, most current generation surveillance systems are vulnerable to dramatic and unpredictable shifts in the health-care data that they monitor. These shifts can occur during major public events, such as the Olympics, as a result of population surges and public closures. Shifts can also occur during epidemics and pandemics as a result of quarantines, the worried-well flooding emergency departments or, conversely, the public staying away from hospitals for fear of nosocomial infection. Most surveillance systems are not robust to such shifts in health-care utilization, either because they do not adjust baselines and alert-thresholds to new utilization levels, or because the utilization shifts themselves may trigger an alarm. As a result, public-health crises and major public events threaten to undermine health-surveillance systems at the very times they are needed most. METHODS AND FINDINGS: To address this challenge, we introduce a class of epidemiological network models that monitor the relationships among different health-care data streams instead of monitoring the data streams themselves. By extracting the extra information present in the relationships between the data streams, these models have the potential to improve the detection capabilities of a system. Furthermore, the models' relational nature has the potential to increase a system's robustness to unpredictable baseline shifts. We implemented these models and evaluated their effectiveness using historical emergency department data from five hospitals in a single metropolitan area, recorded over a period of 4.5 y by the Automated Epidemiological Geotemporal Integrated Surveillance real-time public health-surveillance system, developed by the Children's Hospital Informatics Program at the Harvard-MIT Division of Health Sciences and Technology on behalf of the Massachusetts Department of Public Health. We performed experiments with semi-synthetic outbreaks of different magnitudes and simulated baseline shifts of different types and magnitudes. The results show that the network models provide better detection of localized outbreaks, and greater robustness to unpredictable shifts than a reference time-series modeling approach. CONCLUSIONS: The integrated network models of epidemiological data streams and their interrelationships have the potential to improve current surveillance efforts, providing better localized outbreak detection under normal circumstances, as well as more robust performance in the face of shifts in health-care utilization during epidemics and major public events.

D

Cassa, Savage, Taylor, Green, McGuire, Mandl. Disclosing pathogenic genetic variants to research participants: quantifying an emerging ethical responsibility. Genome Res. 2012;22:421–8.
There is an emerging consensus that when investigators obtain genomic data from research participants, they may incur an ethical responsibility to inform at-risk individuals about clinically significant variants discovered during the course of their research. With whole-exome sequencing becoming commonplace and the falling costs of full-genome sequencing, there will be an increasingly large number of variants identified in research participants that may be of sufficient clinical relevance to share. An explicit approach to triaging and communicating these results has yet to be developed, and even the magnitude of the task is uncertain. To develop an estimate of the number of variants that might qualify for disclosure, we apply recently published recommendations for the return of results to a defined and representative set of variants and then extrapolate these estimates to genome scale. We find that the total number of variants meeting the threshold for recommended disclosure ranges from 3955-12,579 (3.79%-12.06%, 95% CI) in the most conservative estimate to 6998-17,189 (6.69%-16.48%, 95% CI) in an estimate including variants with variable disease expressivity. Additionally, if the growth rate from the previous 4 yr continues, we estimate that the total number of disease-associated variants will grow 37% over the next 4 yr.
The fetal and maternal concentration of various plasma proteins alters during pregnancy. Cells in the livers of fetal hamsters accumulate serum amyloid A (SAA) and C-reactive protein (CRP) mRNA, major acute phase reactants, when lipopolysaccharide is administered to the fetal circulation. No fetal SAA or CRP mRNA response is seen when the mother is stimulated at a remote site by endotoxin or a nonspecific inflammatory agent. In addition, cells of the fetal hamster liver do not respond by accumulating SAA mRNA when exposed to the specific cytokines, tumor necrosis factor, IL-1, and IL-6. CRP mRNA levels increased in fetal livers after administration of tumor necrosis factor and IL-1. These data suggest that cells contained in the fetal liver can respond during an acute phase reaction but that the capacity of some acute phase reactant genes to respond to cytokines may be developmentally regulated. Studies of immature hamsters after birth show that the responses of CRP and SAA genes to lipopolysaccharide, tumor necrosis factor, IL-1, and IL-6 are reduced when compared with induction of mRNA accumulation for these acute phase reactants in adult animals.