A well-known issue in healthcare which has only been addressed in the past two decades.

Reprint: R1310B

In health care, the days of business as usual are over. Around the world, every health care system is struggling with rising costs and uneven quality, despite the hard work of well-intentioned, well-trained clinicians. Health care leaders and policy makers have tried countless incremental fixes—attacking fraud, reducing errors, enforcing practice guidelines, making patients better “consumers,” implementing electronic medical records—but none have had much impact.

It’s time for a fundamentally new strategy. At its core is maximizing value for patients: that is, achieving the best outcomes at the lowest cost. We must move away from a supply-driven health care system organized around what physicians do and toward a patient-centered system organized around what patients need. We must shift the focus from the volume and profitability of services provided—physician visits, hospitalizations, procedures, and tests—to the patient outcomes achieved. And we must replace today’s fragmented system, in which every local provider offers a full range of services, with a system in which services for particular medical conditions are concentrated in health-delivery organizations and in the right locations to deliver high-value care.

The strategy for moving to a high-value health care delivery system comprises six interdependent components: organizing around patients’ medical conditions rather than physicians’ medical specialties, measuring costs and outcomes for each patient, developing bundled prices for the full care cycle, integrating care across separate facilities, expanding geographic reach, and building an enabling IT platform.

The transformation to value-based health care is well under way. Some organizations, such as the Cleveland Clinic and Germany’s Schön Klinik, have undertaken large-scale changes involving multiple components of the value agenda. The result has been striking improvements in outcomes and efficiency, and growth in market share.

In health care, the days of business as usual are over. Around the world, every health care system is struggling with rising costs and uneven quality despite the hard work of well-intentioned, well-trained clinicians. Health care leaders and policy makers have tried countless incremental fixes—attacking fraud, reducing errors, enforcing practice guidelines, making patients better “consumers,” implementing electronic medical records—but none have had much impact.

A version of this article appeared in the October 2013 issue of Harvard Business Review.

Reprint: R0605B

Health care in the United States—and in most other developed countries—is ailing. Medical treatment has made astonishing advances, but the packaging and delivery of health care are often inefficient, ineffective, and user unfriendly.

Problems ranging from costs to medical errors beg for ingenious solutions—and indeed, enormous investments have been made in innovation. But too many efforts fail. To find out why, it’s necessary to break down the problem, look at the different types of innovation, and examine the forces that affect them.

Three kinds of innovation can make health care better and cheaper: One changes the ways consumers buy and use health care, another taps into technology, and the third generates new business models.

The health care system erects an array of barriers to each type of innovation. More often than not, organizations can overcome the barriers by managing the six forces that have an impact on health care innovation: players, the friends and foes who can bolster or destroy; funding, the revenue-generation and capital-acquisition processes, which differ from those in other industries; policy, the regulations that pervade the industry; technology, the foundation for innovations that can make health care delivery more efficient and convenient; customers, the empowered and engaged consumers of health care; and accountability, the demand from consumers, payers, and regulators that innovations be safe, effective, and cost-effective. Companies can often turn these six forces to their advantage.

The analytical framework the author describes can also be used to examine other industries. Cataloging the innovation types and identifying the forces that aid or undermine them can reveal insights on how to treat chronic innovation ills—prescriptions that will make any industry healthier.

Health care—in the United States, certainly, but also in most other developed countries—is ailing and in need of help. Yes, medical treatment has made astonishing advances over the years. But the packaging and delivery of that treatment are often inefficient, ineffective, and consumer unfriendly.

A version of this article appeared in the May 2006 issue of Harvard Business Review.

The Institute of Medicine’s To Err Is Human1 was transformational for patient safety. It brought the problem of medical errors into the public eye and highlighted why every health care organization in the US must consider safety as a priority. Before the report’s release, many—including leaders in major health care organizations—simply did not.

The report made several major points: Errors are common, they are costly, systems-related problems cause errors, errors can be prevented, and safety can be improved.1 Important changes resulted, including a significant increase in patient safety research sponsored mainly by the Agency for Healthcare Research and Quality (AHRQ) and hospital programs focused on measurement, accreditation, and regulation.2 The number of studies to address safety gaps increased by more than 250 percent over several years,3 and many occurred in areas that had not received previous attention.

In the years since the report’s publication, it has become increasingly clear that safety issues are pervasive throughout health care and that patients are frequently injured as a result of the care they receive. The exact number of deaths that occur in the US is highly controversial and has been debated at some length.4–7 This is partly because methodologically questionable approaches have been used to estimate deaths, and in any given instance, it’s often hard to determine whether an individual death could have been prevented. However, many experts believe that the number is probably in the hundreds of thousands annually, while many more patients are injured unnecessarily.

Early efforts to reduce hospital errors largely focused on hospital safety. Before the report, adverse events such as hospital-acquired infections were considered a cost of doing business. Central line–associated bloodstream infections (a type of hospital-acquired infection) represent a notable example. Peter Pronovost and his team from Johns Hopkins University showed that by following a bundle of safety procedures, they could reduce the incidence of these infections to nearly zero.8 The bundle included steps to follow in central venous catheter insertion, the handling and maintenance of lines, and the prompt removal of unnecessary lines. Many felt that these initial results might be too good to be true, but Pronovost and colleagues were later able to replicate the results across the state of Michigan.9 This resulted in a change in how people thought about harm, because even in situations in which no obvious error had been made, it was possible to dramatically reduce the risk of harm. Some of the principles behind such interventions were adopted from high-reliability industries10 such as aviation, which use a more systematic approach to safety than health care does.

Subsequent safety targets included ventilator-associated pneumonia and catheter-associated urinary tract infection. Nearly all hospitals have implemented surveillance for the main types of hospital-acquired infections, including these two conditions, central line–associated bloodstream infections, and surgical site infections. Improved hand washing has also been an important part of this effort.11 In fact, the number of hospital-acquired conditions fell from 145 per 1,000 admissions in 2010 to 115 per 1,000 admissions in 2015, as assessed by the AHRQ national scorecard.12 The rate of central line–associated bloodstream infections appears to have fallen by about 80 percent since the publication of To Err Is Human.13

While effective prevention strategies are now available, infection rates remain too high. For example, 75 percent of US hospitals had a standardized infection ratio above the Leapfrog Group’s standard in one recent evaluation.14 Much of the remaining variation in hospital infection rates is believed to result from inconsistency in the use of prevention techniques. Approaches such as peer-to-peer assessment appear to hold potential for reducing the rates.15

Medication errors have also been found to be one of the most common causes of harm.16 However, effective interventions have been developed. Specifically, computerizing the ordering of medications and delivering computerized clinical decision support to the ordering provider has been found to reduce rates of adverse drug events.17–19 Decision support includes checking orders for allergies and flagging drugs with risky interactions or out-of-range dosages and then making corrective suggestions to providers in real time. Another intervention, the bar coding of patients and medications, has reduced error rates both at the point of care20 and in the pharmacy.21 In 2009 the federal government implemented incentives to adopt computerized order entry with decision support as part of electronic health record (EHR) meaningful-use attestation, which increased the adoption of these technologies across the US. However, recent data suggest that clinical decision support in EHRs is not delivering the benefits seen in earlier studies, and that it might not be having any impact at all as currently implemented—which makes this a critical priority to address.22 Work-arounds remain a pervasive issue with technologies such as bar coding: People employ work-arounds to save time in part because they might not appreciate the safety benefits. More generally, variability in the implementation and use of technology affects its impact. Much of this relates to disregard of the “sociotechnical” factors involved—nontechnical factors such as work flow, training, and organizational issues.23

Surgical injuries have also been a major cause of harm. To address this, Atul Gawande and his team at Brigham and Women’s Hospital developed a surgical checklist for the operating room, which resulted in a 36 percent decrease in the rate of adverse events and a 47 percent decrease in the mortality rate in a multinational study.24 Yet postimplementation success rates have been variable in this area, too. It is likely that several contextual factors25 influence the success of an intervention, and while effective tools have been developed, their impact on safety in the real world is often determined by how those factors are addressed. For instance, leadership support and local safety culture are important determinants of whether there is adequate uptake and effect of an intervention that looks good on its face. Moreover, errors related to human cognition or behavior in or out of the operating room might not be targeted by the checklist, which suggests the need for more work to understand and address surgical safety.

Additional types of hospital errors that need addressing include errors during handoffs between units, failure to rescue, misidentification of patients, pressure ulcers, and falls. Safety gaps from discontinuous care have been addressed by a standardized intervention bundle called I-PASS (for illness severity, patient summary, action list, situation awareness and contingency plans, and synthesis by receiver),26 which is now being implemented in hundreds of hospitals across the US and internationally. Failure to rescue, defined as the death of a patient after one or more potentially treatable complications, is being used as a surgical quality indicator to account for potentially preventable postoperative complications.

At the organizational level, safety improvement is closely related to good management and the effective implementation of a safety culture.27 A consistent and salient safety culture is a critical determinant of the success of safety interventions, and many organizations now measure their safety culture over time using a validated instrument available from AHRQ, the Hospital Survey on Patient Safety Culture. Organizations are unable to take on newly identified safety issues when they are still struggling to manage old ones whose solutions have not been sustainable because of culture issues. Hand washing is an example of an unsustainable intervention at many hospitals. Many leading organizations have also embraced the concept of a high-reliability safety culture, which has been defined as “professional leadership attitudes in a High Reliability Organization that manage potentially hazardous activities to maintain risk to people and the environment as low as reasonably achievable, thereby assuring stakeholder trust.”28 These institutions are trying to move from addressing each individual adverse event and type of adverse event to addressing safety systematically within an integrated management system for safety.29

An important part of safety promotion involves the scaling of successful interventions. Several organizations have been involved in scaling, including the Institute for Healthcare Improvement and the National Patient Safety Foundation (NPSF). The institute’s 100,000 Lives campaign made notable strides, engaging hundreds of hospitals in adopting safety solutions. The NPSF formed the Lucian Leape Institute, a think tank that identifies novel approaches to improve safety and identifies risk areas that need system-level attention, as well as supporting both education related to safety in training and work on disclosure and apology.

Major national policy and practice initiatives have also built momentum to address safety in US hospitals. The Patient Safety and Quality Improvement Act of 2005 authorized the creation of Patient Safety Organizations (PSOs). These organizations bring groups together to improve wider learning by sharing data from voluntary reporting under privacy and confidentiality protection.30 Often they coalesce around a specific domain such as health information technology (IT) safety. Organizations (often hospitals or integrated delivery systems) submit information about errors and adverse events to their PSO. While submitting organizations participate variably, with some reporting a great deal and others largely observing, the PSOs can play a valuable role in providing information on safety patterns and trends back to the reporting organizations.31 A national initiative of the Centers for Medicare and Medicaid Services (CMS), the Partnership for Patients, is also investing resources to reduce preventable harm through the Hospital Improvement Innovation Networks.

In 2008 CMS stopped reimbursing hospitals under Medicare for certain hospital-acquired conditions, including pressure ulcers, in-hospital falls, and infections.32 While this certainly stimulated hospitals to work on these problems, both the measurement of hospital-acquired conditions and the safety impact of this policy remain controversial.33,34 Measurement of these conditions has varied substantially across hospitals, and some of the metrics appear unreliable. Perhaps more important, large hospitals that care for sicker populations and hospitals that care for poorer populations have higher rates of hospital-acquired conditions, and they believe this relates to the fact that their patients are at higher risk and of lower socioeconomic status than patients at community hospitals.

The health care system has begun to draw on scientific approaches to safety from areas outside of traditional medicine.

The health care system has begun to draw on scientific approaches to safety from areas outside of traditional medicine, including human factors engineering, psychology, the social sciences, patient-centered approaches, culture and teamwork, and design of the physical environment. These disciplines have improved the health care system’s understanding of safety and served as the basis for developing novel strategies within health care to address safety problems. For example, evidence-based design in relation to the built environment35,36 plays a major role in infection prevention and improvement of other safety issues. Regarding infection, examples include designing rooms to eliminate cloth curtains (which hold bacteria) and eliminating corners in rooms (which are difficult to sterilize). More work is needed to translate systems and human factors engineering principles to design safer systems in health care environments.

Many new issues have emerged within the purview of patient safety that require systematic safety-based solutions. In this section we highlight the problems of diagnostic error, outpatient safety, and safety related to health IT because we believe they are especially pressing.

Although exact inpatient numbers are unknown, about 5 percent of US adults in the outpatient setting experience a diagnostic error every year, and about half of these are potentially harmful.37 Standards for accuracy and timeliness of diagnosis are ill-defined for most conditions, and providers must constantly balance diagnostic accuracy against the judicious or appropriate use of tests or procedures. Errors involve common diseases or conditions, not just infrequent or rare ones, and often result from breakdowns in data gathering and interpretation of patient history and exam or in follow-up of abnormal diagnostic tests.38 A 2015 report by the National Academies of Sciences, Engineering, and Medicine titled Improving Diagnosis in Health Care thrust diagnostic error into the mainstream conversation on patient safety.39

The past decade revealed more advanced understanding of diagnostic error—its frequency, harm, and contributory factors.40,41 No single physician’s knowledge and decision making are sufficient to ensure an accurate diagnosis, especially when a diagnosis evolves across time and place and involves interactions among numerous team players. Research has highlighted the need to account for the complex interaction of multiple contributory factors, both system (such as breakdowns in communication, coordination, or teamwork or the lack of robust policies and procedures) and individual (such as failures in data gathering or interpretation, overconfidence in diagnostic judgment, and lack of knowledge).42,43 This underscores the rationale for a more systems-based approach to addressing the diagnostic process instead of simply focusing on whether the diagnosis was right or wrong.

The National Academies and other organizations have made recommendations for addressing diagnostic error that are consistent with other areas of safety and health care improvement: improving teamwork and patient engagement; providing adequate time and reimbursement for cognitive work; reforming malpractice standards; using technologies to support patient care, such as clinical decision support—which sometimes involves artificial intelligence; and providing research funding to accelerate the science of diagnostic errors and develop preventive strategies.44,45 While AHRQ in particular is sponsoring research on how to better measure the problem,46 several high-risk areas are ripe for policy and practice initiatives to reduce diagnostic error, and health systems could lead these efforts. These include clarifying responsibilities for follow-up of abnormal clinical findings among different care team members, identifying at-risk patients for reliable tracking or “closed-loop” follow-up—for example, ensuring that a patient who has received an important specialist referral gets to see the specialist, improving doctor-patient communication and relationships, and monitoring follow-up of high-risk abnormal test results (such as those suspicious for cancer).47–49

The high volume of outpatient care and the need for collaboration and communication across the continuum of care increase the potential for errors in outpatient settings. Furthermore, problems and strategies identified in the inpatient setting might not be applicable or relevant to outpatient care.50 Outpatient clinicians have fewer resources and less infrastructure for patient safety activities than inpatient clinicians do. In addition, regulatory and accreditation agencies have not prioritized outpatient safety to the same extent as they have inpatient safety. The result is that knowledge in this area is nascent, and there are only a few generalizable interventions.

Recent reports from AHRQ, the American College of Physicians, the Organization for Economic Cooperation and Development, and the World Health Organization highlight potential next steps,51–54 including the systematic measurement of safety and harm to inform action; learning from patient reporting of adverse events; more incentives for team-based care and patient engagement; research into both quantifying problems and intervention development; and strategies to address underlying contributory factors such as physician stress, burnout, and culture.

Health IT can help prevent many types of patient safety errors. These include medication and diagnostic errors,55 patient identification errors,56 poor data accessibility for both patients and providers, and ensuring that issues like abnormal laboratory tests and important referrals are followed up appropriately.

But it has also become clear that health IT invariably introduces new problems. Emerging priorities for patient safety related to this technology include ensuring the safety of the technology itself; the safe use of the technology by clinicians, staff members, and patients; and the effective use of it to improve patient safety.57 The latter entails using the technology to identify and monitor risks and safety events and intervening before harm occurs.

Examples of safety issues that have emerged include software bugs and system crashes;58 copying and pasting inaccurate information;59 signing autopopulated information supplied by the computer that shows abnormal clinical findings; and overlooking important abnormal lab or medication interaction alerts, often amid handling other alerts that are inconsequential.60 Problems with EHR usability—including burdensome documentation methods, awkward workflow arrangements, and lack of interoperability with other patient record systems—cause provider frustration and burnout, with potential implications for safety.61

While improvements have been made, unacceptably high frequency of patient harm remains. Additional safety priorities continue to emerge as new care approaches are implemented. Moreover, even well-thought-out interventions inevitably create new challenges and unforeseen safety issues.

A major priority must be to stimulate and support multidisciplinary scientific progress in both understanding the complexity of safety and developing and evaluating interventions. AHRQ has long been the federal leader in supporting multidisciplinary research in this area and needs to continue support for research on emerging safety threats and ongoing harm, because harm rates continue to be too high. Safety research should also be supported by the National Institutes of Health, whose institutes could expand their portfolios to include safety in the areas they address.

In addition, health systems must start to measure harm in a consistent and reliable way, using standard definitions, and they should publicly report harm rates. For this to happen, researchers must overcome methodological challenges, and robust metrics must be developed. Metrics are needed that can be reliably extracted from EHRs with limited burden on institutions, and measures must be judiciously tested for validity. When measures are inaccurate, as was the case with many of the Patient Safety Indicators,62 public reporting of harm rates can provide the wrong picture of which organizations are delivering safe care, which can lead patients to make the wrong choices and adversely affect the organizations.

Penalties for certain patient safety events should be carefully considered. Policies that prevent payment when harm occurs make sense on their face but can have perverse consequences, as organizations may simply under-code harms to avoid payment disincentives.63 The hospital-acquired condition program has been quite controversial, with large academic hospitals arguing that they have been unfairly penalized.64 Moreover, payment-based penalties can drive too much institutional attention to measures tied to payment, shifting attention and resources away from other safety issues.

Patient safety policies should ideally support a “learning health system” approach to safety, in which measurement on the front lines of care creates evidence for improvement. The evidence should be used in an ongoing way to develop interventions that are incorporated into practice. Health systems should conduct more embedded research,65 creating learning labs to understand safety problems, advancing the science, and pilot-testing improvement strategies. Policy makers must promote knowledge sharing, such as through the creation of a national clearinghouse or coordinating center to promote rapid knowledge exchange among health systems. After pilot-testing, accelerated implementation of best practices could be spread to other settings through large multi-institutional quality improvement collaboratives.66 The Veterans Affairs (VA) National Center for Patient Safety offers an example of a learning health system. The center not only promotes organization-wide learning in the VA but also funds patient safety centers of excellence nationally that focus on research and implementation, bringing to the bedside practical tools to improve safety.67

Health systems must start to expand their patient safety capacity and infrastructure to meet the demands of emerging safety issues, address recommendations from policy makers and other national stakeholders, and implement newly developed best practices. In a number of high-risk areas, scientific progress and evidence-based tools and strategies to improve safety still have not been translated into practice.68 Recently, AHRQ and the Institute for Healthcare Improvement launched a new National Steering Committee for Patient Safety to create a national action plan for preventing harm, which could address institutional capacity, priority setting, and thorny implementation issues that thwart progress in safety.

With the move to a health care system enabled by health IT, legislative or regulatory policies should be enacted to enable and encourage health systems to better use their EHR data for improving safety. Not only should EHR content such as clinical decision support and user-interface presentation be improved for safety purposes, but health systems should also extract key clinical and administrative data into enterprise data warehouses. This would facilitate complex, cross-patient queries to help identify areas for improvement and monitoring. Data scientists can help create condition-, location-, and procedure-specific dashboards to help clinicians and health systems monitor their performance in real time and predict which patients are most vulnerable to adverse events. Then increased monitoring could be done by front-line providers to prevent harm to patients who are at high risk.

Policy levers should also create mechanisms for shared responsibility for safety between health systems, care providers, industry, and relevant public and private agencies. One such mechanism would be a national safety center that leverages public-private partnership. The creation of a national center that would focus on health IT–related safety and enable key knowledge sharing has already been proposed.69 Such a center could help modify barriers to knowledge sharing contained in EHR software license agreements, nondisclosure provisions, and intellectual property protections. Loosening these provisions would enable better sharing of data related to patient safety.70

The period since To Err Is Human was published1 could be considered a Bronze Age in patient safety, when new tools—which may now be considered primitive—were developed and led to advances. Much has been learned about the epidemiology of safety, and while several effective solutions have been developed for some safety issues, their implementation and practice has been inconsistent. Despite progress in hospital-acquired infections and medication safety, there remain substantial opportunities for improvement—far more than any individual organization can afford to test or adopt. Progress in the prevention of patient harms such as pressure ulcers, deep venous thrombosis and embolism, and falls has been variable, even though some effective solutions are available. Even “never events” such as wrong-patient and wrong-site surgery still occur with disturbing frequency. Emerging priority areas include addressing harm related to outpatient care, diagnostic error, and health IT, as well as using newly available electronic data to improve safety

The next challenge in patient safety is the development and implementation of tools and strategies that enable organizations to measure and reduce harm both inside and outside the hospital, continuously and routinely. And as their effectiveness is demonstrated, policies that encourage and—when appropriate—require organizations to use these tools and strategies across multiple health care settings could lead us to the Golden Era of patient safety.

ACKNOWLEDGMENTS

David Bates consults for EarlySense, which makes patient safety monitoring systems. He receives cash compensation from CDI (Negev), Ltd., a not-for-profit incubator for health information technology start-ups. He receives equity from ValeraHealth, which makes software to help patients with chronic diseases. He receives equity from Intensix, which makes software to support clinical decision making in intensive care. He receives equity from MDClone, which takes clinical data and produces deidentified versions of it. His financial interests have been reviewed by Brigham and Women’s Hospital and Partners HealthCare in accordance with their institutional policies. Hardeep Singh’s research has been funded by the Veterans Affairs (VA) Health Services Research and Development Service (HSR&D) (CRE-12-033 and the Presidential Early Career Award for Scientists and Engineers USA 14-274), the Agency for Healthcare Research and Quality (R01HS022087 and R18HS017820), the VA National Center for Patient Safety, the Houston VA HSR&D Center for Innovations in Quality, Effectiveness, and Safety (CIN 13-413), and the Gordon and Betty Moore Foundation. Authors’ views do not represent those of any of the funders. An earlier version of the manuscript was presented at a working paper review session in Washington, D.C., April 10, 2018, organized by Health Affairs and supported by the Gordon and Betty Moore Foundation.

  • 1 Corrigan JM, Kohn LT, Donaldson MS editors. To err is human: building a safer health system. Washington (DC): National Academies Press; 1999. Google Scholar
  • 2 Altman DE, Clancy C, Blendon RJ. Improving patient safety—five years after the IOM report. N Engl J Med. 2004;351(20):2041–3. Crossref, Medline, Google Scholar
  • 3 Stelfox HT, Palmisani S, Scurlock C, Orav EJ, Bates DW. The To Err Is Human report and the patient safety literature. Qual Saf Health Care. 2006;15(3):174–8. Crossref, Medline, Google Scholar
  • 4 James JT. A new, evidence-based estimate of patient harms associated with hospital care. J Patient Saf. 2013;9(3):122–8. Crossref, Medline, Google Scholar
  • 5 Makary MA, Daniel M. Medical error—the third leading cause of death in the US. BMJ. 2016;353:i2139. Crossref, Medline, Google Scholar
  • 6 Hayward RA, Hofer TP. Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer. JAMA. 2001;286(4):415–20. Crossref, Medline, Google Scholar
  • 7 Shojania KG, Dixon-Woods M. Estimating deaths due to medical error: the ongoing controversy and why it matters. BMJ Qual Saf. 2017;26(5):423–8. Medline, Google Scholar
  • 8 Berenholtz SM, Pronovost PJ, Lipsett PA, Hobson D, Earsing K, Farley JEet al. Eliminating catheter-related bloodstream infections in the intensive care unit. Crit Care Med. 2004;32(10):2014–20. Crossref, Medline, Google Scholar
  • 9 Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove Set al. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006;355(26):2725–32. Crossref, Medline, Google Scholar
  • 10 Chassin MR, Loeb JM. The ongoing quality improvement journey: next stop, high reliability. Health Aff (Millwood). 2011;30(4):559–68. Go to the article, Google Scholar
  • 11 Shabot MM, Chassin MR, France AC, Inurria J, Kendrick J, Schmaltz SP. Using the Targeted Solutions Tool® to improve hand hygiene compliance is associated with decreased health care-associated infections. Jt Comm J Qual Patient Saf. 2016;42(1):6–17. Crossref, Medline, Google Scholar
  • 12 Agency for Healthcare Research and Quality. National scorecard on rates of hospital-acquired conditions 2010 to 2015: interim data from national efforts to make health care safer [Internet]. Rockville (MD): AHRQ; [last reviewed 2016 Dec; cited 2018 Sep 24]. Available from: http://www.ahrq.gov/professionals/quality-patient-safety/pfp/2015-interim.html Google Scholar
  • 13 Pronovost PJ, Cleeman JI, Wright D, Srinivasan A. Fifteen years after To Err Is Human: a success story to learn from. BMJ Qual Saf. 2016;25(6):396–9. Crossref, Medline, Google Scholar
  • 14 Leapfrog Group. New data shows infection rates still too high in U.S. hospitals [Internet]. Washington (DC): Leapfrog Group; 2016 Mar 16 [cited 2018 Sep 24]. Available from: http://www.leapfroggroup.org/news-events/new-data-shows-infection-rates-still-too-high-us-hospitals Google Scholar
  • 15 Pham JC, Goeschel CA, Berenholtz SM, Demski R, Lubomski LH, Rosen MAet al. CLABSI conversations: lessons from peer-to-peer assessments to reduce central line–associated bloodstream infections. Qual Manag Health Care. 2016;25(2):67–78. Crossref, Medline, Google Scholar
  • 16 Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi Det al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. JAMA. 1995;274(1):29–34. Crossref, Medline, Google Scholar
  • 17 Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163(12):1409–16. Crossref, Medline, Google Scholar
  • 18 Prgomet M, Li L, Niazkhani Z, Georgiou A, Westbrook JI. Impact of commercial computerized provider order entry (CPOE) and clinical decision support systems (CDSSs) on medication errors, length of stay, and mortality in intensive care units: a systematic review and meta-analysis. J Am Med Inform Assoc. 2017;24(2):413–22. Medline, Google Scholar
  • 19 Bates DW, Leape LL, Cullen DJ, Laird N, Petersen LA, Teich JMet al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280(15):1311–6. Crossref, Medline, Google Scholar
  • 20 Poon EG, Keohane CA, Yoon CS, Ditmore M, Bane A, Levtzion-Korach Oet al. Effect of bar-code technology on the safety of medication administration. N Engl J Med. 2010;362(18):1698–707. Crossref, Medline, Google Scholar
  • 21 Poon EG, Cina JL, Churchill W, Patel N, Featherstone E, Rothschild JMet al. Medication dispensing errors and potential adverse drug events before and after implementing bar code technology in the pharmacy. Ann Intern Med. 2006;145(6):426–34. Crossref, Medline, Google Scholar
  • 22 Wang SJ, Middleton B, Prosser LA, Bardon CG, Spurr CD, Carchidi PJet al. A cost-benefit analysis of electronic medical records in primary care. Am J Med. 2003;114(5):397–403. Crossref, Medline, Google Scholar
  • 23 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010;19(Suppl 3):i68–74. Crossref, Medline, Google Scholar
  • 24 Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EPet al. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009;360(5):491–9. Crossref, Medline, Google Scholar
  • 25 Taylor SL, Dy S, Foy R, Hempel S, McDonald KM, Ovretveit Jet al. What context features might be important determinants of the effectiveness of patient safety practice interventions? BMJ Qual Saf. 2011;20(7):611–7. Crossref, Medline, Google Scholar
  • 26 Starmer AJ, Spector ND, Srivastava R, West DC, Rosenbluth G, Allen ADet al. Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371(19):1803–12. Crossref, Medline, Google Scholar
  • 27 Bloom N, Van Reenen J. Measuring and explaining management practices across firms and countries. Q J Econ. 2007;122(4):1351–408. Crossref, Google Scholar
  • 28 Nuclear Regulatory Commission. HRO safety culture definition: an integrated approach [Internet]. Washington (DC): NRC; 2010 Jan [cited 2018 Sep 24]. Available from: https://www.nrc.gov/about-nrc/regulatory/enforcement/hro-sc-collins.pdf Google Scholar
  • 29 Sutcliffe KM, Paine L, Pronovost PJ. Re-examining high reliability: actively organising for safety. BMJ Qual Saf. 2017;26(3):248–51. Crossref, Medline, Google Scholar
  • 30 California Hospital Patient Safety Organization. Laws and regulations [Internet]. Sacramento (CA): CHPSO; [cited 2018 Sep 24]. Available from: http://www.chpso.org/laws-and-regulations Google Scholar
  • 31 Sammer C, Miller S, Jones C, Nelson A, Garrett P, Classen Det al. Developing and evaluating an automated all-cause harm trigger system. Jt Comm J Qual Patient Saf. 2017;43(4):155–65. Crossref, Medline, Google Scholar
  • 32 McNair PD, Luft HS, Bindman AB. Medicare’s policy not to pay for treating hospital-acquired conditions: the impact. Health Aff (Millwood). 2009;28(5):1485–93. Go to the article, Google Scholar
  • 33 Winters BD, Bharmal A, Wilson RF, Zhang A, Engineer L, Defoe Det al. Validity of the Agency for Healthcare Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-Acquired Conditions: a systematic review and meta-analysis. Med Care. 2016;54(12):1105–11. Crossref, Medline, Google Scholar
  • 34 Lee GM, Kleinman K, Soumerai SB, Tse A, Cole D, Fridkin SKet al. Effect of nonpayment for preventable infections in U.S. hospitals. N Engl J Med. 2012;367(15):1428–37. Crossref, Medline, Google Scholar
  • 35 Henriksen K, Isaacson S, Sadler BL, Zimring CM. The role of the physical environment in crossing the quality chasm. Jt Comm J Qual Patient Saf. 2007;33(11, Suppl):68–80. Crossref, Medline, Google Scholar
  • 36 Joseph A, Rashid M. The architecture of safety: hospital design. Curr Opin Crit Care. 2007;13(6):714–9. Crossref, Medline, Google Scholar
  • 37 Singh H, Meyer AN, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf. 2014;23(9):727–31. Crossref, Medline, Google Scholar
  • 38 Medford-Davis L, Park E, Shlamovitz G, Suliburk J, Meyer AN, Singh H. Diagnostic errors related to acute abdominal pain in the emergency department. Emerg Med J. 2016;33(4):253–9. Crossref, Medline, Google Scholar
  • 39 National Academies of Sciences, Engineering, and Medicine. Improving diagnosis in health care. Washington (DC): National Academies Press; 2015. Google Scholar
  • 40 Graber ML. The incidence of diagnostic error in medicine. BMJ Qual Saf. 2013;22(Suppl 2):ii21–7. Crossref, Medline, Google Scholar
  • 41 Schiff GD, Hasan O, Kim S, Abrams R, Cosby K, Lambert BLet al. Diagnostic error in medicine: analysis of 583 physician-reported errors. Arch Intern Med. 2009;169(20):1881–7. Crossref, Medline, Google Scholar
  • 42 Zwaan L, Monteiro S, Sherbino J, Ilgen J, Howey B, Norman G. Is bias in the eye of the beholder? A vignette study to assess recognition of cognitive biases in clinical case workups. BMJ Qual Saf. 2017;26(2):104–10. Crossref, Medline, Google Scholar
  • 43 Giardina TD, King BJ, Ignaczak AP, Paull DE, Hoeksema L, Mills PDet al. Root cause analysis reports help identify common factors in delayed diagnosis and treatment of outpatients. Health Aff (Millwood). 2013;32(8):1368–75. Go to the article, Google Scholar
  • 44 Graber ML, Rusz D, Jones ML, Farm-Franks D, Jones B, Cyr Gluck Jet al. The new diagnostic team. Diagnosis (Berl). 2017;4(4):225–38. Crossref, Medline, Google Scholar
  • 45 Graber ML, Bailey R, Johnston D (RTI International, Research Triangle Park, NC). Goals and priorities for health care organizations to improve safety using health IT: revised report [Internet]. Washington (DC): Department of Health and Human Services, Office of the National Coordinator for Health Information Technology; 2016 May [cited 2018 Sep 25]. Available from: https://www.healthit.gov/sites/default/files/task_9_report.pdf Google Scholar
  • 46 National Quality Forum. Improving diagnostic quality and safety: final report [Internet]. Washington (DC): NQF; 2017 Sep 19 [cited 2018 Sep 25]. Available for download from: https://www.qualityforum.org/Publications/2017/09/Improving_Diagnostic_Quality_and_Safety_Final_Report.aspx Google Scholar
  • 47 Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AN, Singh H. Electronic trigger-based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol. 2015;33(31):3560–7. Crossref, Medline, Google Scholar
  • 48 El-Kareh R, Hasan O, Schiff GD. Use of health information technology to reduce diagnostic errors. BMJ Qual Saf. 2013;22(Suppl 2):ii40–51. Crossref, Medline, Google Scholar
  • 49 Schiff GD, Bates DW. Can electronic clinical documentation help prevent diagnostic errors? N Engl J Med. 2010;362(12):1066–9. Crossref, Medline, Google Scholar
  • 50 Wachter RM. Is ambulatory patient safety just like hospital safety, only without the “stat”? Ann Intern Med. 2006;145(7):547–9. Crossref, Medline, Google Scholar
  • 51 Agency for Healthcare Research and Quality. Patient safety in ambulatory settings [Internet]. Rockville (MD): AHRQ; 2016 Oct [cited 2018 Sep 25]. (Technical Brief No. 27). Available from: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/ambulatory-safety_technical-brief.pdf Google Scholar
  • 52 Crowley RA. Patient safety in the office-based practice setting [Internet]. Philadelphia (PA): American College of Physicians; 2017 [cited 2018 Sep 25]. (Position Paper). Available from: https://www.acponline.org/acp_policy/policies/patient_safety_in_the_office_based_practice_setting_2017.pdf Google Scholar
  • 53 Slawomirski L, Auraaen A, Klazinga N. The economics of patient safety in primary and ambulatory care: flying blind [Internet]. Paris: Organization for Economic Cooperation and Development; c 2018 [cited 2018 Sep 25]. Available from: http://www.oecd.org/health/health-systems/The-Economics-of-Patient-Safety-in-Primary-and-Ambulatory-Care-April2018.pdf Google Scholar
  • 54 World Health Organization. Patient safety: safer primary care [Internet]. Geneva; WHO; c 2018 [cited 2018 Sep 25]. Available from: http://www.who.int/patientsafety/topics/primary-care/en/ Google Scholar
  • 55 Radecki RP, Sittig DF. Application of electronic health records to the Joint Commission’s 2011 National Patient Safety Goals. JAMA. 2011;306(1):92–3. Crossref, Medline, Google Scholar
  • 56 ECRI Institute [Internet]. Plymouth Meeting (PA): ECRI Institute. News release, Partnership for Health IT Patient Safety issues recommendations for the safe use of health IT for patient identification; 2017 Feb 20 [cited 2018 Sep 25]. Available from: https://www.ecri.org/press/Pages/HITPS-Issues-Recommendations-for-Patient-Identification.aspx Google Scholar
  • 57 Sittig DF, Singh H. Electronic health records and national patient-safety goals. N Engl J Med. 2012;367(19):1854–60. Crossref, Medline, Google Scholar
  • 58 Wright A, Ai A, Ash J, Wiesen JF, Hickman TT, Aaron Set al. Clinical decision support alert malfunctions: analysis and empirically derived taxonomy. J Am Med Inform Assoc. 2018;25(5):496–506. Crossref, Medline, Google Scholar
  • 59 Wang MD, Khanna R, Najafi N. Characterizing the source of text in electronic health record progress notes. JAMA Intern Med. 2017;177(8):1212–3. Crossref, Medline, Google Scholar
  • 60 Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in electronic health record-based settings. JAMA Intern Med. 2013;173(8):702–4. Crossref, Medline, Google Scholar
  • 61 Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med. 2018;169(1):50–1. Crossref, Medline, Google Scholar
  • 62 Ramanathan R, Leavell P, Stockslager G, Mays C, Harvey D, Duane TM. Validity of Agency for Healthcare Research and Quality Patient Safety Indicators at an academic medical center. Am Surg. 2013;79(6):578–82. Medline, Google Scholar
  • 63 Rau J. More than 750 hospitals face Medicare crackdown on patient injuries. Kaiser Health News [serial on the Internet]. 2014 Jun 22 [cited 2018 Sep 25]. Available from: https://khn.org/news/patient-injuries-hospitals-medicare-hospital-acquired-condition-reduction-program/ Google Scholar
  • 64 Rajaram R, Chung J, Kinnier C, Barnard C, Mohanty S, Pavey Eet al. Hospital characteristics associated with penalties in the Centers for Medicare and Medicaid Services Hospital-Acquired Condition Reduction Program. JAMA. 2015;314(4):375–83. Crossref, Medline, Google Scholar
  • 65 Bindman AB, Pronovost PJ, Asch DA. Funding innovation in a learning health care system. JAMA. 2018;319(2):119–20. Crossref, Medline, Google Scholar
  • 66 Rinke ML, Singh H, Heo M, Adelman JS, O’Donnell HC, Choi SJet al. Diagnostic errors in primary care pediatrics: Project RedDE. Acad Pediatr. 2018;18(2):220–7. Crossref, Medline, Google Scholar
  • 67 Department of Veterans Affairs. VA National Center for Patient Safety: Patient Safety Centers of Inquiry (PSCI) [Internet]. Washington (DC): The Department; [last updated 2018 Mar 8; cited 2018 Sep 25]. Available from: https://www.patientsafety.va.gov/professionals/centers.asp Google Scholar
  • 68 National Quality Forum. Identification and prioritization of health IT patient safety measures: final report [Internet]. Washington (DC): NQF; 2016 Feb 11 [cited 2018 Sep 25]. Available for download from: http://www.qualityforum.org/Publications/2016/02/Identification_and_Prioritization_of_HIT_Patient_Safety_Measures.aspx Google Scholar
  • 69 Institute of Medicine. Health IT and patient safety: building safer systems for better care. Washington (DC): National Academies Press; 2012. Google Scholar
  • 70 Sittig DF, Belmont E, Singh H. Improving the safety of health information technology requires shared responsibility: it is time we all step up. Healthc (Amst). 2018;6(1):7–12. Crossref, Medline, Google Scholar


Page 2

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.


Download article citation data for: