FRONT PAGE : | TECH | Op-Ed Page | About | Advertise | List
THCB UPDATE Get email updates of new posts and industry news.
facebook

June 02, 2008

Why diagnostic errors don't get any respect and what can be done about it

I gave a keynote yesterday to the first-ever meeting on "Diagnostic Error in Medicine." I hope the confab helps put diagnostic errors on the safety map. But, as Ricky Ricardo said, the experts and advocates in the audience have some 'splainin' to do.

I date the origin of the patient safety field to the publication of the IOM report on medical errors (To Err is Human). It is the field’s equivalent of the Birth of Christ (as in, there was before, and there is after). But from the get-go, diagnostic errors were the ugly stepchild of the safety family. I searched the text of To Err… and found that the term “medication errors” is mentioned 70 times, while “diagnostic errors” appears twice. This is interesting because diagnostic errors comprised 17 percent of the adverse events in the Harvard Medical Practice Study (from which the IOM’s 44,000 to 98,000 deaths numbers were drawn), and account for twice as many malpractice suits as medication errors.

What I call “Diagnostic Errors Exceptionalism” has persisted ever since. Think about the patient safety issues that are on today’s public radar screen (i.e., they are subject to public reporting, included in “no pay for errors,” examined during Joint Commission visits, etc.). It’s a pretty diverse group, including medication mistakes, falls, decubitus ulcers, wrong-site surgery, and hospital-acquired infections. But not diagnostic errors. Funny, huh?

There are lots of reasons for this. Here are just a few:

The Problem of Visceral, Accessible Dread
Ask any horror movie producer – certain calamities cause visceral dread. They tend to be “bolt out of the blue” events – ones that lack both forewarning and opportunities for post-strike redemption. (Think sharks, plane crashes, tsunamis, and earthquakes.) But diagnostic errors often have complex causal pathways, take time to play out, and may not kill for hours (missed MI), days (missed meningitis) or even years (missed cancers). They don’t pack the same visceral wallop as wrong-site surgery, the “shark bit off a guy's leg” of the safety field.

Iconic, Mediagenic Examples
Think about the errors that have made 60 Minutes in the past decade or so: the chemotherapy error that killed Boston Globe health columnist Betsy Lehman, the Duke transplant mix-up involving failure to check ABO type, the amputation of Willie King’s wrong leg, even Dennis Quaid’s twins’ heparin OD. How about diagnostic errors? Personally, I can’t think of one that ended up in the spot lights. The one mediagenic error that was (at least in part) due to a diagnostic error – the death of Libby Zion at New York Hospital in the 1980s – was framed as a death caused by long residency work hours and poor supervision, not as one caused by a diagnostic error.

Data Suitable to Create Sound Bites
These are great sound bites (I’ve used them many times myself):

    * “The average hospitalized patient experiences one medication error a day.”
    * “The average ICU patient has 1.7 errors per day in their care.”

We have no comparable data for diagnostic errors, and so they don’t compete very well for attention. In fact, this measurement problem (diagnostic errors are very hard to measure, particularly through retrospective chart review) is a huge issue. How are we to convince policymakers and hospital executives, who are now obsessing about lowering the rates of hospital-acquired infections and falls, to focus on diagnostic errors when their toll is so vague?

Some Research (or at Least Common Sense) Points to Solutions
Many traditional types of errors can be paired with well-understood solutions, some of which even have data demonstrating that they work. Just consider these:

    * Prescribing errors: computerized order entry
    * Drug administration errors: bar coding and smart pumps
    * Failure in rote processes: double checks, checklists
    * Wrong-site surgery: sign the site
    * Retained sponges in surgery: count ‘em up

The solutions for diagnostic errors generally fall into two big buckets. One might be thought of as “better thinking” -- appreciating the risks of certain heuristics (anchoring, premature closure), correctly applying Bayesian reasoning and Iterative Hypothesis Testing, and so on. This group of activities, while fascinating (building on the groundbreaking work of brilliant cognitive psychologists like Amos Tversky and Daniel Kahneman), is a bit too arcane for real people to get their arms around. It seems like inside baseball.

The other broad bucket of proposed solutions to diagnostic errors involves various forms of computerized decision support. Providing computerized diagnostic support – and perhaps even some artificial intelligence (AI) – at the point-of-care makes all the sense in the world. But remember the Technology Hype Cycle from a few blogs back. Diagnostic AI was way overhyped in the 1970s and 80s, much of the hype focused on several programs that titillated the IT wonks of the day (such as QMR and Iliad) but are now in the IT dustbin of history. Turns out that replacing a doctor’s diagnostic abilities with a computer is an incredibly knotty problem (partly because the symptoms, signs, and initial labs in flu and plague have about 95 percent overlap). The disappointment over the ineffectiveness of early AI programs led to widespread skepticism that any decision support programs could help physicians be better diagnosticians. This skepticism is getting in the way of today’s markedly improved systems, such as Isabel, from gaining the traction they deserve.

So solutions for diagnostic errors – whether new ways of training people to think or computerized decision support – do not compete very effectively in the battle for resources and attention against far more easily implemented and better researched solutions to other safety problems, such as “bundles” to prevent catheter infections or ventilator-associated pneumonia.

The Problem of the Accountable Entity
One final problem is the absence of an accountable entity with deep pockets. Because the patient safety field focused its attention on hospital errors (at least initially), the hospital – rather than individual physicians – could be held accountable (by the Joint Commission, CMS, the state, and the media) for creating safer systems. And hospitals have stepped up to this particular plate, by putting safety atop their strategic plans, and by implementing incident reporting systems, patient safety officers, CPOE, root cause analysis, teamwork training, and more. They had no choice.

But if diagnostic errors are seen as individual physician cognitive problems, then the hospital is unlikely to contribute to their solution, or even to pay much attention to them. And so they haven’t, and they don’t.

What Can Be Done?
Is there any hope of getting diagnostic errors included under the broad umbrella of patient safety, where they can garner the attention and resources they deserve? Sure. But we need to solve a chicken-or-egg problem: If there is no interest and funding in the topic, we won’t generate the research we need to measure the toll of the problem or come up with effective solutions. And then there won’t be funding and interest.

That’s why AHRQ’s sponsorship of the Diagnostic Errors Conference, and the agency’s overall interest in the topic, is so crucial. Having allies in high places, beginning with AHRQ and other funders, but extending to malpractice carriers, accreditation boards, med schools and residencies, and even the Joint Commission, will be essential.

Judging by the robust sales of Jerome Groopman’s book, How Doctors Think, the public is interested in this topic. Passionate and effective leaders and advocates, most of whom were in Phoenix yesterday, are emerging. If we can find some support for their work, better data and solutions cannot be too far behind. And then the problem of diagnostic errors will get the attention it deserves.

As the quality and safety movements gallop along, the need to fix Diagnostic Errors Exceptionalism grows more pressing. For until we do, we face a fundamental problem: a hospital can be seen as high quality hospital – receiving awards for being a great performer and oodles of cash from P4P programs – if all of its “pneumonia” patients receive the correct antibiotics, all its “CHF” patients are prescribed ACE inhibitors, and all its “MI” patients get aspirin and beta blockers.

Even if every one of the diagnoses was wrong.

June 2, 2008 in Bob Wachter, Hospitals, Patient Safety, Physicians | Permalink

Comments

I am surprised that Dr. Wachter does not mention the big question: How is a preventable (I assume he is not interested in the unpreventable ones) diganostic error defined? I am sure Dr. Wachter knows from his own experience that there is a lot of disease that presents in an atypical or entirely nonspecific manner, especially early. If a doctor did not catch it, at what point would you blame him for not making the correct diagnosis (or referring to a specialist, or a tertiary care center/subspecialist). Are doctors entitled to make mistakes (to a certain extent)? I am always sure that almost everyone agrees that the borders here are ill defined, with a large gray area between acceptable practice and mistake - that is basically what a lot of malpractice suits are about ("failure to diagnose").

To answer my own question, I think that hospitals/boards should formally review only egregious diagnostic errors ... but that all institutions involved into teaching (residency programs, CME lectures) should be obliged to identify and address preventable diagnostic errors. Identification happens by review of malpractice cases (this already occasionally happens), or, with a much better yield, by a no fault self report mechanism.

Posted by: rbar | Jun 2, 2008 7:29:25 AM

Seconding rbar's comment: a diagnostic error can only be tallied only if a second diagnosis contradicting the first (and apparently incorrect) diagnosis is made. For that matter, there is no guarantee that the subsequent diagnosis is necessarily right.

You may have to rank diagnostic errors as dramatic swings in probability, since a diagnosis is really much more a statement of probability ("you probably have this disease") rather than a statement of certainty ("you definitely have this disesase"). Also, Finding a "gold standard" to verify diagnoses may be too costly or too difficult.

Posted by: Jerry Tsai | Jun 2, 2008 10:31:16 AM

Thought-provoking post for all of us. I spend a lot of time agonizing over my own misdiagnoses, now that I'm working largely on my own. I wish we could encourage informal collaborative problem-solving (i.e. residency-style case conferences, not to impress but to go through decision-making processes). Not enough of these in my rural area.

I responded to Dr. Wachter's post in depth here: http://tinyurl.com/4o6hf2

Posted by: Theresa Chan | Jun 4, 2008 9:35:16 AM

Post a comment