Hard Talk

The cult of the suicide risk assessment


 

Provider liability

Another concern is the liability placed on providers. A common problem encountered in the inpatient setting is insurance companies refusing to reimburse a hospital stay for depressed patients denying suicidality.

Any provider in the position of caring for such a patient must ask: What is the likelihood of someone providing a false negative – a false denial of suicidality? Is the likelihood of a suicidal person denying suicidality different if asked 5 or 10 or more times in a day? There are innumerable instances where a patient at a very high risk of self-harm has denied suicidality, been discharged from the hospital, and suffered terrible consequences. Ethically, the psychiatrist aware of this risk is no more at ease discharging these patients, whether it is one suicide risk scale or a dozen that suggests a patient is at low risk.

Alternatively, it may feel untenable from a medicolegal perspective for a psychiatrist to discharge a patient denying suicidality when the chart includes over a dozen previously documented elevated suicide risk assessments in the past 72 hours. By placing the job of suicide risk assessment in the hands of providers of varying levels of training and responsibility, a situation is created in which the seasoned psychiatrist who would otherwise be comfortable discharging a patient feels unable to do so because every other note-writer in the record – from the triage nurse to the medical assistant to the sitter in the emergency department – has recorded the patient as high risk for suicide. When put in such a position, the thought often occurs that systems of care, rather than individual providers, are protected most by ever escalating requirements for suicide risk documentation. To make a clinical decision contrary to the body of suicide risk documentation puts the provider at risk of being scapegoated by the system of care, which can point to its illogical and ineffective, though profusely documented, suicide prevention protocols.

Limitations of risk assessments

Considering the ongoing rise in the use of suicide risk assessments, one would expect that the evidence for their efficacy was robust and well established. Yet a thorough review of suicide risk assessments funded by the MacArthur Foundation, which examined decades of research, came to disheartening conclusions: “predictive ability has not improved over the past 50 years”; “no risk factor category or subcategory is substantially stronger than any other”; and “predicting solely according to base rates may be comparable to prediction with current risk factors.”5

Those findings were consistent with the conclusions of many other studies, which have summarized the utility of suicide risk assessments as follows: “occurrence of suicide is too low to identify those individuals who are likely to die by suicide”;6 “suicide prediction models produce accurate overall classification models, but their accuracy of predicting a future event is near zero”;7 “risk stratification is too inaccurate to be clinically useful and might even be harmful”;8 “suicide risk prediction [lacks] any items or information that to a useful degree permit the identification of persons who will complete suicide”;9 “existing suicide prediction tools have little current clinical value”;10 “our current preoccupation with risk assessment has ... created a mythology with no evidence to support it.”11 And that’s to cite just a few.

Sadly, we have known about the limitations of suicide risk assessments for many decades. In 1983 a large VA prospective study, which aimed to identify veterans who will die by suicide, examined 4,800 patients with a wide range of instruments and measures.12 This study concluded that “discriminant analysis was clearly inadequate in correctly classifying the subjects. For an event as rare as suicide, our predictive tools and guides are simply not equal to the task.” The authors described the feelings of many in stating “courts and public opinion expect physicians to be able to pick out the particular persons who will later commit suicide. Although we may reconstruct causal chains and motives, we do not possess the tools to predict suicides.”

Yet, even several decades prior, in 1954, Dr. Albert Rosen performed an elegant statistical analysis and predicted that, considering the low base rate of suicide, suicide risk assessments are “of no practical value, for it would be impossible to treat the prodigious number of false positives.”13 It seems that we continue to be unable to accept Dr. Rosen’s premonition despite decades of confirmatory evidence.

Next Article: