Latest News

How racist is your algorithm?


 

Waiting for alternatives

The University of Maryland Medical System last year embarked on a project similar to the AAP initiative but within its own system. The first use of race to be eliminated was in the eGFR. The health system also recently removed the variable from a tool for diagnosing urinary tract infections (UTIs) in children younger than 2 years.

Part of that tool includes deciding to perform a catheterized urine test. If a doctor chose “White” as the race, the tool would recommend the test. If the doctor chose “Black,” the tool would recommend to not test. Joseph Wright, MD, MPH, chief health equity officer at University of Maryland Medical System, said this step in the tool is based on the unproven assumption that young Black children had a lower likelihood of UTIs than their White peers.

“We simply want folks to not by default lob race in as a decisionmaking point when we have, with a little bit more scientific diligence, the ability to include better clinical variables,” Dr. Wright, who is also an adjunct professor of health policy and management at the University of Maryland School of Public Health, College Park, said.

The developers of the UTI tool recently released a revised version that removes race in favor of two new medical datapoints: whether the patient has had a fever for over 48 hours, and whether the patient has previously had a UTI.

The process of re-examining tools, coming up with new datapoints, and implementing changes is not simple, according to Dr. Wright.

“This is just the baby step to fix the algorithms, because we’re all going to have to examine our own house, where these calculators live, whether it’s in a textbook, whether it’s in an electronic health record, and that’s the heavy lift,” he said. “All sources of clinical guidance have to be scrutinized, and it’s going to literally take years to unroot.”

Electronic medical record vendor Cerner said it generally revises its algorithms after medical societies make changes, then communicates those fixes to providers.

Rebecca C. Winokur, MD, MPH, lead physician executive and health equity service line leader at Cerner, explained that if doctors ordered an eGFR a year ago and then another today, the results might be different because of the new code that eliminates race.

“The numbers are so different, how do you know that the patient may or may not have the same function?” Dr. Winokur said.

Dr. Winokur said the company is trying to determine at which point a message should pop up in the records workflow that would inform clinicians that they may be comparing apples to cherries. The company also is reconsidering the use of race in tools that estimate the probability of a successful vaginal birth after prior cesarean delivery, a calculator that predicts the risk of urethral stones in patients with flank pain, and another that measures lung function to help diagnose pulmonary disease.

In addition to managing the logistics of removing race, health institutions also need buy-in from clinicians. At Mass General Brigham, Boston, Thomas Sequist, MD, MPH, chief medical officer, is leading a project to examine how the system uses race in calculators.

“People struggle mainly with, well, if we shouldn’t use this calculator, what should we use, because we need a calculator. And that’s a legitimate question,” Dr. Sequist said in an interview. “If we’re going to stop using this race-based calculator, I still need to know what dose of medication I give my patient. We’re not going to pull any of these calculators until we have a safe and reliable alternative.”

For each calculator, relevant specialty chiefs come to the table with Dr. Sequist and his team; current projects include examining bone density screenings and cardiac risk scores. A large part of the work is communicating the lack of science behind the inclusion of race as a variable.

“It’s hard because these tools have been in existence for decades, and people are used to using them,” Dr. Sequist said. “So this is a big-change management project.”

Some clinicians also have difficulty discerning why their health system may stratify patient outcomes by race while providers are being told that race is being removed from the calculators they use every day. The key difference is that stratifying outcomes by race illuminates systemic problems that can be targeted by a health system.

For instance, if readmission rates are higher for Black patients overall after surgery, the reason might be that nurses are not delivering the same level of care to them as they are to non-Black patients, possibly because of hidden bias. Or, perhaps Black patients at a hospital have less access to transportation for follow-up appointments after surgery. The potential reasons can be investigated, and solutions can be created.

“If you look at a population level, what you’re looking for is not for the evidence of race as a biological construct,” Dr. Chomilo said. “You’re looking for the impact of racism on populations, and that’s the difference: It’s racism, not race.”

A version of this article first appeared on Medscape.com.

Pages

Next Article: