Unblinding measure needs validation
In an interview, Roy M. Fleischmann, MD, co–medical director of the Metroplex Clinical Research Center in Dallas, raised some objections to the paper. The paper addresses an interesting question about unblinding, but there should have been more work done, such as finding “a measure that is validated that can say whether you’ve been unblinded or not.”
He added that he was surprised the paper on unblinding in rheumatology trials was published in its current form.
“I would have sent it for a major rewrite” if asked to review this paper before publication, said Dr. Fleischmann, who as a reviewer for Lancet Rheumatology. “I would have said: ‘Okay, 90% of this paper is okay, but your gist is not correct.’ It should be: ‘Is this a problem?’ ”
Dr. Fleischmann said he would have recommended a different perspective to the paper. “That is, this could occur. Should we be looking at this, and how would we look at this?”
In the paper, the authors acknowledge their approach has not been validated, “but it highlights the potential effect of idiosyncratic adverse events,” they wrote.
There’s less funding in general for meta-research than for studies involving treatments, so researchers look for approaches that can be handled without requiring significant funding, and much of the research on the quality of research is conducted like this analysis of rheumatology trials, Michael Putman, MD, the corresponding author and is a rheumatologist and an assistant professor at the Medical College of Wisconsin, said in an interview.
“You’re mostly doing on a shoestring budget with yourself and trainees,” he said. Dr. Putman is an associate editor at the journal Rheumatology and also involved in meta-research, or efforts to understand how studies and trials answer questions about how medical treatments work.
In an Aug. 16 tweet, Dr. Putman said this issue of unintentional unblinding with rheumatology trials was something he’d “been ruminating about for awhile; took two all star trainees to push it over the top!”
One of the barriers to funding of meta-research is a tendency for major funding for medical studies to be focused on specific diseases or targets. With meta-research, it may be more difficult to explain how a specific project will advance efforts to treat or prevent a certain disease, Dr. Putman said.
“It’s a little more esoteric and maybe not quite as clear how these projects will move things forward,” Dr. Putman said.
In addition, the nature of meta-research is to question and often be critical of work that’s already been published, adding another hurdle in attempts to secure funding, he said.
Dr. Putman is supported by a Rheumatology Research Foundation Scientist Development Grant, receives research funding related to clinical trials by AbbVie and AstraZeneca, and consulting fees from Novartis. The other authors declared no competing interests.