Bioethics Blogs

Methodological Miasma not mental dystrophy plagues drug trials

by Arthur Caplan, Ph.D. and Bruce Levin, Ph.D.

The Wall Street Journal and many other media outlets chose to beat on the FDA for its recent decision to deny approval of eteplirsen, a treatment for Duchenne muscular dystrophy being developed by Sarepta Therapeutics.

Actually it was the FDA’s scientific advisors not the FDA who concluded that there wasn’t sufficient evidence the drug was effective.

Still the WSJ sneered that “Here’s the gist of FDA’s objection: 12 patients are too few, and thus we don’t know if the drug helps boys walk longer or if the results are skewed. FDA prefers large trials that inject half of patients with a placebo. The agency has all but told patients to blame the lack of approval on Sarepta for its trial design.”

It is not just the FDA but most of the scientific community that prefers large placebo trials that produce stronger evidence. But both the WSJ, other FDA bashers and the FDA’s scientific advisors need to move the ball forward on trials. It is not placebo-controls but the importance of randomization in small trials that ought to be the issue for demonstrating safety and efficacy in any trial using small numbers.

In the comparison of eteplirsen to the matched control group there was no randomization.

Consider this fourfold table:

Still walking    Not still walking     Total

Treated                  10                      2                  12

Comparison             1                    10                  11

The P-value for testing the null hypothesis of no difference is 0.0006.  The likelihood ratio weight of evidence in favor of an efficacy hypothesis and against the null hypothesis is 71.6—that is generally considered quite strong evidence.

The views, opinions and positions expressed by these authors and blogs are theirs and do not necessarily represent that of the Bioethics Research Library and Kennedy Institute of Ethics or Georgetown University.