Quotes from critics of the PACE trial

The PACE trial received a substantial amount of criticism from various experts. The following includes a selection of quotes about the PACE trial from supporters and critics.

Action for ME - Sonya Chowdhury

Seven years after the publication of the PACE trial, and shortly after the the re-analysis of the PACE trial patient data, Action for ME Chief Executive Sonya Chowdhury published a statement stating:

"By having a role on the [PACE trial] Steering Committee and Management Group, there was a de facto endorsement of the use of £5m of research funding to focus on behavioural treatments. Neither I nor the current Board of Trustees would agree to do this now, as reflected by our current research strategy, the focus of which is collaborative biomedical research.

"I am sorry that the charity did not advocate for this considerable level of funding to be invested in biomedical research instead. It was never our intention to contribute to any stigma or misunderstanding about the illness and I sincerely apologise to those who feel that, in not speaking out sooner and more strongly, we have caused harm... "

In the same statement, Sonya Chowdhury added:

"A summary of our position

"Action for M.E. does not support any treatment approach:

• based on the deconditioning hypothesis

in which patients' legitimate concerns about the consequences of exercise are dismissed or ignored.

"We fully support treatment approaches which:

- aim to reduce and stabilise symptoms before any appropriate increase in activity levels is attempted - put the person with M.E./CFS in charge of the aims and goals of the overall management plan."

The statement went on to say that they "fully support" an approach based on pacing and setting shared goals, in order for patients to maximise their functioning.

Trevor Butterworth

Trevor Butterworth is the Editor of Sense About Statistics, an online collaboration between the American Statistical Association and Sense About Science USA.

"...the way PACE was designed and redesigned means it cannot provide reliable answers to the questions it asked. There is really not a lot that can be said to mitigate that; it’s a terminal prognosis."

Professor James Coyne

Professor Coyne is Professor of Health Psychology, University Medical Center, Groningen and University of the Netherlands; Distinguished Visiting Professor at the Institute for Health Policy, Rutgers, the State University of New Jersey; and Professor Emeritus of Psychology in the Department of Psychiatry, University of Pennsylvania. He is one of the most cited psychologists in the academic literature.

"The data presented are uninterpretable. We can temporarily suspend critical thinking and some basic rules for conducting randomized trials (RCTs), follow-up studies, and analyzing the subsequent data. Even if we do, we should reject some of the interpretations offered by the PACE investigators as unfairly spun to fit what [is] already a distorted positive interpretation of the results."

"The self-report measures do not necessarily capture subjective experience, only forced choice responses to a limited set of statements."

"One of the two outcome measures, the physical health scale of the SF-36 requires forced choice responses to a limited set of statements selected for general utility across all mental and physical conditions."

"The validity [of the] other primary outcome measure, the Chalder Fatigue Scale depends heavily on research conducted by this investigator group and has inadequate validation of its sensitivity to change in objective measures of functioning."

Professor Coyne gave a public talk criticising the PACE trial in Edinburgh in November 2015. Video footage is available, as are a slide show full and an edited transcripts, and an audio recording.

He spoke again about the PACE study in Belfast in February 2016 where he described it as "a wasteful trainwreck of a study".

Professor Coyne has questioned whether the PACE trial paper could ever have been properly peer-reviewed, given the large number of study authors and the small world of British science.

Professors James Coyne and Keith Laws

Professor Coyne and Professor Laws of the University of Hertfordshire have criticised, in a joint letter to Lancet Psychiatry, the long-term follow-up analysis of the PACE trial that was published in 2015. Referring to the results of the study as a whole, they said:

"There are no group differences, and the overall mean short-form 36 (SF-63) physical functioning score is less than 60. It is useful to put this number in context. 77% of the PACE trial participants were women, and the mean age of the trial population was 38 years, with no other disabling medical conditions. Patients with lupus have a mean physical functioning score of 63, patients with class II congestive heart failure have a mean score lower than 60, and normal controls with no long-term health problems have a mean score of 93."

Professor Ronald Davis

Professor Ronald Davis is a world-famous geneticist at Stanford University, known for work that enabled the Human Genome Project.

"I'm shocked that the Lancet published it... The PACE study has so many flaws and there are so many questions you'd want to ask about it that I don't understand how it got through any kind of peer review."

Emeritus Professor Jonathan Edwards

Professor Edwards, of University College London, is internationally known for his pioneering work in establishing B-cell depletion therapy as an effective treatment for rheumatoid arthritis.

"It's a mass of un-interpretability to me…All the issues with the trial are extremely worrying, making interpretation of the clinical significance of the findings more or less impossible....Within the circle who are involved in this field, it seems there were a group who were prepared to all sing by the hymn sheet and agree that PACE was wonderful. But all the issues with the trial are extremely worrying, making interpretation of the clinical significance of the findings more or less impossible."

Professor Rebecca Goldin

Professor Goldin is Professor of Mathematical Sciences at George Mason University and Director of STATS.org (US).

"The PACE design changed so significantly as to leave many wondering whether there is value in the study itself."

"It seems that the best we can glean from PACE is that study design is essential to good science, and the flaws in this design were enough to doom its results from the start."

Dr Ellen Goudsmit

Dr Goudsmit is a retired health psychologist who has published a number of criticisms of the PACE trial.

"The PACE trial was scientifically extremely poor"

"A treatment like GET is simply not appropriate for a disease like ME which is linked to infection and metabolic abnormalities. Given the close relationship between exertion and symptoms, it follows that asking a patient to increase their activity levels is as logical as advising smokers with lung cancer to gradually increase the number of cigarettes they smoke"

Professor Leonard Jason

Leonard Jason is a professor of psychology at DePaul University in Chicago, Illinois, and director of its Center for Community Research.

“The PACE authors should have reduced the kind of blatant methodological lapses that can impugn the credibility of the research, such as having overlapping recovery and entry/disability criteria.”

"My key points are that the PACE trial investigators were not successful in designing and implementing a valid pacing intervention and patient selection ambiguity further compromised the study’s outcomes."

Professor Bruce Levin

Professor Levin is a professor of biostatistics at Columbia University and an expert in clinical trial design.

"To let participants know that interventions have been selected by a government committee 'based on the best available evidence' strikes me as the height of clinical trial amateurism."

Professor Vincent Racaniello

Vincent Racaniello is a virologist at Columbia University in New York in the United States.

"This is a flawed study, it has to be fixed and people are being harmed by it."

"... multiple flaws that are inexcusable."

"In short, the PACE study is a sham, with meaningless results. In this case, the emperor truly has no clothes. Dr. Horton and his editorial team at The Lancet are stark naked."

"I think they are going to ignore, obfuscate, and give their usual responses until we are all dead. I don't have hope that the PACE authors, or Lancet, will respond in any meaningful way until there is more of an outcry.

Professor Arthur Reingold

Professor Reingold is Head of Epidemiology at the University of California, Berkeley.

"Under the circumstances, an independent review of the trial conducted by experts not involved in the design or conduct of the study would seem to be very much in order."

Dr. Charles Shepherd

Dr Shepherd, medical advisor to the ME Association, who also has ME/CFS, has criticised the trial's long-term follow-up analyses:

"Without robust objective evidence relating to improvement and recovery, the ME patient community will continue to regard the PACE trial as a tremendous waste of research funding money".

Dr David Tuller

Dr Tuller is is academic coordinator of the University of California, Berkeley's joint masters program in public health and journalism. He was a reporter and editor for 10 years at the San Francisco Chronicle, served as health editor at Salon.com and frequently writes about health for The New York Times. He has written extensively about the PACE trial.

"The study included a bizarre paradox: participants’ baseline scores for the two primary outcomes of physical function and fatigue could qualify them simultaneously as disabled enough to get into the trial but already 'recovered' on those indicators–even before any treatment. In fact, 13 percent of the study sample was already 'recovered' on one of these two measures at the start of the study."

"In the middle of the study, the PACE team published a newsletter for participants that included glowing testimonials from earlier trial subjects about how much the 'therapy' and 'treatment' helped them. The newsletter also included an article informing participants that the two interventions pioneered by the investigators and being tested for efficacy in the trial, graded exercise therapy and cognitive behavior therapy, had been recommended as treatments by a U.K. government committee 'based on the best available evidence.' The newsletter article did not mention that a key PACE investigator was also serving on the U.K. government committee that endorsed the PACE therapies."

"The PACE team changed all the methods outlined in its protocol for assessing the primary outcomes of physical function and fatigue, but did not take necessary steps to demonstrate that the revised methods and findings were robust, such as including sensitivity analyses. The researchers also relaxed all four of the criteria outlined in the protocol for defining 'recovery.' They have rejected requests from patients for the findings as originally promised in the protocol as 'vexatious.'"

"The PACE claims of successful treatment and 'recovery' were based solely on subjective outcomes. All the objective measures from the trial—a walking test, a step test, and data on employment and the receipt of financial information—failed to provide any evidence to support such claims. Afterwards, the PACE authors dismissed their own main objective measures as non-objective, irrelevant, or unreliable."

"In seeking informed consent, the PACE authors violated their own protocol, which included an explicit commitment to tell prospective participants about any possible conflicts of interest. The main investigators have had longstanding financial and consulting ties with disability insurance companies, having advised them for years that cognitive behavior therapy and graded exercise therapy could get claimants off benefits and back to work. Yet prospective participants were not told about any insurance industry links and the information was not included on consent forms. The authors did include the information in the 'conflicts of interest' sections of the published papers."

"The Lancet Psychiatry follow-up had null findings: Two years or more after randomization, there were no differences in reported levels of fatigue and physical function between those assigned to any of the groups... Yet the authors, once again, attempted to spin this mess as a success."

"This study is a piece of crap."

Dr David Tuller and Julie Rehmeyer

Public health expert Dr Tuller and ME/CFS patient Julie Rehmeyer are both journalists who have written critically about the PACE authors' claims regarding the safety of Graded exercise therapy:

"The study’s primary case definition for identifying participants, called the Oxford criteria, was extremely broad; it required only six months of medically unexplained fatigue, with no other symptoms necessary. Indeed, 16% of the participants didn’t even have exercise intolerance—now recognized as the primary symptom of ME/CFS".

"After the trial began, the researchers tightened their definition of harms, just as they had relaxed their methods of assessing improvement."

"[T]he study was unblinded, so both participants and therapists knew the treatment being administered. Many participants were probably aware that the researchers themselves favored graded exercise therapy and another treatment, cognitive behavior therapy, which also involved increasing activity levels. Such information has been shown in other studies to lead to efforts to cooperate, which in this case could lead to lowered reporting of harms."

Julie Rehmeyer

"... one of the most damaging cases of bad statistical practice that I have personally encountered in my years as a journalist"

"... an object lesson in how our systems can break down. In this case there were serious breakdowns statistically, scientifically, journalistically and in public health."

Dr Michael VanElzakker

"Subjective measures of sick people before & after they are repeatedly told 'You're not sick' is a social psych study, not a clinical trial."

"In 5 years, the UK medical establishment's obdurateness on ME/CFS and PACE will be taught in medical schools as a cautionary tale."

"The PACE trial is a classic case of #badscience - researchers are determined to support their theory, even if the data do not."

Dr David Marks

Editor of the Journal of Health Psychology

"The many wrongs committed by psychiatry and medicine to the ME/CFS community can only be righted when the PACE trial is ultimately seen for what it is: a disgraceful confidence trick to reduce patient compensation payments and benefits."

"Gaslighting has been applied to the entire ME/CFS community by misapplication and misuse of the Biopsychosocial Model".

See also

• PACE trial

Learn more

• 2016, The scandal of the £5m PACE trial for ME (video) - James Coyne

slide show