PACE trial: Difference between revisions

From MEpedia, a crowd-sourced encyclopedia of ME and CFS science and history
(actually just bolded text is good enough for these subheadings)
(changed more subheadings to bolded text, in order to make table of contents easier to navigate)
Line 405: Line 405:
[[Alem Matthees]] , an Australian ME sufferer, submitted a  FOIA request to the PACE trial authors who were ordered to provide the requested data by the Information Commissioners Office.  This decision was appealed by them to the Information Tribunal and was heard on April 20th 2016 at a three day hearing.
[[Alem Matthees]] , an Australian ME sufferer, submitted a  FOIA request to the PACE trial authors who were ordered to provide the requested data by the Information Commissioners Office.  This decision was appealed by them to the Information Tribunal and was heard on April 20th 2016 at a three day hearing.


===Information Tribunal===
'''Information Tribunal'''


Mr [[Alem Matthees]] original Freedom of Information Act 2000 request to QMUL [https://www.whatdotheyknow.com/request/selected_data_on_pace_trial_part#comment-74511 Selected data on PACE Trial participants] was submitted on 24 March 2014. QMUL refused to release the requested data and Mathees complained to the Information Commissioners Office. The [https://ico.org.uk/media/action-weve-taken/decision-notices/2015/1560081/fs_50565190.pdf Information Commissioners decision]  was made on  27 October 2015 and concluded that QMUL should release the data.<ref name="FirstTierTribunal2015">{{Cite news|title=First-tier tribunal: Information Rights Appeal EA/2015/0269.|url=https://informationrights.decisions.tribunals.gov.uk//DBFiles/Decision/i1854/Queen%20Mary%20University%20of%20London%20EA-2015-0269%20(12-8-16).PDF|page=40|last=Kennedy|first=Brian|last2=Stephenson|first2=Darryl|last3=Watson|first3=Nigel|quote=The evidence of <nowiki>[expert witness]</nowiki> Professor Anderson that third parties could not identify participants from the information alone and that, when pressed, he said that the chance of an "activist" being able to discover information that would lead to individual identification was remote, it was clear that his assessment of activist behaviour was, in our view, grossly exaggerated and the only actual evidence was that an individual at a seminar had heckled Professor Chalder. The identity of those questioning the research, who had signed an open letter or supported it, was impressive.}}</ref>
Mr [[Alem Matthees]] original Freedom of Information Act 2000 request to QMUL [https://www.whatdotheyknow.com/request/selected_data_on_pace_trial_part#comment-74511 Selected data on PACE Trial participants] was submitted on 24 March 2014. QMUL refused to release the requested data and Mathees complained to the Information Commissioners Office. The [https://ico.org.uk/media/action-weve-taken/decision-notices/2015/1560081/fs_50565190.pdf Information Commissioners decision]  was made on  27 October 2015 and concluded that QMUL should release the data.<ref name="FirstTierTribunal2015">{{Cite news|title=First-tier tribunal: Information Rights Appeal EA/2015/0269.|url=https://informationrights.decisions.tribunals.gov.uk//DBFiles/Decision/i1854/Queen%20Mary%20University%20of%20London%20EA-2015-0269%20(12-8-16).PDF|page=40|last=Kennedy|first=Brian|last2=Stephenson|first2=Darryl|last3=Watson|first3=Nigel|quote=The evidence of <nowiki>[expert witness]</nowiki> Professor Anderson that third parties could not identify participants from the information alone and that, when pressed, he said that the chance of an "activist" being able to discover information that would lead to individual identification was remote, it was clear that his assessment of activist behaviour was, in our view, grossly exaggerated and the only actual evidence was that an individual at a seminar had heckled Professor Chalder. The identity of those questioning the research, who had signed an open letter or supported it, was impressive.}}</ref>
Line 429: Line 429:
QMUL did not appeal and released the data to Matthees.<ref>http://www.qmul.ac.uk/media/news/items/smd/181216.html</ref> It was uploaded online.<ref>https://twitter.com/CoyneoftheRealm/status/778643034800005120</ref><ref>https://sites.google.com/site/pacefoir/pace-ipd_foia-qmul-2014-f73.xlsx?attredirects=0</ref><ref>https://sites.google.com/site/pacefoir/pace-ipd_foia-%20qmul-%202014-f73.xlsx </ref>
QMUL did not appeal and released the data to Matthees.<ref>http://www.qmul.ac.uk/media/news/items/smd/181216.html</ref> It was uploaded online.<ref>https://twitter.com/CoyneoftheRealm/status/778643034800005120</ref><ref>https://sites.google.com/site/pacefoir/pace-ipd_foia-qmul-2014-f73.xlsx?attredirects=0</ref><ref>https://sites.google.com/site/pacefoir/pace-ipd_foia-%20qmul-%202014-f73.xlsx </ref>


===Results of Reanalysis===
'''Results of Reanalysis'''


Virology blog published the re-analysis on September 21, [http://www.virology.ws/2016/09/21/no-recovery-in-pace-trial-new-analysis-finds/ No 'Recovery' in PACE Trial, New Analysis Finds] and concluded "The results should put to rest once and for all any question about whether the PACE trial’s enormous mid-trial changes in assessment methods allowed the investigators to report better results than they otherwise would have had. While the answer was obvious from Dr. Tuller’s reporting, the new analysis makes the argument incontrovertible."  
Virology blog published the re-analysis on September 21, [http://www.virology.ws/2016/09/21/no-recovery-in-pace-trial-new-analysis-finds/ No 'Recovery' in PACE Trial, New Analysis Finds] and concluded "The results should put to rest once and for all any question about whether the PACE trial’s enormous mid-trial changes in assessment methods allowed the investigators to report better results than they otherwise would have had. While the answer was obvious from Dr. Tuller’s reporting, the new analysis makes the argument incontrovertible."  
Line 449: Line 449:
* [[List of scientific and media response to release of PACE trial data]]
* [[List of scientific and media response to release of PACE trial data]]


===Journal of Health Psychology 'Special Issue on the PACE Trial'===
'''Journal of Health Psychology 'Special Issue on the PACE Trial''''


A special edition of the Journal of Health Psychology was published in 31 July by the editor, Dr David Marks with an editorial - [http://journals.sagepub.com/doi/full/10.1177/1359105317722370 'Special Issue on the PACE Trial'] and accompanying all [http://journals.sagepub.com/toc/hpqa/22/9 20 Editorials & Commentaries]. <ref>http://journals.sagepub.com/toc/hpqa/22/9 </ref>
A special edition of the Journal of Health Psychology was published in 31 July by the editor, Dr David Marks with an editorial - [http://journals.sagepub.com/doi/full/10.1177/1359105317722370 'Special Issue on the PACE Trial'] and accompanying all [http://journals.sagepub.com/toc/hpqa/22/9 20 Editorials & Commentaries]. <ref>http://journals.sagepub.com/toc/hpqa/22/9 </ref>
Line 477: Line 477:
The Journal of Health Psychology August Special Edition with all articles  is also available on [https://www.ncbi.nlm.nih.gov/pubmed?term=Journal+of+health+psychology+aug+PACE&cmd=DetailsSearch PubMed].
The Journal of Health Psychology August Special Edition with all articles  is also available on [https://www.ncbi.nlm.nih.gov/pubmed?term=Journal+of+health+psychology+aug+PACE&cmd=DetailsSearch PubMed].


===Learn more===
'''Learn more'''


*2016, [https://www.statnews.com/2016/09/21/chronic-fatigue-syndrome-pace-trial/ Bad science misled millions with chronic fatigue syndrome. Here’s how we fought back], [[Julie Rehmeyer]], ''Stat News'', 21 Sep 2016.<ref name="Rehmeyer20160921" />
*2016, [https://www.statnews.com/2016/09/21/chronic-fatigue-syndrome-pace-trial/ Bad science misled millions with chronic fatigue syndrome. Here’s how we fought back], [[Julie Rehmeyer]], ''Stat News'', 21 Sep 2016.<ref name="Rehmeyer20160921" />
Line 485: Line 485:
The PACE trial was scientifically discredited but the impact of it on the medical community has continued especially in the UK.
The PACE trial was scientifically discredited but the impact of it on the medical community has continued especially in the UK.


===Agency for Healthcare Research and Quality (AHRQ) amendment, US===
'''Agency for Healthcare Research and Quality (AHRQ) amendment, US'''
The US government agency called the [[Agency for Healthcare Research and Quality]] (AHRQ) revised its earlier recommendations about found that when studies of CBT and GET, including PACE, that used the Oxford Criteria were excluded, there was no evidence for graded exercise and only weak evidence for CBT.<ref name="MEACTION20160818ahrq" /> [[Mary Dimmock]] led the way on this issue with AHRQ and co-authored with [[Jennie Spotila]] [http://occupyme.net/2016/08/16/ahrq-evidence-review-changes-its-conclusions/ AHRQ Evidence Review Changes Its Conclusions.]
The US government agency called the [[Agency for Healthcare Research and Quality]] (AHRQ) revised its earlier recommendations about found that when studies of CBT and GET, including PACE, that used the Oxford Criteria were excluded, there was no evidence for graded exercise and only weak evidence for CBT.<ref name="MEACTION20160818ahrq" /> [[Mary Dimmock]] led the way on this issue with AHRQ and co-authored with [[Jennie Spotila]] [http://occupyme.net/2016/08/16/ahrq-evidence-review-changes-its-conclusions/ AHRQ Evidence Review Changes Its Conclusions.]


===PLOS Expression of Concern===
'''PLOS Expression of Concern'''


Prof James Coyne had requested anonymised data in 2015 from the PACE trial authors from the Cost Effectiveness paper. He pursued this request throughout 2015 and 2016 but was also refused as "vexatious". After 18 months,  PLOS issued an [http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0040808 Expression of Concern] on May 2nd 2017. It stated "We conclude that the lack of resolution towards release of the dataset is not in line with the journal’s editorial policy and we are thus issuing this Expression of Concern to alert readers about the concerns raised about this article.<ref>{{Cite journal|last=The PLOS ONE Editors|first=|date=2017-05-02|title=Expression of Concern: Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis|url=https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0177037|journal =PLOS ONE|volume =12|issue=5|pages=e0177037|doi=10.1371/journal.pone.0177037|issn=1932-6203|pmc=5412692|pmid=28463341}}</ref> The editors of PLOS One, Iratxe Puebla and Joerg Heber, wrote in PLOS One Blog "Since we feel we have exhausted the options to make the data available responsibly, and considering the questions that were raised about the validity of the article’s conclusions, we have decided to post an Expression of Concern to alert readers that the data are not available in line with the journal’s editorial policy".<ref>{{Cite web|url=https://everyone.plos.org/2017/05/02/data-sharing-in-clinical-research/|title=Data sharing in clinical research: challenges and open opportunities|last=|first=|authorlink=|date=2017-05-02|website=PLoS|language=en-US|archive-url=|archive-date=|url-status=|access-date=2020-07-19}}</ref> Retraction Watch reported on the development <ref>http://retractionwatch.com/2017/05/02/plos-upgrades-flag-controversial-pace-chronic-fatigue-syndrome-trial-authors-surprised/</ref>
Prof James Coyne had requested anonymised data in 2015 from the PACE trial authors from the Cost Effectiveness paper. He pursued this request throughout 2015 and 2016 but was also refused as "vexatious". After 18 months,  PLOS issued an [http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0040808 Expression of Concern] on May 2nd 2017. It stated "We conclude that the lack of resolution towards release of the dataset is not in line with the journal’s editorial policy and we are thus issuing this Expression of Concern to alert readers about the concerns raised about this article.<ref>{{Cite journal|last=The PLOS ONE Editors|first=|date=2017-05-02|title=Expression of Concern: Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis|url=https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0177037|journal =PLOS ONE|volume =12|issue=5|pages=e0177037|doi=10.1371/journal.pone.0177037|issn=1932-6203|pmc=5412692|pmid=28463341}}</ref> The editors of PLOS One, Iratxe Puebla and Joerg Heber, wrote in PLOS One Blog "Since we feel we have exhausted the options to make the data available responsibly, and considering the questions that were raised about the validity of the article’s conclusions, we have decided to post an Expression of Concern to alert readers that the data are not available in line with the journal’s editorial policy".<ref>{{Cite web|url=https://everyone.plos.org/2017/05/02/data-sharing-in-clinical-research/|title=Data sharing in clinical research: challenges and open opportunities|last=|first=|authorlink=|date=2017-05-02|website=PLoS|language=en-US|archive-url=|archive-date=|url-status=|access-date=2020-07-19}}</ref> Retraction Watch reported on the development <ref>http://retractionwatch.com/2017/05/02/plos-upgrades-flag-controversial-pace-chronic-fatigue-syndrome-trial-authors-surprised/</ref>


===Centers for Disease Control & Prevention (CDC), US===
'''Centers for Disease Control & Prevention (CDC), US'''


David Tuller reported  in July 2017  [http://www.virology.ws/2017/07/10/trial-by-error-the-cdc-drops-cbtget/ Trial By Error: The CDC Drops CBT/GET]  the [[Centers for Disease Control and Prevention|CDC]] updated their treatment recommendations and  "the agency has “disappeared” all mention of CBT and GET as treatment or management strategies."  It was reported by Tuller that the key members of the PACE trial  had a long history with the CDC and  "For advocates, the CDC’s removal of the CBT/GET recommendations represents a major victory. “I think it’s huge,” said Mary Dimmock, an advocate who has long pressured the CDC to revise its website." The removal of CBT and GET has been "heralded as an important" by patient charities <ref>http://www.meassociation.org.uk/2017/07/cdc-removes-cbt-and-get-as-recommended-treatments-for-mecfs-11-july-2017/ </ref>. David Tuller in Undark reported on this development as [https://undark.org/2017/07/26/cdc-chronic-fatigue-graded-exercise/ CDC Removes Reference to Disputed ME/CFS Therapies From Website]. <ref>https://undark.org/2017/07/26/cdc-chronic-fatigue-graded-exercise/ CDC Removes Reference to Disputed ME/CFS Therapies From Website  </ref>.
David Tuller reported  in July 2017  [http://www.virology.ws/2017/07/10/trial-by-error-the-cdc-drops-cbtget/ Trial By Error: The CDC Drops CBT/GET]  the [[Centers for Disease Control and Prevention|CDC]] updated their treatment recommendations and  "the agency has “disappeared” all mention of CBT and GET as treatment or management strategies."  It was reported by Tuller that the key members of the PACE trial  had a long history with the CDC and  "For advocates, the CDC’s removal of the CBT/GET recommendations represents a major victory. “I think it’s huge,” said Mary Dimmock, an advocate who has long pressured the CDC to revise its website." The removal of CBT and GET has been "heralded as an important" by patient charities <ref>http://www.meassociation.org.uk/2017/07/cdc-removes-cbt-and-get-as-recommended-treatments-for-mecfs-11-july-2017/ </ref>. David Tuller in Undark reported on this development as [https://undark.org/2017/07/26/cdc-chronic-fatigue-graded-exercise/ CDC Removes Reference to Disputed ME/CFS Therapies From Website]. <ref>https://undark.org/2017/07/26/cdc-chronic-fatigue-graded-exercise/ CDC Removes Reference to Disputed ME/CFS Therapies From Website  </ref>.
Line 498: Line 498:
In September, [[David Tuller]] and [[Julie Rehmeyer]] wrote an article in STAT exploring [https://www.statnews.com/2017/09/25/chronic-fatigue-syndrome-cdc/ 'Why did it take the] [[CDC]] so long to reverse course on debunked treatments for chronic fatigue syndrome?'. NPR reported on the change in the CDC recommendations and that exercise  can make the  disease worse and criticised the seminal paper Sir [[Simon Wessely]] from 1989 that led to exercise as a treatment and the PACE trial. <ref>http://www.npr.org/sections/health-shots/2017/10/02/554369327/for-people-with-chronic-fatigue-syndrome-more-exercise-isnt-better  </ref>. The New York Times published  an article 'New Recognition for Chronic Fatigue Syndrome'] that longstanding advice to exercise was now recognised as not only ineffective but counterproductive and referred to the CDC and NICE decision to review the recommendations <ref>https://www.nytimes.com/2017/11/27/well/new-recognition-for-chronic-fatigue.html?smid=tw-share </ref>.
In September, [[David Tuller]] and [[Julie Rehmeyer]] wrote an article in STAT exploring [https://www.statnews.com/2017/09/25/chronic-fatigue-syndrome-cdc/ 'Why did it take the] [[CDC]] so long to reverse course on debunked treatments for chronic fatigue syndrome?'. NPR reported on the change in the CDC recommendations and that exercise  can make the  disease worse and criticised the seminal paper Sir [[Simon Wessely]] from 1989 that led to exercise as a treatment and the PACE trial. <ref>http://www.npr.org/sections/health-shots/2017/10/02/554369327/for-people-with-chronic-fatigue-syndrome-more-exercise-isnt-better  </ref>. The New York Times published  an article 'New Recognition for Chronic Fatigue Syndrome'] that longstanding advice to exercise was now recognised as not only ineffective but counterproductive and referred to the CDC and NICE decision to review the recommendations <ref>https://www.nytimes.com/2017/11/27/well/new-recognition-for-chronic-fatigue.html?smid=tw-share </ref>.


===UK reaction from the Journals - Lancet, Psychological Medicine and Guideline Provider - NICE===
'''UK reaction from the Journals - Lancet, Psychological Medicine and Guideline Provider - NICE'''


The UK medical and scientific establishment have been obstinate in changing their position to reflect the flaws of the PACE trial as the PACE trial investigators are highly influential and senior members of the UK establishment. The Lancet have refused to retract the study as yet. Psychological Medicine have also refused to retract the study as well.  
The UK medical and scientific establishment have been obstinate in changing their position to reflect the flaws of the PACE trial as the PACE trial investigators are highly influential and senior members of the UK establishment. The Lancet have refused to retract the study as yet. Psychological Medicine have also refused to retract the study as well.  
Line 506: Line 506:
Jerome Burns in Health Insights UK published a follow up article to his 2016 articles on the PACE trial in the article headlined ‘The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out…’ The journalist stated he thought it would be big story in 2016 with lots of repercussions but the UK press largely ignored it and he revisited the story  in 2019 due to professional opinions changing against CBT/GET, with  the recent House of Commons debates and the impending revision of the NICE guidelines.<ref>{{Cite web|url=http://healthinsightuk.org/2019/04/22/the-claim-that-the-cure-for-the-crippling-fatigue-of-mecfs-was-to-change-your-mind-always-seemed-bizarre-now-it-really-is-on-the-way-out/|title=The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out… {{!}} HealthInsightUK|language=en-US|access-date=2019-04-23}}</ref>
Jerome Burns in Health Insights UK published a follow up article to his 2016 articles on the PACE trial in the article headlined ‘The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out…’ The journalist stated he thought it would be big story in 2016 with lots of repercussions but the UK press largely ignored it and he revisited the story  in 2019 due to professional opinions changing against CBT/GET, with  the recent House of Commons debates and the impending revision of the NICE guidelines.<ref>{{Cite web|url=http://healthinsightuk.org/2019/04/22/the-claim-that-the-cure-for-the-crippling-fatigue-of-mecfs-was-to-change-your-mind-always-seemed-bizarre-now-it-really-is-on-the-way-out/|title=The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out… {{!}} HealthInsightUK|language=en-US|access-date=2019-04-23}}</ref>


===Continued campaigning===
'''Continued campaigning'''


[[Mary Dimmock]] wrote a comprehensive report [https://www.dropbox.com/s/kbjmmuc1utx67md/Concerns%20with%20ME%20Evidence%20Based%20Guidance%20January%202018.pdf?dl=0 'Clinical Guidance for ME: “Evidence-Based” Guidance Gone Awry'] in January 2018 that details how the PACE trial and similar studies based on  flawed science led to evidence-based reviews and  clinical guidance recommending harmful treatments for ME patients <ref>https://www.meaction.net/2018/02/05/the-failure-of-clinical-guidance-for-people-with-me/</ref>.
[[Mary Dimmock]] wrote a comprehensive report [https://www.dropbox.com/s/kbjmmuc1utx67md/Concerns%20with%20ME%20Evidence%20Based%20Guidance%20January%202018.pdf?dl=0 'Clinical Guidance for ME: “Evidence-Based” Guidance Gone Awry'] in January 2018 that details how the PACE trial and similar studies based on  flawed science led to evidence-based reviews and  clinical guidance recommending harmful treatments for ME patients <ref>https://www.meaction.net/2018/02/05/the-failure-of-clinical-guidance-for-people-with-me/</ref>.
Line 515: Line 515:
Dr Racaniello sent another open letter with nearly 100 signatories including scientists, clinicians, academics, lawyers  and other experts to the editor Richard Horton at the Lancet due to receiving no response  two years later  to the original letter from February 2016,. The letter again asked for an independent re-analysis from independent reviewers  outside UK psychiatry who have no conflicts of interests involving the PACE investigators and the funders of the trial <ref>http://www.virology.ws/2018/06/19/trial-by-error-an-open-letter-to-the-lancet-two-years-on/</ref>. Another letter of appeal was sent with signatories including 65 ME patient organisation / charities and also this time with 10 Members of Parliament signing the open letter to Richard Horton and the Lancet <ref>http://www.virology.ws/2018/07/10/trial-by-error-yet-another-appeal-to-the-lancet-with-more-on-board/ </ref>. The Times (UK) reported on the third letter in its article 'Call for review of ‘flawed’ ME research in Lancet letter' and stated at the end,  "The Lancet declined to comment" <ref>https://www.thetimes.co.uk/article/call-for-review-of-flawed-me-research-in-lancet-letter-l75rvcprh</ref>. The BMJ who were supportive of the PACE trial previously reported it as  'Pressure grows on Lancet to review “flawed” PACE trial' and also approached the Lancet for comment  <ref>https://www.bmj.com/content/362/bmj.k3621.short?rss=1 </ref>. In a letter to the editor of The Times, the Chief Executive of the MRC, Fiona Watt continued to defend the PACE trial<ref>{{Cite web|url=https://www.meassociation.org.uk/2018/08/the-times-call-for-review-of-flawed-me-research-in-lancet-letter-21-august-2018/|title=The Times: Call for review of ‘flawed’ ME research in Lancet letter {{!}} August 21, 2018|language=en-US|access-date=2019-04-09}}</ref><ref>{{Cite news|url=https://www.thetimes.co.uk/article/preparing-children-for-starting-primary-school-6q6hv8nl3|title=Preparing children for starting primary school|date=2018-08-27|access-date=2019-04-09|language=en|issn=0140-0460}}</ref>.
Dr Racaniello sent another open letter with nearly 100 signatories including scientists, clinicians, academics, lawyers  and other experts to the editor Richard Horton at the Lancet due to receiving no response  two years later  to the original letter from February 2016,. The letter again asked for an independent re-analysis from independent reviewers  outside UK psychiatry who have no conflicts of interests involving the PACE investigators and the funders of the trial <ref>http://www.virology.ws/2018/06/19/trial-by-error-an-open-letter-to-the-lancet-two-years-on/</ref>. Another letter of appeal was sent with signatories including 65 ME patient organisation / charities and also this time with 10 Members of Parliament signing the open letter to Richard Horton and the Lancet <ref>http://www.virology.ws/2018/07/10/trial-by-error-yet-another-appeal-to-the-lancet-with-more-on-board/ </ref>. The Times (UK) reported on the third letter in its article 'Call for review of ‘flawed’ ME research in Lancet letter' and stated at the end,  "The Lancet declined to comment" <ref>https://www.thetimes.co.uk/article/call-for-review-of-flawed-me-research-in-lancet-letter-l75rvcprh</ref>. The BMJ who were supportive of the PACE trial previously reported it as  'Pressure grows on Lancet to review “flawed” PACE trial' and also approached the Lancet for comment  <ref>https://www.bmj.com/content/362/bmj.k3621.short?rss=1 </ref>. In a letter to the editor of The Times, the Chief Executive of the MRC, Fiona Watt continued to defend the PACE trial<ref>{{Cite web|url=https://www.meassociation.org.uk/2018/08/the-times-call-for-review-of-flawed-me-research-in-lancet-letter-21-august-2018/|title=The Times: Call for review of ‘flawed’ ME research in Lancet letter {{!}} August 21, 2018|language=en-US|access-date=2019-04-09}}</ref><ref>{{Cite news|url=https://www.thetimes.co.uk/article/preparing-children-for-starting-primary-school-6q6hv8nl3|title=Preparing children for starting primary school|date=2018-08-27|access-date=2019-04-09|language=en|issn=0140-0460}}</ref>.


=== Additional Scientific Publications===
===Additional Scientific Publications===


'''BMC Psychology - Re-analysis by Wilshire et al'''
'''BMC Psychology - Re-analysis by Wilshire et al'''
Line 543: Line 543:
In August 2018 a book called 'Psychology in Crisis' by Prof Brian Michael Hughes also documented and summarised  the failures of the PACE trial <ref>https://www.amazon.co.uk/Psychology-Crisis-Brian-Hughes/dp/1352003007</ref>.
In August 2018 a book called 'Psychology in Crisis' by Prof Brian Michael Hughes also documented and summarised  the failures of the PACE trial <ref>https://www.amazon.co.uk/Psychology-Crisis-Brian-Hughes/dp/1352003007</ref>.


===Complaint to medical regulator (GMC)===
'''Complaint to medical regulator (GMC)'''


Dr Sarah Myhill has complained to the UK's medical regulator, the [https://en.wikipedia.org/wiki/General_Medical_Council General Medical Council], over the conduct of the PACE trial authors <ref>http://www.drmyhill.co.uk/wiki/My_Complaint_to_the_GMC_about_the_PACE_authors</ref>.  Over 200 letters of complaints by ME patients were also sent to the General Medical Council. A petition gathered over 8900 signatories supporting Dr Myhill's complaint to the GMC about the PACE trial authors <ref>https://www.change.org/p/the-general-medical-council-i-am-showing-my-support-for-dr-myhill-s-complaint-to-the-gmc-about-the-pace-authors</ </ref>.
Dr Sarah Myhill has complained to the UK's medical regulator, the [https://en.wikipedia.org/wiki/General_Medical_Council General Medical Council], over the conduct of the PACE trial authors <ref>http://www.drmyhill.co.uk/wiki/My_Complaint_to_the_GMC_about_the_PACE_authors</ref>.  Over 200 letters of complaints by ME patients were also sent to the General Medical Council. A petition gathered over 8900 signatories supporting Dr Myhill's complaint to the GMC about the PACE trial authors <ref>https://www.change.org/p/the-general-medical-council-i-am-showing-my-support-for-dr-myhill-s-complaint-to-the-gmc-about-the-pace-authors</ </ref>.


===Further FOIA requests===
'''Further FOIA requests'''


Further Freedom of Information Act 2000 requests have been made to the PACE trial team at [[Queen Mary University of London]] (QMUL). The PACE authors have continued to refuse using various reasons including refusing an internal review and these decisions have been appealed again to the Information Commissioner's Office. On 20 February 2018  the Information Commissioner's Office ruled that the the university should release the [[PACE Trial Steering Committee]] minutes and the [[PACE Trial Management Group|Trial Management Group]] minutes. The PACE team and the university surprisingly  repeated its  earlier arguments to the ICO that the criticism is unwarranted and the trial is not controversial among the majority of scientists in the field and that there is a history of the researchers being personal abused, their integrity being questioned and even as far as saying they may risk threats of physical violence. The Information Tribunal in August 2016 in its court decision rejected these serious but unfounded assertions. The complainant, an ME sufferer, argued that this data should be released given the previous submissions by the PACE authors were unreliable and in the intervening period the scientific community  in addition to patients had cast further  concerns about the trial. The Commissioner found that the public interest favors publishing the anonymized information and ruled that the university should release the data and has 35 days to do so.  <ref>https://ico.org.uk/media/action-weve-taken/decision-notices/2018/2258289/fs50687719.pdf</ref>. <ref>https://www.dropbox.com/s/xbos0l3k6ylr0ew/ICO%20decision%20minutes.pdf?dl=0</ref>.
Further Freedom of Information Act 2000 requests have been made to the PACE trial team at [[Queen Mary University of London]] (QMUL). The PACE authors have continued to refuse using various reasons including refusing an internal review and these decisions have been appealed again to the Information Commissioner's Office. On 20 February 2018  the Information Commissioner's Office ruled that the the university should release the [[PACE Trial Steering Committee]] minutes and the [[PACE Trial Management Group|Trial Management Group]] minutes. The PACE team and the university surprisingly  repeated its  earlier arguments to the ICO that the criticism is unwarranted and the trial is not controversial among the majority of scientists in the field and that there is a history of the researchers being personal abused, their integrity being questioned and even as far as saying they may risk threats of physical violence. The Information Tribunal in August 2016 in its court decision rejected these serious but unfounded assertions. The complainant, an ME sufferer, argued that this data should be released given the previous submissions by the PACE authors were unreliable and in the intervening period the scientific community  in addition to patients had cast further  concerns about the trial. The Commissioner found that the public interest favors publishing the anonymized information and ruled that the university should release the data and has 35 days to do so.  <ref>https://ico.org.uk/media/action-weve-taken/decision-notices/2018/2258289/fs50687719.pdf</ref>. <ref>https://www.dropbox.com/s/xbos0l3k6ylr0ew/ICO%20decision%20minutes.pdf?dl=0</ref>.
Line 725: Line 725:
==List of PACE trial publications==
==List of PACE trial publications==


===2003: Trial Registry. BioMed Central. ISRCTN54285094===
'''2003: Trial Registry. BioMed Central. ISRCTN54285094'''
 
There is a currently published trial register<ref name="pace2003trialregistry" /> and there is a version of the register that is no longer available on the web but has been archived.<ref name="pace2003trialregistryarchive" /> Both versions contain slightly different details. The archived version contains the details of the trial's pre-specified endpoint analyses.
There is a currently published trial register<ref name="pace2003trialregistry" /> and there is a version of the register that is no longer available on the web but has been archived.<ref name="pace2003trialregistryarchive" /> Both versions contain slightly different details. The archived version contains the details of the trial's pre-specified endpoint analyses.


===2006: Final protocol version 5.0===
'''2006: Final protocol version 5.0'''
 
This full version of the study protocol, which includes trial materials such as questionnaires and consent forms, was never officially published.<ref name="pace2006protocolv5" />
This full version of the study protocol, which includes trial materials such as questionnaires and consent forms, was never officially published.<ref name="pace2006protocolv5" />


===2007: PACE trial protocol===
'''2007: PACE trial protocol'''
 
[[BMC Neurology]] published the trial's planned methodology, including its planned analyses.<ref name="pace2007protocol" />
[[BMC Neurology]] published the trial's planned methodology, including its planned analyses.<ref name="pace2007protocol" />


===2011: Main trial outcomes===
'''2011: Main trial outcomes'''
 
The trial's main outcomes, and some selected secondary outcomes, were reported in [[The Lancet]].<ref name="pace2011a" /> Forty-four letters were submitted in a response that the journal's editor described as "swift and damning".<ref name="pace2011LancetEd" />
The trial's main outcomes, and some selected secondary outcomes, were reported in [[The Lancet]].<ref name="pace2011a" /> Forty-four letters were submitted in a response that the journal's editor described as "swift and damning".<ref name="pace2011LancetEd" />


Line 766: Line 770:
<ref>http://www.primarycarereports.co.uk/uk.html/</ref>
<ref>http://www.primarycarereports.co.uk/uk.html/</ref>


===2012: Cost-effectiveness of CBT and GET===
'''2012: Cost-effectiveness of CBT and GET'''
 
This paper was published in the [[PLoS One]] journal and concluded that [[cognitive behavioral therapy]] and [[graded exercise therapy]] had the best probability of being the most cost-effective treatments.<ref name="pace2012CE" /> The UK media publicised the results from this paper
This paper was published in the [[PLoS One]] journal and concluded that [[cognitive behavioral therapy]] and [[graded exercise therapy]] had the best probability of being the most cost-effective treatments.<ref name="pace2012CE" /> The UK media publicised the results from this paper
<ref>http://www.bbc.co.uk/news/health-19076398</ref><ref>http://www.nursingtimes.net/nursing...fatigue-syndrome/5047819.article?referrer=RSS </ref><ref>http://www.independent.co.uk/life-style/health-and-families/health-news/two-chronic-fatigue-syndrome-treatments-offer-good-value-8000997.html</ref><ref>http://www.huffingtonpost.co.uk/2012/08/02/how-to-spot-symptoms-chronic-fatigue-syndrome_n_1732004.html</ref><ref>http://www.nhs.uk/news/2012/08august/Pages/Pacing-for-chronic-fatigue-syndrome-not-cost-effective.aspx</ref>. Controversy has broken out over the failure of the study authors to provide the underlying data to Professor James Coyne under PLoS One's data-sharing policy.<ref name="Coyne20160214" /> Journalist [[David Tuller]] has criticized the study's assumptions and conclusions.<ref name="Tuller20151222" />
<ref>http://www.bbc.co.uk/news/health-19076398</ref><ref>http://www.nursingtimes.net/nursing...fatigue-syndrome/5047819.article?referrer=RSS </ref><ref>http://www.independent.co.uk/life-style/health-and-families/health-news/two-chronic-fatigue-syndrome-treatments-offer-good-value-8000997.html</ref><ref>http://www.huffingtonpost.co.uk/2012/08/02/how-to-spot-symptoms-chronic-fatigue-syndrome_n_1732004.html</ref><ref>http://www.nhs.uk/news/2012/08august/Pages/Pacing-for-chronic-fatigue-syndrome-not-cost-effective.aspx</ref>. Controversy has broken out over the failure of the study authors to provide the underlying data to Professor James Coyne under PLoS One's data-sharing policy.<ref name="Coyne20160214" /> Journalist [[David Tuller]] has criticized the study's assumptions and conclusions.<ref name="Tuller20151222" />


===2013: "Recovery" rates===
'''2013: "Recovery" rates'''
 
This paper appeared in [[Psychological Medicine]].<ref name="pace2013a" /> The [[Science Media Centre]] issued an "expert opinion" about the study.<ref name="paceSMC20130131" />
This paper appeared in [[Psychological Medicine]].<ref name="pace2013a" /> The [[Science Media Centre]] issued an "expert opinion" about the study.<ref name="paceSMC20130131" />


Line 779: Line 785:
Patients created a tongue-in-cheek song video to satirically criticize the recovery paper results.<ref name="MERecoverySong" />
Patients created a tongue-in-cheek song video to satirically criticize the recovery paper results.<ref name="MERecoverySong" />


===2013: Statistical analysis plan===
'''2013: Statistical analysis plan'''
 
Trials Journal published the detailed plan for PACE's data analysis.<ref name="pace2013sap" />
Trials Journal published the detailed plan for PACE's data analysis.<ref name="pace2013sap" />


===2014: Adverse effects===
'''2014: Adverse effects'''
 
The Journal of Psychosomatic Research published the results on safety and adverse effects.<ref name="pace2014AE" />
The Journal of Psychosomatic Research published the results on safety and adverse effects.<ref name="pace2014AE" />


===2015: Secondary mediation analysis===
'''2015: Secondary mediation analysis'''
 
[[The Lancet Psychiatry]] published this paper. <ref name="pace2015SMA" />  The UK and international media publicised the results from this paper. <ref name="FoxNews20150114" /><ref name="Guardian20150114" /><ref>http://www.bbc.co.uk/news/health-30795506</ref>
[[The Lancet Psychiatry]] published this paper. <ref name="pace2015SMA" />  The UK and international media publicised the results from this paper. <ref name="FoxNews20150114" /><ref name="Guardian20150114" /><ref>http://www.bbc.co.uk/news/health-30795506</ref>
<ref>http://www.economist.com/news/science-and-technology/21639438-controversial-trial-mysterious-disease-continues-yield-insights-fear</ref>
<ref>http://www.economist.com/news/science-and-technology/21639438-controversial-trial-mysterious-disease-continues-yield-insights-fear</ref>
Line 802: Line 811:
[[File:Lancet_pace_follow-up_study_chart.jpg|100px|thumb|right|PACE long-term follow-up]]
[[File:Lancet_pace_follow-up_study_chart.jpg|100px|thumb|right|PACE long-term follow-up]]


===2015: Long-term follow-up===
'''2015: Long-term follow-up'''


Long-term follow-up results were published in [[The Lancet Psychiatry]] in October 2015.<ref name="pace2015FU" />
Long-term follow-up results were published in [[The Lancet Psychiatry]] in October 2015.<ref name="pace2015FU" />
Line 814: Line 823:
Professors [[James Coyne]] and [[Keith Laws]] criticised the results as "uninterpretable" and consisting of "null findings."<ref name="Coyne20151029mb" /> The [[ME Association]] also criticized the follow-up study.<ref name="MEASSUK20151028press" />
Professors [[James Coyne]] and [[Keith Laws]] criticised the results as "uninterpretable" and consisting of "null findings."<ref name="Coyne20151029mb" /> The [[ME Association]] also criticized the follow-up study.<ref name="MEASSUK20151028press" />


===2015: Longitudinal mediation analysis===
'''2015: Longitudinal mediation analysis'''
 
This short paper published in Trials Journal concluded: "Approximately half of the effect of each of CBT and GET [...] on physical function was mediated through reducing avoidance of fearful situations".<ref name="pace2015lm" />
This short paper published in Trials Journal concluded: "Approximately half of the effect of each of CBT and GET [...] on physical function was mediated through reducing avoidance of fearful situations".<ref name="pace2015lm" />



Revision as of 02:45, August 2, 2022

Pace trial.png

The PACE Trial study (short for "Pacing, graded Activity, and Cognitive behaviour therapy; a randomised Evaluation") was a large and controversial trial of treatments for people with Chronic Fatigue Syndrome (CFS), also known as Myalgic Encephalomyelitis (ME).[1]

The PACE trial compared standardised specialist medical care (SMC) alone to SMC plus Adaptive Pacing Therapy (APT), Cognitive Behavioral Therapy (CBT), or Graded Exercise Therapy (GET). The researchers that conducted the trial expected that the CBT and GET groups would see the greatest improvement,[1] and this finding was reported in subsequent articles published by them.[2][3][4] This claim has been controversial, however, due to patient groups finding that exercise made patients deteriorate and CBT lacked benefit, and concerns regarding the methodology and refusal to release the full data.[5][6][7] Some patients campaigned for the full release of the PACE study's results, and after a five year battle, the PACE trial data was released for others to analyse.[8] The full PACE data led to over 40 scientists writing an open letter to the Lancet to raise serious concerns about the study, and asking for a new, independent analysis of results.[7]

The PACE trial has been highly influential in clinical guidelines in the UK, and other countries, in both government funded health care and private medical insurance, and had a significant influence on the Cochrane reviews for ME/CFS treatments.[9][10][11] By the time the main PACE trial results were published, the UK had included CBT and GET in clinical guidance for four years - the PACE trial was expected to confirm that they were effective.[9]

Background[edit | edit source]

The PACE trial[2] was funded by the UK Medical Research Council, Department of Health and Social Care (UK) for England, Scottish Chief Scientist Office, and - apparently uniquely for a clinical trial - the Department for Work and Pensions - the government department for sickness, disability and pension benefits. The PACE trial cost £5 million[12] and is the most expensive piece of research into ME/CFS ever conducted.

Recruitment of patients began in March 2005 and data collection was completed in January 2010.[2] The study protocol was published in BMC Neurology in 2007.[13] The main study outcomes were published in The Lancet in 2011[2] and the experimenters continued to publish papers on the PACE trial for a number of years.

The principal investigators were Professors Peter White, Trudie Chalder, and Michael Sharpe. Although not an author, Professor Simon Wessely provided feedback on their report.[2] He stated in November 2015 that "there are also more trials in the pipeline".[14]

Study design[edit | edit source]

641 patients were randomised into four groups in the study.[2] All received specialist medical care (SMC), which consisted of medication for symptoms such as insomnia and pain, and general advice to avoid extremes of rest and inactivity.[15] One group received SMC alone. Patients in another group additionally received adaptive pacing therapy (APT), and were advised to stay within the limits of activity imposed by the disease to give their bodies the best chance of recovery.[16] The other two groups were both told that they were not ill but deconditioned, and that if they gradually increased their activity, there was nothing to prevent their recovery.[17][18] The cognitive behavioural therapy (CBT) group focused on addressing their presumed fear of activity while the graded exercise therapy (GET) group focused on increasing their activity in a structured manner, with regular aerobic exercise as the eventual goal.

Patients in the APT, CBT and GET groups were offered up to 14 sessions with a therapist over a six-month period, to support them in following their therapy programmes, with a top-up session at 36 weeks. They also received a lengthy manual[16][17][18] explaining their therapy. All participants were offered at least three sessions of SMC.

Patients were assessed at baseline, 12 weeks, 24 weeks and 52 weeks. The main outcome measures were self-rated fatigue and physical function. Secondary measures included the study's objective variables such as a six-minute walking test, a fitness test and economic measures including the number of days of work lost due to fatigue, and the receipt of sickness benefits.[13]

Patients were also followed up (using subjective ratings only) at least two years after randomisation.[4]

As of 7 May 2018, the PACE manuals were not retrievable from the QMUL website, but they were retrievable as of 16 July 2022.[19]

All documents pertaining to the PACE trial can be found following the link PACE trial documents.

Findings[edit | edit source]

The trial's results showed that patients in the CBT and GET groups improved more in self-rated fatigue and physical function than the APT or SMC-only groups.[2] Apart from the GET group improving slightly more than the others on the six-minute walking test,[2] all of the study's objective measures[20][21] and the long-term follow-up data[4] (self-ratings of fatigue and physical function) showed no difference between groups.

The authors reported, in a 2013 paper specifically about recovery, that 22% of patients in the CBT and GET groups had recovered following these therapies, compared to 8% in the APT group and 7% in the SMC-only group.

Impact[edit | edit source]

The PACE trial and other studies that use the Oxford criteria for diagnosis of ME/CFS have had major international impact on popular perceptions of the disease and also on public policies toward treating and researching it.

Media[edit | edit source]

Daily Telegraph headline suggesting positivity and exercise

On February 27, 2011, when the first PACE trial paper was published, researchers Michael Sharpe and Trudie Chalder held a press conference[22][23][24] to discuss their findings. Chalder stated, “twice as many people on graded exercise therapy and cognitive behaviour therapy got back to normal.”[25] That assertion has been criticized for grossly overstating the study's actual findings.[26][27][28]

The claims made about the study were covered in the UK and international press.[29][30][31][32][33] For example, The Daily Mail stated, "Fatigued patients who go out and exercise have best hope of recovery",[34] while The New York Times declared "Psychotherapy Eases Chronic Fatigue Syndrome".[35] According to the British Medical Journal's report on the trial, some participants were "cured."[26]

Many other PACE papers followed, although with relatively little media attention until October 2015, when long-term follow-up results were published in The Lancet Psychiatry.[4][36][37][38][39][40][41] The Daily Telegraph ran a front-page story with the headline, "Exercise and positivity can overcome ME."[42][43] The piece stated, "Chronic Fatigue Syndrome is not actually a chronic illness and sufferers can overcome symptoms by increasing exercise and thinking positively, Oxford University has found". The article quoted Professor Sharpe describing ME as a “self-fulfilling prophesy” that happens when patients live within their limits. The article was altered following public pressure but no formal retraction was made. Science Magazine also published an article in October 2015 along with comments from Sharpe about the growing criticism outwith the patient community from the broader science community.[44]

In the UK the Science Media Centre is a government-funded body that describes its purpose as being to improve science journalism. Its reporting on ME/CFS has been criticized for bias towards a psychological etiology for the disease.[45]

Influence on treatment[edit | edit source]

The sheer size of the PACE trial means that it dominates the evidence base in ME/CFS. Together with other studies of CBT and GET, it is highly influential in UK clinical policy and that of many other countries, both in terms of healthcare provided by government[9] and by private medical insurance.[10][11] The influential Cochrane exercise therapy review relied significantly on the PACE trial.[46]

In the UK, the NICE guidelines for NHS-provided care[9] recommend CBT and GET for ME/CFS. They were published in 2007, before the PACE trial was conducted, but the evidence was based on a few small trials and was considered "somewhat limited".[47] The ME Association has asked for the guidelines to be updated to take into account new treatment evidence, noting, "we assume that the guideline surveillance review that took place in March 2011, and which followed publication of the PACE trial in February 2011, simply ‘rubber stamped’ the 2007 NICE guideline recommendations on the basis that the PACE trial had supported the recommendations relating to CBT and GET."[48] NICE responded, "we still do not feel that the evidence base is substantially evolving in this area at this time".[49] After considerable objections, this decision was reversed and the NICE guidelines clinical review began in 2017.[50]

In the US, the Mayo Clinic, Cleveland Clinic, Kaiser Permanente, and numerous key secondary medical education providers, such as UpToDate and WebMD, recommend CBT and GET, using PACE as a reference. CBT and GET were included in the Center for Disease Control's clinical guidelines for CFS, based on the PACE trial evidence.[51]

Criticisms of the study[edit | edit source]

Selection of patients[edit | edit source]

The PACE trial used the Oxford criteria for diagnosis. Many patients and specialist clinicians consider them overly broad,[52][53] and the National Institutes of Health 2015 P2P report[54] on ME/CFS recommended that the Oxford definition be retired for this reason.

Changes in criteria for effectiveness and recovery[edit | edit source]

PACE recovery thresholds - author confusion.
Image: Senseaboutscienceusa.org

The authors abandoned their protocol-specified main outcome and recovery analyses partway through the trial and replaced them with others.[2][3] They have defended the changes, noting, "All these changes were made before any outcome data were analyzed (i.e. they were pre-specified), and were all approved by the independent PACE Trial Steering Committee and Data Monitoring and Ethics Committee."[55] However, 42 scientists, in an open letter to the Lancet, stated that the changes were of "of particular concern in an unblinded trial like PACE, in which outcome trends are often apparent long before outcome data are seen. The investigators provided no sensitivity analyses to assess the impact of the changes and have refused requests to provide the results per the methods outlined in their protocol."[56]

Most notably, the authors introduced post-hoc "normal ranges" for fatigue and physical function.[2] These ranges have been heavily criticised for having thresholds so low that patients could worsen from trial entry and yet be within these normal ranges. The "normal range" for physical function (measured on the SF-36 100-point scale) was 60 and above, even though patients had to score 65 or lower to enter the trial. A score of 60 is close to the mean physical function score (57) of patients with Class II coronary heart failure.[57]

PACE recovery thresholds - much lower than for healthy people of similar age. Image: Senseaboutscienceusa.org

"The average age of participants in the PACE trial is about 39 years old; normative data suggest that people in this age group should have SF-36 scores of about 93. Yet the new 2013 “normal” is a score of 60."[58]

The PACE authors used the "normal ranges", in conjunction with other thresholds, to define clinical effectiveness in the Lancet[59] paper and recovery rates in a later paper in Psychological Medicine.[60]

All Freedom of Information requests to the authors for the main outcome and recovery results according to the protocol-specified analyses, or for the underlying data so that others could conduct the analyses, have been refused.[61][62][63][64]

Use of subjective main outcome measures[edit | edit source]

The study has been criticised for having subjective primary analyses in an unblinded trial.[65] Subjective measures are known to be susceptible to bias, as can arise from expectations and social pressure. The CBT and GET groups, but not the others, were told that there was nothing to stop them from recovering if they gradually increased their activity, and critics have argued that these differential expectations could have inflated their self-assessments.[7][66]

Conflicts of interest and lack of informed consent[edit | edit source]

The forty-two scientists and clinicians who wrote an open letter to the Lancet complaining about the PACE trial criticized the study authors' failure to disclose a potential conflict of interest to trial participants.[56] They wrote:

"The investigators violated their promise in the PACE protocol to adhere to the Declaration of Helsinki, which mandates that prospective participants be 'adequately informed' about researchers’ “possible conflicts of interest.” The main investigators have had financial and consulting relationships with disability insurance companies, advising them that rehabilitative therapies like those tested in PACE could help ME/CFS claimants get off benefits and back to work. They disclosed these insurance industry links in The Lancet but did not inform trial participants, contrary to their protocol commitment. This serious ethical breach raises concerns about whether the consent obtained from the 641 trial participants is legitimate."

Newsletter to participants[edit | edit source]

The investigators published newsletters for participants[67][68][69][70] while the trial was still underway. Critics have said that the material in the third newsletter[69] could have influenced patients' self-reported outcomes. It included a number of positive testimonials from patients in the trial, but without naming their therapies. The PACE authors have argued that this meant that there would be no bias in favour of CBT and GET[55] but Professor James Coyne has dismissed the idea that bias would be expected to affect all four groups equally.[71][72]

The newsletter did, however, announce that the new NICE guidelines, "based on the best available evidence... recommended therapies [that] include Cognitive Behavioural Therapy, Graded Exercise Therapy and Activity Management." There was no explanation of what "Activity Management" was: no group had that title in the PACE trial. Dr. Bruce Levin, a professor of biostatistics at Columbia University and an expert in clinical trial design, said, “To let participants know that interventions have been selected by a government committee ‘based on the best available evidence’ strikes me as the height of clinical trial amateurism”.[26] The newsletter also contained a less than positive assessment of research on the possibility of an infectious component of ME/CFS, including research by Jose Montoya on herpesviruses and by John Chia on enteroviruses. The newsletter said of Dr Chia's work, for example, "The laboratory work looked convincing, but many patients had significant gastro-intestinal symptoms and even signs, casting some doubt on the diagnoses of CFS being the correct or sole diagnosis in these patients." It is possible that this negative view of evidence of an ongoing infection would have made the rationale for APT appear less plausible and that for CBT and GET more plausible, thus biasing the participants.

An account of another study, in contrast, gave a positive assessment of CBT, saying "cognitive behaviour therapy was associated with an increase in grey matter of the brain and this increase was associated with improved cognitive function".

Risks and side effects[edit | edit source]

A survey[6] conducted by the ME Association in 2012 showed that 74% of patients had their symptoms worsen after a course of GET. In contrast, the PACE trial found no apparently meaningful difference in rates of adverse events between the four trial groups,[73] suggesting that APT, CBT and GET added no risk to SMC alone (since all four groups received SMC). However, critics have questioned whether patients actually increased their activity sufficiently in the CBT and GET groups to trigger many serious adverse events:[74][75] the lack of improvement in the step-fitness test in all groups indicates that this is distinctly possible.[21]

Analysis by "citizen-scientists" - ME Sufferers and Charities[edit | edit source]

Numerous ME sufferers and other interested parties have produced critiques of the PACE trial including statistical analyses and trial methodology.

Robert Courtney

Mr Courtney has written a number of published letters in the medical journals, criticising PACE.

"Chalder and colleagues acknowledge that the trial outcomes do not support the hypothetical deconditioning model of GET for chronic fatigue syndrome".[76]

Peter Kemp

Peter Kemp has written a detailed 30 page critique of the study split into 10 sections called the 'PACE Trial Analysis' [77].

Angela Kennedy

Angela Kennedy has made specific critiques of PACE regarding the following areas:[78]

  1. Serious risks to clinical patient safety caused by unsound claims made about the efficacy of CBT and GET following the PACE trial;
  2. Gross discrepancies between research and clinical cohorts, and how clinical patients (and the physiological dysfunction associated with them) appear to have been actively excluded from PACE and other research by the research group involved in PACE, which has, ironically, caused serious resulting risks to clinical patient safety in the UK in particular;
  3. Related to the above, gross discrepancies in how various sets of patient criteria were used (and/or rejected), including but not limited to a changing of the London criteria by PACE authors from its original state, a set of criteria which was already controversial and problematic to start with for a number of reasons;
  4. Failure of the PACE trial authors to acknowledge the range and depth of scientific literature documenting serious physiological dysfunction in patients given diagnoses of ME or CFS, and how CBT and GET approaches may endanger patients in this context;
  5. The inclusion of major mental illnesses in the research cohort;
  6. The distortion by PACE trial researchers of 'pacing' from an autonomous flexible management strategy for patients into a therapist led Graded Activity approach;
  7. The post hoc dismissal of adverse outcomes as irrelevant to the trial, in direct contradiction to what is scientifically known about the physiological dysfunctions of people given diagnoses of Myalgic Encephalomyelitis or Chronic Fatigue Syndrome;
  8. The instability of 'specialist medical care' as a treatment category, and the lack of any sound category of 'control' group.

Frank Twisk

Dutch patient Frank Twisk of the ME-de-patiënten Foundation has also published criticism of the PACE trial.[79]

"The PACE trial investigated the effects of CBT and GET in chronic fatigue, as defined by the Oxford criteria, not in chronic fatigue syndrome, let alone myalgic encephalomyelitis".

"[T]he positive effect of CBT and GET in subjective measures, fatigue and physical functioning, cannot be qualified as sufficient. Mean short form-36 physical functioning scores in the CBT group (62·2) and the GET group (59·8) at follow-up were below the inclusion cutoff score for the PACE trial (≤65)3 and far below the objective for recovery as defined in the PACE protocol (≥85)."

"The vast majority of patients improved subjectively by specialist medical care and APT to the same level as by CBT and GET, without any additional therapies, including CBT and GET, or by other therapies."

"[L]ooking at subjective outcomes at follow-up and objective outcomes in earlier studies, such as physical fitness, return to employment, social welfare benefits, and health-care usage, CBT and GET, like specialist medical care and APT, cannot be qualified as effective".

Tom Kindlon

Tom Kindlon a patient and Vice-Chairman of the Irish ME/CFS Association. He has published extensive criticism of the PACE trial. In 2011 he published a paper on harms associated with Graded exercise therapy.[74]

Mr Kindlon has also written a large number of letters and comments that have been published in medical journals in response to the published papers.

Among many other published letters that have been critical of the trial, many are from people who have identified themselves as patients. For example, most of the letters published by The Lancet criticising the 2011 PACE paper were from patients or representatives of patients' groups.[80][81][82]

ME Analysis: Evaluating the results of the PACE Trial study

Janelle Wiley and Graham McPhee also collaborated with others from Phoenix Rising to create 'ME Analysis: Evaluating the results of the PACE Trial' website summarising their critique of the trial.

It examined the flaws with the PACE trial and came up with 10 conclusions. The 'ME Analysis: Evaluating the results of the PACE Trial' is presented in the form of 10 conclusions. Clicking on each conclusion will lead to a short summary, and clicking on the links underneath each summary will, if you wish, lead you ever deeper into our analysis.

ME Analysis videos by Phoenix Rising

Members of Phoenix Rising including Graham McPhee and Tom Kindlon have collaborated on a set of explanatory videos about flaws in PACE's statistical analyses on YouTube:

ME Charities criticism and complaints

Charities have criticised it including Invest in ME [83]. Jane Colby of Tymes Trust wrote a letter to the Guardian [84]. The ME Association have also criticised the PACE trial.

MEAction

MEAction submitted a petition to retract the PACE trial that received over 12,000 signatures.[85] In addition, #MEAction published a 'PACE Trial overview' of the PACE trial and its flaws, produced by patients.[86] MEAction have also produced a factsheet of 'Why ME patients are critical of the PACE trial' which addresses three major myths which have been created by the PACE trial investigators and the harms that these myths have caused[87]. The myths busted include MYTH: 1 'The controversy is fueled by a vocal minority of “vociferous” ME militants on the internet, 2. MYTH: M E sufferers oppose GET because they are afraid of exercise 3. MYTH: ME sufferers oppose CBT because they are afraid of the stigma of mental illness.

Briefing document from a Science for ME working group

Consisting of patients including Tom Kindlon, Sean Kirby and Graham McPhee, this working group has produced a document to concisely explain the flaws in the PACE trial.

ME Analysis videos (2018)

Graham McPhee has created a set of three videos looking again at the PACE trial.

Others including Jessica Kellgren-Fozard, a vlogger and TV producer with a large social media following, created a video in May 2018 called 'Have you been misled...? // What is PACE? // Medical Scandal' which had been viewed over 35,000 times.[88]

Controversy[edit | edit source]

The PACE Trial has been heavily criticised by patient groups and some researchers and science journalists for a number of methodological problems since its publication. [26][27][28][55][89][90][91][92][93]

Prof Malcolm Hooper's complaints[edit | edit source]

Prof Malcolm Hooper and Margaret Williams have followed the PACE trial from its inception in 2004 and provided salutary warnings about the possible issues and problems with the conduct of the trial due to their previous knowledge of the principal investigators research.[94][95]

They then published a 400 page critique of the PACE trial in February 2010 'Magical Medicine: How to make a disease disappear'.[96] In February 2011 upon publication of the PACE trial findings, Prof Hooper submitted a comprehensive complaint to the editor of the Lancet[97] and a further detailed response[98].

Prof Hooper et al in 2011 published further concerns about the PACE trial[99] and have also examined the role of the Science Media Centre and the insurance industry with the PACE trial[100]. The Key Concerns about the PACE trial were also published in 2013 by MEActionUK.[101] Prof Hooper has published a summary of the key dates and chronology of the trial since 2004.[102]

Investigation by public health journalist and academic, Dr. David Tuller[edit | edit source]

Renewed interest in the trial came in October 2015 with public health expert and investigative journalist Dr. David Tuller's investigative "Trial by Error: The Troubling Case of the PACE Chronic Fatigue Syndrome Study" publication on Virology Blog which gave a detailed analysis of PACE's methodological problems. Dr. Tuller continues to publish articles criticizing different aspects of the trial.[103] The main articles for the "Trial by Error" series on the PACE trial are listed below.


The PACE trial authors, with the exception of their response to Virology on October 30, 2015, have refused to respond to or engage with David Tuller about these concerns; Tuller made requests for comment in 2015 and 2016. Similarly, Richard Horton, editor of the Lancet has refused to respond to Tuller about these concerns or about the retraction of the PACE trial publication. Sir Simon Wessely on behalf of the PACE trial principal investigators did publish an article in November 2015 The PACE trial for chronic fatigue syndrome: choppy seas but a prosperous voyage referring to the growing concerns over the PACE trial. This was published in a blog website called National Elf Service run by the Mental Elf, in which he used an analogy of the clinical trial as an ocean liner crossing the Atlantic.[14]

Further criticism from scientific community[edit | edit source]

Dr James Coyne, Professor of Health Psychology, at the University Medical Centre Gronigen]] (UMCG), published on PLoS One Blog on 29 October 2015 "Uninterpretable: Fatal flaws in PACE Chronic Fatigue Syndrome follow-up study".[72] He gave a talk at Edinburgh University in November 2015 criticising the PACE trial [104][105][106][107]. He spoke again about the PACE study in Belfast in February 2016 where he described it as "a wasteful trainwreck of a study".[108][109] Professor Coyne has also questioned whether the PACE trial paper could ever have been properly peer-reviewed, given the large number of study authors and the small world of British science.[110] He has continued to critique the PACE trial.[111]

Dr Keith Laws, Professor of Neuropsychology at the University of Hertfordshire has also criticised the PACE trial in a number of blogs on his website in November 2015.[112][113] He also co-authored a letter in the Lancet Psychiatry in 2016 with Dr. Coyne "Results of the PACE follow-up study are uninterpretable".[114]

Science journalist Julie Rehmeyer published an article in Slate magazine in November 2015 called "Hope for Chronic Fatigue Syndrome: The debate over this mysterious disease is suddenly shifting" and contrasted the hope that sufferers had with research being conducted in the US and the UK researchers involved with PACE trial.[115] Julie Rehmeyer has continued to criticise the PACE trial with further publications and in conferences.[116][117][116]

Lucy Bailey, a former editor of the Lancet, analysed the PACE trial and provided her comments on the controversy, concluding, "Psychiatrists need to understand that their presence anywhere near this condition is now toxic, and maybe they need to take a step back".[118] Bailey also wrote a letter to the Lancet Infectious Disease called "A case for Retraction?" and has questioned the reasons why actigraphy was dropped late in the trial.[119][120]

Dr Mark Vink, a family physician in the Netherlands, published in the Journal of Neurology and Neurobiology on 30 March 2016 "The PACE Trial Invalidates the Use of Cognitive Behavioral and Graded Exercise Therapy in Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome: A Review".[121]

Prof Jonathan Edwards has declared that "PACE is valueless for one reason: the combination of lack of blinding of treatments and choice of subjective primary endpoint. Neither of these alone need be a fatal design flaw but the combination is". He also stated "the authors have not been meticulous in trying to avoid bias that might arise. On the contrary they appear to have acted in ways more or less guaranteed to maximise bias."[66]

In early 2016, Leonid Schneider, a science journalist, criticised the lack of data sharing by the PACE trial authors and the Lancet and its editor Richard Horton's role in the scandal and compared it to other recent Lancet scandals.[122][123][124]

Prof Andrew Gelman, Professor of Statistics and Political Science at Columbia University, NY, examined the Lancet's role in how the PACE trial got taken so seriously and stayed afloat for so long.[125][126][127][128]

Dr Sten Helmfrid published an article in the journal Socialmedicinsk tidskrift in September 2016 called "Studies on Cognitive Behavioral Therapy and Graded Exercise Therapy for ME/CFS are misleading" that criticized not only the PACE trial, but the entire CBT/GET paradigm for ME/CFS. "The underlying model has no theoretical foundation and is at odds with physiological findings. Surveys suggest that the efficacy of CBT is no better than placebo and that GET is harmful. Therefore, cognitive behavioral therapy and graded exercise therapy for ME/CFS are not evidence based."[129]

Dr Sonia Lee, a clinical epidemiologist, published 30 slides critically appraising the PACE trial in February 2017 and concluding the PACE trial authors should "rectify or retract".[130][131] Dr Lee has also wrote "Research Waste In ME/CFS" which compared psychosocial trials using the PACE trial in the study as more likely to engage in selective reporting than biomedical trials which means that they are a waste of money and time and "it confirms the concerns raised by ME/CFS groups that psychosocial interventions are harmful, and present questionable therapeutic benefits no different to a placebo" [132] [133].

Professor Leonard Jason in the Journal of Health Psychology wrote in February 2017 'The PACE trial missteps on pacing and patient selection' which criticised the issue of patient selection in the trial with the use of the Oxford criteria included those without the disease and the PACE trial investigators did not design and implement a valid pacing intervention in the trial.[134]

Dr Sarah Myhill in her August 2017 video on Medical Abuse in ME Sufferers (MAIMES) called the PACE trial "fraudulent" and "a criminal act" and is an "abuse" of "vulnerable people" and "defrauds them of benefits".[135]

In April 2018 Dr Neil McGregor analysed the harms in the PACE trial and stated that "The conclusions within the PACE studies is consistent with a highly biased study which under-estimates, and does not assess, the adverse outcomes in relationship to the disease process. The use of therapies of this type cannot be recommended based upon the data within the PACE study and must exclude the worst affected patients as they were not included in the study assessments." [136].

Scientists' open letter to The Lancet and Psychological Medicine[edit | edit source]

In November 2015, scientists Ronald Davis, David Tuller, Vincent Racaniello, Jonathan Edwards, Leonard Jason, Bruce Levin and Arthur Reingold wrote an open letter to The Lancet citing "major flaws" in the original trial publication and asking for an independent re-analysis of the individual-level trial data.[7] The journal failed to respond.

In February 2016 the open letter was re-published with 36 additional signatures from doctors and researchers including: Dharam Ablashi, Lisa Barcellos, James Baraniuk, Lucinda Bateman, David Bell, Alison Bested, Gordon Broderick, John Chia, Lily Chu, Derek Enlander, Mary Ann Fletcher, Kenneth Friedman, David Kaufman, Nancy Klimas, Charles Lapp, Susan Levine, Alan Light, Sonya Marshall-Gradisnik, Peter Medveczky, Zaher Nahle, James Oleske, Richard Podell, Charles Shepherd, Christopher Snell, Nigel Speight, Donald Staines, Philip Stark, John Swartzberg, Ronald Tompkins, Rosemary Underhill, Rosamund Vallings, Michael VanElzakker, William Weir, Marcie Zinn and Mark Zinn.[56]

Richard Horton, the editor of the Lancet, requested it to be submitted as an official letter but after 6 months of chasing he rejected it and refused to publish the letter.[137][138]

On March 13, 2017 David Tuller and the original signatories to the open letter to the Lancet in 2016 and an additional 37 signatories signed an open letter to the Journal of Psychological Medicine. In total 102 signatories signed this open letter regarding the recovery paper of 2013 to the Journal of Psychological Medicine.

These included scientists and medical professionals including Molly Brown, Todd E. Davenport, Simon Duffy, Meredyth Evans, Robert F. Garry, Keith Geraghty, Ian GibsonRebecca Goldin, Ellen Goudsmit, Maureen Hanson, Malcolm Hooper, Betsy Keller, Andreas M. Kogelnik, Eliana M. Lacerda, Vincent C. Lombardi, Alex Lubet, Steven Lubet, Patrick E. McKnight, Jose G. Montoya, Henrik Nielsen, Elisa Oltra, Nicole Porter, Anders Rosén, Peter C. Rowe, William Satariano, Ola Didrik Saugstad, Eleanor Stein, Staci Stevens, Julian Stewart, Leonie Sugarman, Mark VanNess, Mark Vink, Frans Visser, Tony Ward, John Whiting, Carolyn Wilshire and Michael Zeineh.

27 ME Charities from 17 countries also co-signed the open letter including 25 Percent ME Group (UK), Emerge Australia, European ME Alliance, Belgium ME/CFS Association, ME Foreningen (Denmark), Suomen CFS-Yhdistys (Finland), Fatigatio e.V. (Germany), Het Alternatief (Netherlands), Icelandic ME Association, Irish ME Trust, Associazione Malati di CFS (Italy), Norges ME Forening (Norway), Liga SFC (Spain), Riksföreningen för ME-patienter (Sweden), Verein ME/CFS Schweiz (Switzerland), Invest in ME Research (UK), Hope 4 ME and Fibro Northern Ireland, Irish ME/CFS Association, Massachusetts CFIDS/ME & FM Association (US), ME Association (UK), ME/cvs Vereniging (Netherlands), National ME/FM Action Network (Canada), New Jersey ME/CFS Association (US), Pandora Org (US), Phoenix Rising, International Solve ME/CFS Initiative (US), Tymes Trust (UK), and Wisconsin ME & CFS Association (US).

On 23 March 2017, David Tuller reported that one of the editors of the Journal of Psychological Medicine, Sir Robin Murray, responded with "an unacceptable response." Tuller restated that "That the editors of Psychological Medicine do not grasp that it is impossible to be “disabled” and “recovered” simultaneously on an outcome measure is astonishing and deeply troubling." The open letter was reposted with 17 additional individuals and 23 more charities. These included more scientists, medical p, rofessionals and lawyers including Norman E. Booth, PhD, FInstP, Joan Crawford, CPsychol, CEng, CSci, MA, MSc, Lucy Dechene, PhD, Valerie Eliot Smith, Margaret C. Fernald, PhD, Simin Ghatineh, MSc, PhD, Alan Gurwitt, M.D., Geoffrey Hallmann, LLB, DipLegPrac, Susan Levine, MD, Marvin S. Medow, Ph.D., Sarah Myhill MB BS, Pamela Phillips, Gwenda L Schmidt-Snoek, PhD, Robin Callender Smith, PhD, Samuel Tucker, MD, AM Uyttersprot, MD, Paul Wadeson, Bsc, MBChB, MRCGP.

An additional 25 charities to sign included Action CND (Canada), Associated New Zealand ME Society, Chester MESH group, Deutsche Gesellschaft für ME/CFS, Lost Voices Stiftung (Germany), M.E. Victoria Association (Canada), ME North East (UK), ME Research UK, ME Self Help Group Nottingham (UK), ME/CFS and Lyme Association of WA, Inc. (Australia), ME/CFS (Australia) Ltd, ME/CFS Australia (SA), Inc., ME/CVS Stichting Nederland, ME/FM Society of British Columbia (Canada), MEAction, Millions Missing Canada, National CFIDS Foundation, Inc. (US), North London ME Network (UK), Oxfordshire ME Group for Action (UK), Open Medicine Foundation (US), Quebec ME Association (Canada), The York ME Community (UK), Welsh Association of ME & CFS Support (UK) and Steungroep ME en Arbeidsongeschiktheid (Netherlands).

No response from the Lancet was received - see continued campaigning in 2018 section below.

Petitions and Protests[edit | edit source]

On October 28, 2015, MEAction launched a petition addressed to The Lancet, Psychological Medicine and the PACE trial authors, calling for an independent analysis of the data and the retraction of some of the PACE trial's "misleading claims" based on "absurd 'normal ranges' for fatigue and physical function". The petition was closed in February 2016, having gathered 11,897 signatures from people in sixty-four countries.[5][139]

A US petition to the Agency for Healthcare Research and Quality (AHRQ) and the Centers for Disease Control was also launched in late 2015, asking government agencies to remove guidelines and recommendations based on PACE and other studies using the Oxford definition of ME/CFS.[140]

During International ME Awareness day (12 May) in 2017 due to the intransigence of the PACE researchers for years, a Millions Missing protest in London resulted in hundreds of patients protesting against the PACE trial.[141][142][143]

Breaches of patient's data security by study investigators[edit | edit source]

In 2006 confidential PACE trial patient data was stolen from an unlocked drawer at King's College London.[144]

Malcolm Hooper documents in Magical Medicine how in 2005 confidential patient data was erroneously released by PACE author Professor Michael Sharpe in relation to another study.[145]

The Centre for Welfare Reform - 'In the Expectation of Recovery'[edit | edit source]

The Centre for Welfare Reform published a 64 page report in April 2016 examining the PACE trial and relating the study to the biopsychosocial model and its links and influence from the insurance industry and government welfare reforms. The report titled 'In the Expectation of Recovery' by George Faulkner heavily criticised the PACE trial and stated “The way in which the biopsychosocial model has been used and promoted, without good supporting evidence for many of the claims being made, is unethical.” and “Had homeopaths or a pharmaceutical company conducted a trial and presented results in the manner of the PACE trial the British research community would have been unlikely to overlook its problems.”[146] Dr Simon Duffy writing in the Huffington Post questioned the motive of the research in 'The Misleading Research at the Heart of Disability Cuts'.[147]

Sense About Science USA[edit | edit source]

Sense about Science USA (SAS USA) published a major statistical examination of the PACE trial in March 2016. The Executive Director of SAS USA, Trevor Butterworth wrote an accompanying editorial on PACE.[148] Prof Rebecca Goldin of Mathematical Sciences at George Mason University and Director of STATS (a collaboration between SAS USA and the American Statistical Association) wrote the 7000 word statistical critique PACE: The research that sparked a patient rebellion and challenged medicine. [58]

Other major investigations and reports[edit | edit source]

In August 2016 Julie Rehmeyer presented a critique of the PACE trial at the largest gathering of statisticians in North America, the Joint Statistical Meeting 2016, in Chicago titled Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE Trial. Rehmeyer said “When I went through the slides showing the changes to the physical function criterion for recovery, I saw jaws drop.” [149]

PACE Trial in UK Parliament[edit | edit source]

The PACE Trial has been the subject of a number of parliamentary enquiries by parliamentarians mainly the Countess of Mar. The Countess of Mar asked questions of the government via a short debate in the House of Lords on the assessment of the PACE trial on 6 February 2013. A video and transcript is available on YouTube and Hansard.[150][151] Comments and analysis on the PACE trial and its establishment defenders has also been made by advocates.[152]

During the court case below in 2015 by Matthees and the Information Commissioners Office v QMUL it was stated by Peter White that he regarded parliamentary debates as harassment and had to brief those taking part in the debate.

In November 2016 Kelvin Hopkins MP asked seven written questions relating to the PACE Trial including "request that the Medical Research Council conducts an inquiry into the management of the PACE trial to ascertain whether any fraudulent activity has occurred." and "prevent the PACE trial researchers from being given further public research funding until an inquiry into possible fraudulent activity into the PACE trial has been conducted."

The Countess of Mar has also asked in February 2017 the Committee of Public Accounts to investigate the use of public funds on the PACE Trial and the PACE authors use of public funds to resist requests to release anonymised clinical trial data. Her letter included a report which stated the trial was "professional misconduct and/or fraud" and "Professor White obtained ethical approval for the study under false pretences".[153]

Response to criticism[edit | edit source]

Response[edit | edit source]

The trial investigators have replied to some criticism of the trial but have been much criticised as being evasive and not responding to the issues raised.

Some of their response to letters to The Lancet concerning their main analyses,[154] Psychological Medicine concerning their recovery analyses,[155] and Lancet Psychiatry concerning their secondary mediation analyses [156] and long-term follow-up paper.[157] A letter to the BMJ by Tom Kindlon[158] drew a reply from the authors[159] that in turn received 31 responses of its own.[160]

Since the controversy with criticism from the scientific community they have largely not responded to the key concerns and have repeated their earlier arguments.

The investigators have also responded to a 14,000-word critique by public health expert and journalist Dr David Tuller.[55] Dr Tuller wrote a rebuttal to their response.[89] He has said, “The PACE authors have long demonstrated great facility in evading questions they don’t want to answer”.

Professor James Coyne reported that he agreed to debate the authors on health website National Elf about the trial but that they declined.[161] Professor Simon Wessely was given the vacated National Elf spot and wrote a lengthy article praising the trial, noting that he once described it as "a thing of beauty" and saying, "We can accept that PACE was a good trial and we can have some confidence in its findings".[14]

Allegations of harassment, death threats and smear campaign[edit | edit source]

During the criticism of the PACE trial by patient groups the PACE trial psychiatrists publicised that they were receiving death threats and harassment.

The PACE trial investigators and Professor Simon Wessely have publicly claimed they have been harassed and subjected to death threats.[162][163][164][165][166][167][168][169] A feature article in the BMJ (read by most UK doctors) was published in June 2011 called 'Dangers of research into chronic fatigue syndrome'.[170] The Times article was titled 'Doctor’s hate mail is sent by the people he tried to cure'.[171] An article was also published in the Sunday Times magazine with Simon Wessely repeating the death threats narrative.[172] One article was even called ‘It’s safer to insult the Prophet Mohammed than to contradict the armed wing of the ME brigade’.[173]

However, the PACE authors and their supporters have been accused of blurring the line between harassment and legitimate criticism of the study. Documentation obtained under the Freedom of Information Act from meetings in 2013 that were attended by some of PACE’s principal investigators include a statement that “harassment is most damaging in the form of vexatious FOIs [Freedom of Information requests].”[174] This framing of FOIA requests as harassment is widely taken to be a reference to the PACE authors, who have complained about the number of FOI requests that they have received for data[175] and who have dismissed several as "vexatious":[176][177][178] the Information Commissioner's Office was told that Professor Peter White “believes that the requests are clearly part of a campaign to discredit the trial” and that “the effect of these requests has been that the team involved in the PACE trial, and in particular the professor involved, now feel harassed and believe that the requests are vexatious in nature.”[175]

The criticisms of the trial's methodology and analyses by patients and others has been referred to by the investigators - and The Lancet - as part of a campaign to undermine the the study. In an editorial comment that accompanied letters criticising the trial, The Lancet described the trial as “rigorously conducted” and questioned whether the “coordination of the response... has been born... from an active campaign to discredit the research”.[179] In an interview on Australian national radio shortly after publication, Dr Richard Horton, The Lancet’s editor, described patients who criticised the trial as “a fairly small, but highly organised, very vocal and very damaging group of individuals”.[180]

But some accuse the investigators of a campaign against patients, labelling them as harassers to undermine their criticisms of the trial, including Angela Kennedy.[181]

The PACE trial authors refused to provide anonymised data to many individuals and also refused to accept the Information Commissioners Office decision for QMUL to release the data in 2015 (see Release of Data/Information Tribunal below). During the PACE trial authors appeal to the Tribunal an article was published during this period by their associates in Nature in which they bizarrely appeared to use projection in describing disabled ME sufferers as “hard-line opponents” of research into chronic fatigue syndrome and compared them with industry lobbyists such as tobacco and climate change denialists.[182][183] Public health expert and journalist David Tuller, who has said, “Wrapping themselves in victimhood, the [PACE authors] have even managed to extend their definition of harassment to include any questioning of their science and the filing of requests for data — a tactic that has shielded their work from legitimate and much-needed scrutiny.” [184] [185]

The Science Media Centre (SMC) was found to have orchestrated and publicised the false narrative in 2011 in the UK media about extremists harassing researchers.[186][187] An article in the Establishment in May 2016, The Hidden Battle For The Rights Of Chronic Fatigue Syndrome Sufferers summarised the campaign to smear ME sufferers and how these psychiatrists after categorising ME as a psychological over two decades then were able to use institutional gaslighting when patients were question the scientific validity of the trial and to stop access to data requests from the PACE trial by framing them as harassment and abuse. Catherine Hale has written about the 'Politics of Stigma' created for ME sufferers by the PACE trial authors.[188] Peter Tatchell, a human rights advocate has supported ME sufferers for their human rights against the psychotherapies and the PACE trial and defended them from the smear campaigns by the psychiatrists similar to what he faced in his advocacy in the 1970s.[189][190][191] Ethics experts Charlotte Blease and Diane O'Leary have investigated ethics and injustice in the behavior of some researchers in the ME/CFS field and the effects of government and institutional actions on patients.

No evidence of anyone with ME/CFS in relation to these matters being charged by the police/law enforcement or convicted in the Courts with harassment and death threats has come to light, despite a number of ME advocates attempting to find evidence, including filing Freedom of Information Act requests to public bodies.[192][192][193][193][194]

Calls to release data[edit | edit source]

Open data commitments[edit | edit source]

The study authors have been criticised for failing to follow the requirements of the Medical Research Council (who provided significant funding for the trial) to release anonymised trial data.[195]

The 2012 PACE cost-effectiveness paper[20] was published in the journal PLoS One. That journal requires authors, as a condition of submitting their papers, to agree to release the anonymized trial data underlying the paper's analyses upon request. In November 2015 Professor James Coyne made a request to the PACE authors on that basis, but the authors treated his request as a Freedom of Information request and refused it.[196][197] However in March 2016 the PLoS One journal confirmed they had requested the investigators to release the trial data, as they committed to do prior to publication.[198][199]

In 2015 Peter White lobbied the UK government through his university QMUL and the Science Media Centre to restrict the Freedom of Information Act 2000 for universities especially for controversial research and cited the PACE trial and compared ME patients requesting data with "climate change science, and research into the health effects of tobacco".[200][201]

Freedom of Information requests[edit | edit source]

The PACE trial investigators have been asked for 160 pieces of separate information in 35 Freedom of Information requests since 2011.[175] They have dismissed at least three of these claims as "vexatious".[176][177][178][64][202]

A ruling by a UK government body, the Information Commissioner's Office (ICO), on 27 October 2015 ordered Queen Mary University of London (QMUL, the institutional base of the PACE trial's lead investigator Peter White) to release the trial data to a patient who had requested it, subject to appeal within 28 days.[203] Three Freedom of Information requests from 2012 and 2013 were included in the ICO's decision.[204][205][61] An appeal by QMUL was heard by the First-Tier Tribunal on 20-22 April 2016. QMUL responded to a freedom of information request confirming the cost of its legal fees for the tribunal totalled £245,745.27 (around USD350,000).[206][207][208] The First-Tier Tribunal judgement was published on August 16, 2016, roundly dismissing the appeal by QMUL, and deciding that the PACE trial data should be released.[209][210] The university has not yet stated whether it will appeal the judgement.[211]

The PACE patient consent form was released through a Freedom of Information request.[212]

Dr Richard Horton, editor of The Lancet, stated on April 18, 2011 in a national Australian radio interview: "The Freedom of Information requests and the legal fees that have been racked up over the years because of these vexatious claims has added another £750,000 of taxpayers’ money to the conduct of this study".[98]

Data requests from scientists[edit | edit source]

Professor James Coyne has publicly called for the trial data to be released. He has repeatedly criticized the PACE investigators for failing to abide by modern expectations concerning "open data".[213][214][215][216][217][218][219][220][221]

Professor Coyne's own request for the data was dismissed under the Freedom of Information Act by the study authors as "vexatious" and as having an "improper motive".[176]

Scientists Ronald Davis, David Tuller, Bruce Levin, and Vincent Racaniello requested the PACE trial data in December 2015.[222] Their request was rejected by the trial investigators.[223]. On International ME Awareness day in May 2016 in an interview with an advocate's article called PACE-Gate, Dr Racaniello stated "“I think they are going to ignore, obfuscate, and give their usual responses until we are all dead. I don’t have hope that the PACE authors, or Lancet, will respond in any meaningful way until there is more of an outcry.”[224]

ME Charities and others calls for data release[edit | edit source]

A number of patient charity groups and individuals have called for the release of the PACE data, including some outside the ME/CFS community who advocate "open data" in science. These calls include:

A total of 29 patient charity groups from 15 countries wrote in support of releasing the anonymized PACE trial data.[246][247]

A ME charity polled on the question "Should or should not the anonymised data from the PACE trial be released for independent analysis?" As at 17 March 2016, 1391 voters took part and 99% (1378 voters) voted for 'Should be released'. 0% (5 voters) voted for 'Should not be released'.[248]

Both cofounders of Retraction Watch, Ivan Oransky and Adam Marcus, added their weight behind patients in the refusal of the PACE trial investigators to release the anonymised data in article in STAT News feature 'The Watchdogs Keeping an eye on misconduct, fraud, and scientific integrity' To keep science honest, study data must be shared and concluded "when researchers refuse to share data, and how they came up with it, they lose the right to call what they do science".[125]

This battle was reported in the Wall Street Journal by Amy Dockser Marcus on 7 March 2016 as Patients, Scientists Fight Over Research-Data Access, which featured quotes from David Tuller, Tom Kindlon, Anna Sheridan Wood, James Coyne.[249][250] Professor Peter White responded to the article with a letter to the WSJ published 24th of March, 2016, claiming that "The main reason that my colleagues and I have been unable to release data to members of the public who ask for it is that we don’t have the consent of the trial participants to release their data in this way, and we are ethically bound to act in the best interest of our patients."[251]

Release of Data[edit | edit source]

Alem Matthees , an Australian ME sufferer, submitted a FOIA request to the PACE trial authors who were ordered to provide the requested data by the Information Commissioners Office. This decision was appealed by them to the Information Tribunal and was heard on April 20th 2016 at a three day hearing.

Information Tribunal

Mr Alem Matthees original Freedom of Information Act 2000 request to QMUL Selected data on PACE Trial participants was submitted on 24 March 2014. QMUL refused to release the requested data and Mathees complained to the Information Commissioners Office. The Information Commissioners decision was made on 27 October 2015 and concluded that QMUL should release the data.[252]

The PACE investigators appealed and the QMUL's Notice of Appeal was submitted on November 23, 2015.[253]

The Information Commissioners response to the Tribunal as First Respondent of January 12, 2016 and Mr Alem Mathees Main response to Tribunal as Second Respondent was also submitted to the Tribunal for the three day hearing on 20, 21 and April 22nd, 2016.

The Information Rights Tribunal Judgement was finally published on August 16, 2016. [210][254] The Tribunal upheld the original ICO decision and rejected the appeal by the PACE investigators and ordered QMUL to release the anonymised data to Mr Matthees.

The tribunal took evidence under the normal rules of court. The tribunal also concluded of the expert witness for the PACE authors that "It was clear that his assessment of activist behaviour was, in our view, grossly exaggerated and the only actual evidence was that an individual at a seminar had heckled Professor Chalder” and "clearly in our view had some self-interest, exaggerated his evidence and did not seem to us to be entirely impartial. What we got from him was a considerable amount of supposition and speculation, with no actual evidence to support his assertions or counter the respondents arguments." The tribunal panel noted that the Commissioner had referred to Professor Anderson’s “wild speculations” that “young men, borderline sociopathic or psychopathic” would attempt to identify trial participants from the anonymised data, and said that his views “do him no credit”. [255]

The decision noted in the evidence that "Contrast instead Professor Chalder when she accepts that unpleasant things have been said to and about PACE researchers only, but that no threats have been made either to researchers or participants. The highest she could put it was some participants stated that they had been made to feel "uncomfortable" as a result of their contact with and treatment from her, not because of their participation in the trial per se. There is no evidence either of a campaign to identify participants nor even of a risk of an 'insider threat'.”

Moreover, regarding the independent Cochrane review it was admitted in the tribunal that "Professor Chalder states that disclosure to the Cochrane review does not count as disclosure to independent scientists as all three of the PACE principal investigators sat on the review panel."

Additionally, a UK ME sufferer submitted a FOI request in June 2016 and established that the PACE trial investigator's university paid £245,745.27 for legal fees to defend their case in the tribunal against the original ICO decision. [256][257]

The lead PACE investigator's university issued a statement the same day stating "We are studying the decision carefully and considering our response".[258] An open letter in support of Alem Matthees was sent to the university and signed by Dr Ronald Davis, Dr Jonathan Edwards, Dr Rebecca Goldin, Dr Bruce Levin, Dr Zaher Nahle, Dr Vincent Racaniello, Dr Charles Shepherd and Dr John Swartzberg strongly urging them to not appeal further.

The ME community through MEAction posted a 'Plea for Decency to White, Chalder & Sharpe' with a plea to "pursue a complete retraction of their PACE trial paper from the Lancet and all associated subsequent papers from their relevant journals." and to "End this tragedy now."

QMUL did not appeal and released the data to Matthees.[259] It was uploaded online.[260][261][262]

Results of Reanalysis

Virology blog published the re-analysis on September 21, No 'Recovery' in PACE Trial, New Analysis Finds and concluded "The results should put to rest once and for all any question about whether the PACE trial’s enormous mid-trial changes in assessment methods allowed the investigators to report better results than they otherwise would have had. While the answer was obvious from Dr. Tuller’s reporting, the new analysis makes the argument incontrovertible."

The full re-analysis was published as 'A preliminary analysis of ‘recovery’ from chronic fatigue syndrome in the PACE trial using individual participant data' and was conducted by Alem Matthees, Tom Kindlon, Carly Maryhew, Philip Stark and Bruce Levin and stated "This re-analysis demonstrates that the previously reported recovery rates were inflated by an average of four-fold.".

On August 19, 2016 The Centre for Welfare Reform also published an update, to its earlier 64 page report from April 2016, called Major breakthrough on PACE trial[263].

'A critical commentary and preliminary re-analysis of the PACE trial' was published in December 2016 in the Journal of 'Fatigue: Biomedicine, Health & Behavior' by Dr Carolyn Wilshire, Tom Kindlon, Alem Matthees and Simon McGrath which found that "The claim that patients can recover as a result of CBT and GET is not justified by the data, and is highly misleading to clinicians and patients considering these treatments"[264] [265].

'A Rejoinder to Sharpe, Chalder, Johnson, Goldsmith and White' was published by Dr Carolyn Wilshire, Tom Kindlon and Simon McGrath in response to the PACE authors reply to their original publication [266]. Wilshire et al disproved again the PACE trials misleading claims as recovery was a strong claim and did not adhere to the core meaning of the word, no evidence that the original protocol specified definition was too stringent and absolute recovery rates from other studies were not legitimate source of support for the recovery definition used. It reinforced the original conclusion that "The PACE trial provides no evidence that CBT and GET can lead to recovery from CFS. The recovery claims made in the PACE trial are therefore misleading for patients and clinicians".

Instead of engaging with critics by releasing other additional requests for data, the PACE trial authors updated their guidelines in January 2017 for those requesting access to the PACE trial data which further restricted access by requiring "formal agreement" with "precise analytic plans, and plans for outputs" [267]. Prof James Coyne commented that it is "a ruse to trap the unwary in endless haggling and appeal, while protecting the PACE investigators from the independent reanalysis of the claims, which they have already declared poses a reputational risk to them".[268]

Scientific and Media response[edit | edit source]

Despite patients and critics not having access to the Science Media Centre the media coverage especially outside the UK was extensive. For a full list of the scientific and media response to the PACE trial data release and reanalysis, see the article:

Journal of Health Psychology 'Special Issue on the PACE Trial'

A special edition of the Journal of Health Psychology was published in 31 July by the editor, Dr David Marks with an editorial - 'Special Issue on the PACE Trial' and accompanying all 20 Editorials & Commentaries. [269]

A press release was put out for 31 July called 'The PACE Trial: The Making of a Medical Scandal' [270] [271][272][273].

Prof Coyne explained in his blog of the 'Last ditch attempt to block publication of special issue of Journal of Health Psychology foiled' and that anonymous and powerful PACE proponents made threats to the publisher of JHP, SAGE Publications, that made them reluctant to publish the special edition. He explained in his blog "Some threats were made to Sage Publications, the publisher of Journal of Health Psychology, which expressed a reluctance to go forward as planned. As often happens with these kind of pressures, we weren’t told the identity of the complainant. It was clear that whoever s/he was, this person was powerful in being able to grind to a halt of making the special issue available, complete with the introductory editorial that was not previously available.'"

It transpired that "When the effort to block publication of the special issue failed, the PACE investigators got criticism posted at Science Media Centre." [274]

The Science Media Centre put out its own "expert reaction" press release to UK journalists minutes before the special edition was available to spin the story about the PACE scandal and distract and refocus away from the central problems with the scandal.[275] The Science Media Centre ignored the glaring problems and instead made personal attacks agains the authors.

Dr David Tuller deconstructed "these rather pathetic efforts at defending the indefensible" from the Medical Research Council (MRC), an unnamed University of Oxford spokesperson, and Malcolm Macleod in 'The Science Media Centre’s Desperate Efforts to Defend PACE'. It was stated by a whistleblower that Michael Sharpe was the person who complained to the Journal to block publication.[276] This was published on social media by a ME advocate and although unverified, due to its importance as it was the principal author of PACE trial, it is being documented and referenced here.

The Times (UK) published two articles 'Scientists trade insults over myalgic encephalomyelitis (ME) study' and 'A battle of prescriptions' covered the issue but with a spin and focus on emails and resignations rather than the central issues in the Special Issue on the PACE trial scandal [277][278]. The impact of the decades long denial by the PACE authors of the disability could be seen in the Express article 'Is chronic fatigue syndrome real? Life-threatening condition can leave sufferers bed bound'. The Daily Mail reported on it with 'Angry scientists throw insults at each other over the results of a £5 million taxpayer-funded study into chronic fatigue syndrome'

US local media reported on it as 'Chronic fatigue syndrome reality conflicts with medical study'. Other international media reporting it including the Metro Netherlands 'Wetenschappers vallen door de mand'. Forskning (Research) of Norway reported it as 'Hard kritikk av stor ME-studie'/'Hard criticism of major ME study' . Seeker published on both the PACE trial scandal and the 2017 Stanford Cytokine study and concluded "The fact that this new study and the journal issue came out at virtually the same time is significant. The study and the journal “reinforce each other,” Tuller said." [279].

Journalist Jerome Burns in the Daily Mail wrote the article 'Why are doctors and patients still at war over M.E.? How the best treatment for the debilitating condition is one of the most bitterly contested areas in medicine' . David Tuller commented on social media "Amazing to see a fair story on ME like this in the UK press. Seems like the PACE story has broken through" as it was a breakthrough in the UK media because of the influence of the PACE authors and the Science Media Centre [280].

The iNews reported it as 'You’re a disgusting old fart neoliberal hypocrite’ – scientists in furious row over ME study' with a prominent and groundbreaking comment from Dr David Marks in the national UK media "The many wrongs committed by psychiatry and medicine to the ME/CFS community can only be righted when the Pace trial is ultimately seen for what it is: a disgraceful confidence trick to reduce patient compensation payments and benefits.”.

The Medical Independent in Ireland published an article referencing Dr Keith Geraghty and Nasim Marie Jafry's work with a literary take on the changing narrative of ME from neurological to biopsychosocial and culminating in the PACE trial and a whole special issue dedicated to the scandal [281].

The President of the IACFS/ME Prof Fred Friedberg stated of the Special Edition "the most misleading and damaging aspect of the PACE trial was contained in the subsequent reporting of “recovery”" and "This can have the effect of delegitimizing the illness even more and may discourage biomedical research on ME/CFS". He continued "misleading reports that inflated the benefits of the PACE trial, which were widely cited in the mass media at the time, may have further undermined illness credibility with the research community" as far as the United States [282]. In contrast a separate investigation into research funding it was established Peter White as receiving the most research funding and a near monopoly from the UK government and taxpayers out of all researchers despite protests from patients [283] .

The Journal of Health Psychology August Special Edition with all articles is also available on PubMed.

Learn more

Reaction by Scientific, Medical and ME Communities[edit | edit source]

The PACE trial was scientifically discredited but the impact of it on the medical community has continued especially in the UK.

Agency for Healthcare Research and Quality (AHRQ) amendment, US The US government agency called the Agency for Healthcare Research and Quality (AHRQ) revised its earlier recommendations about found that when studies of CBT and GET, including PACE, that used the Oxford Criteria were excluded, there was no evidence for graded exercise and only weak evidence for CBT.[285] Mary Dimmock led the way on this issue with AHRQ and co-authored with Jennie Spotila AHRQ Evidence Review Changes Its Conclusions.

PLOS Expression of Concern

Prof James Coyne had requested anonymised data in 2015 from the PACE trial authors from the Cost Effectiveness paper. He pursued this request throughout 2015 and 2016 but was also refused as "vexatious". After 18 months, PLOS issued an Expression of Concern on May 2nd 2017. It stated "We conclude that the lack of resolution towards release of the dataset is not in line with the journal’s editorial policy and we are thus issuing this Expression of Concern to alert readers about the concerns raised about this article.[286] The editors of PLOS One, Iratxe Puebla and Joerg Heber, wrote in PLOS One Blog "Since we feel we have exhausted the options to make the data available responsibly, and considering the questions that were raised about the validity of the article’s conclusions, we have decided to post an Expression of Concern to alert readers that the data are not available in line with the journal’s editorial policy".[287] Retraction Watch reported on the development [288]

Centers for Disease Control & Prevention (CDC), US

David Tuller reported in July 2017 Trial By Error: The CDC Drops CBT/GET the CDC updated their treatment recommendations and "the agency has “disappeared” all mention of CBT and GET as treatment or management strategies." It was reported by Tuller that the key members of the PACE trial had a long history with the CDC and "For advocates, the CDC’s removal of the CBT/GET recommendations represents a major victory. “I think it’s huge,” said Mary Dimmock, an advocate who has long pressured the CDC to revise its website." The removal of CBT and GET has been "heralded as an important" by patient charities [289]. David Tuller in Undark reported on this development as CDC Removes Reference to Disputed ME/CFS Therapies From Website. [290].

In September, David Tuller and Julie Rehmeyer wrote an article in STAT exploring 'Why did it take the CDC so long to reverse course on debunked treatments for chronic fatigue syndrome?'. NPR reported on the change in the CDC recommendations and that exercise can make the disease worse and criticised the seminal paper Sir Simon Wessely from 1989 that led to exercise as a treatment and the PACE trial. [291]. The New York Times published an article 'New Recognition for Chronic Fatigue Syndrome'] that longstanding advice to exercise was now recognised as not only ineffective but counterproductive and referred to the CDC and NICE decision to review the recommendations [292].

UK reaction from the Journals - Lancet, Psychological Medicine and Guideline Provider - NICE

The UK medical and scientific establishment have been obstinate in changing their position to reflect the flaws of the PACE trial as the PACE trial investigators are highly influential and senior members of the UK establishment. The Lancet have refused to retract the study as yet. Psychological Medicine have also refused to retract the study as well.

The controversial NICE guidelines were challenged by patient groups after the PACE trial was discredited by way of petitions and challenges by ME patient groups in 2017. ME sufferers have taken other actions due to the UK medical establishment intransigence of acknowledging the issues. The Medical Research Council (MRC) and its Chief Executive continued to defend the trial and in a statement dated 28 August 2018 said that  as funders of the PACE trial we reject the view that the scientific evidence provided by the trial was unsound [293].

Jerome Burns in Health Insights UK published a follow up article to his 2016 articles on the PACE trial in the article headlined ‘The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out…’ The journalist stated he thought it would be big story in 2016 with lots of repercussions but the UK press largely ignored it and he revisited the story in 2019 due to professional opinions changing against CBT/GET, with the recent House of Commons debates and the impending revision of the NICE guidelines.[294]

Continued campaigning

Mary Dimmock wrote a comprehensive report 'Clinical Guidance for ME: “Evidence-Based” Guidance Gone Awry' in January 2018 that details how the PACE trial and similar studies based on flawed science led to evidence-based reviews and clinical guidance recommending harmful treatments for ME patients [295].

ME sufferers have continued to campaign against the PACE trial including in Millions Missing protests around the world in 2018 over the PACE trial and the adverse effects on biomedical research. As part of this a 'Song for ME: Blowin in the Wind' (available on YouTube) was recorded by ME patients from 7 countries around the world which included the lyrics "How many times must an idea fail...Before it is seen to be flawed?...And how many flaws can a trial embrace...Before it is seen as a fraud?...Yes and how many wounds must its victims expose... Before they’re no longer ignored?" [296]

Dr Racaniello sent another open letter with nearly 100 signatories including scientists, clinicians, academics, lawyers and other experts to the editor Richard Horton at the Lancet due to receiving no response two years later to the original letter from February 2016,. The letter again asked for an independent re-analysis from independent reviewers outside UK psychiatry who have no conflicts of interests involving the PACE investigators and the funders of the trial [297]. Another letter of appeal was sent with signatories including 65 ME patient organisation / charities and also this time with 10 Members of Parliament signing the open letter to Richard Horton and the Lancet [298]. The Times (UK) reported on the third letter in its article 'Call for review of ‘flawed’ ME research in Lancet letter' and stated at the end, "The Lancet declined to comment" [299]. The BMJ who were supportive of the PACE trial previously reported it as 'Pressure grows on Lancet to review “flawed” PACE trial' and also approached the Lancet for comment [300]. In a letter to the editor of The Times, the Chief Executive of the MRC, Fiona Watt continued to defend the PACE trial[301][302].

Additional Scientific Publications[edit | edit source]

BMC Psychology - Re-analysis by Wilshire et al

BMC Psychology published on 22 March 2018 'Rethinking the treatment of chronic fatigue syndrome—A reanalysis and evaluation of findings from a recent major trial of graded exercise and CBT' by Drs Carolyn Wilshire, David Tuller, Tom Kindlon, Alem Matthees, Keith Geraghty, Robert Courtney and Bruce Levin [303] . It concluded these findings raise serious concerns about not only the PACE trial but the robustness of the claims made about the efficacy of CBT and GET as a whole. One of the early critics and author, Robert Courtney, died shortly before the paper was published. The reanalysis is published on PubMed. [304]

Once again the Science Media Centre on the eve of the publication organised media briefings for journalists and news organisations. The Science Media Centre produced on this occasion three separate briefings in an attempt to reduce the impact of the publication and spin the story. It produced a 'Factsheet: CFS/ME – The illness and the controversy', 'Before the headlines analysis – Reanalysis of the PACE trial' , and an 'expert reaction to reanalysis of the PACE trial for chronic fatigue syndrome (CFS) treatments'.[305][306][307]

One of the patient authors asked other patients to contact journalists to ensure they cover the publication and to ensure they have the full facts [308]. Despite the pressure and Science Media Centre briefings to undermine the publication the media did report on it. The Times reported it as 'Findings of £5m ME chronic fatigue study ‘worthless’. Even the government news organisation, the BBC, reported on it with 'Chronic fatigue trial results 'not robust', new study says'. The Daily Mail and Huffington Post and other UK national and local media reported on the story [309][310][311][312]. The news was reported in Europe by Health Europa [313]. The Canary did in-depth coverage of the reanalysis paper [314]. The NEJM JWatch publicised this to physicians [315]. The European Health Journal also republished the paper [316].

In their correspondence to BMC Psychology submitted on 31 July 2018 and published on 12 March 2019 2019, PACE trial authors Michael Sharpe, Kimberley Goldsmith and Trudie Chalder responded to the re-analysis by Wilshire et al, with ’The PACE trial of treatments for chronic fatigue syndrome: a response to Wilshire et al’.  They restated that "both CBT and GET, when given appropriately as supplements to specialist medical care, are more effective at improving both fatigue and physical functioning in people with CFS, than are APT or SMC alone." and that they found "no good reason" to change the conclusions of the PACE trial.[317]

Wilshire and Kindlon also responded in BMC Psychology on 26 March 2019 with  ‘Response: Sharpe, Goldsmith and Chalder fail to restore confidence in the PACE trial findings’.[318] In the rejoinder Wilshire and Kindlon clarify the misconception in the PACE trial author’s commentary, and address the seven additional arguments they raise in defence of their conclusion. They concluded  “New arguments presented by Sharpe et al. inspire some interesting reflections on the scientific process, but they fail to restore confidence in the PACE trial’s original conclusions.” It was also stated that unjustified optimism of CBT/GET fuelled by the PACE trial has caused many consequences including hindering the search for effective treatments and that the debate around the PACE trial will have implications reaching far and beyond.

Other journals

Also in March, the British Journal of Healthcare Management (a peer reviewed journal for management in the healthcare sector) published by George Winters, 'Chronic fatigue syndrome: the ongoing medical debate' which was a summary of the controversy over the decades and the scandal over the last two years [319].

In July 2018 Scientists from Workwell Foundation, University of the Pacific, California published an editorial in the British Journal of Sports Medicine 'Checking our blind spots: current status of research evidence summaries in ME/CFS' and concluded "the UK PACE Trial has exposed some of the most important public health-related ethical and legal challenges of our time, which, as yet, remain largely under-reported and unknown to many clinicians." It also supported citizen scientists in its conclusion "We should follow the example of engaged patient advocates and citizen scientists in ME/CFS by involving patients as advisory board members on trials and as reviewers on published evidence summaries....By including evidence from patients in clinical decisions and research, we can begin to address the important blind spots in how we think about and implement EBP."[320]

Textbooks

After years of trying to gain traction in scientific journals, shortly after the scandal being exposed in the journals and media, academic textbooks in psychology also began documenting the flaws of the PACE trial.

In March 2018 'Health Psychology: Theory, Research and Practice' by Dr David Marks et al documented the numerous flaws in the PACE trial in a section called 'The PACE trial: A Catalogue of Errors' (pages 603-605) [321].

In August 2018 a book called 'Psychology in Crisis' by Prof Brian Michael Hughes also documented and summarised the failures of the PACE trial [322].

Complaint to medical regulator (GMC)

Dr Sarah Myhill has complained to the UK's medical regulator, the General Medical Council, over the conduct of the PACE trial authors [323]. Over 200 letters of complaints by ME patients were also sent to the General Medical Council. A petition gathered over 8900 signatories supporting Dr Myhill's complaint to the GMC about the PACE trial authors [324].

Further FOIA requests

Further Freedom of Information Act 2000 requests have been made to the PACE trial team at Queen Mary University of London (QMUL). The PACE authors have continued to refuse using various reasons including refusing an internal review and these decisions have been appealed again to the Information Commissioner's Office. On 20 February 2018 the Information Commissioner's Office ruled that the the university should release the PACE Trial Steering Committee minutes and the Trial Management Group minutes. The PACE team and the university surprisingly repeated its earlier arguments to the ICO that the criticism is unwarranted and the trial is not controversial among the majority of scientists in the field and that there is a history of the researchers being personal abused, their integrity being questioned and even as far as saying they may risk threats of physical violence. The Information Tribunal in August 2016 in its court decision rejected these serious but unfounded assertions. The complainant, an ME sufferer, argued that this data should be released given the previous submissions by the PACE authors were unreliable and in the intervening period the scientific community in addition to patients had cast further concerns about the trial. The Commissioner found that the public interest favors publishing the anonymized information and ruled that the university should release the data and has 35 days to do so. [325]. [326].

Second Parliamentary debate on PACE Trial[edit | edit source]

It was announced on 6 February 2018 by Carol Monaghan MP that a Westminster Hall debate would be held on the PACE trial called 'PACE trial and its effect on people with ME' [327]. This was exactly five years to the date of the last PACE trial debate in 2013. Scottish media reported on it and The Herald published 'Glasgow MP Carol Monaghan secures parliamentary examination of controversial ME trial' . On the day of the debate The National reported it as 'SNP's Carol Monaghan to lead debate on treatment for ME patients'.

The 'PACE Trial and its effect on people with ME' debate took place on 20 February 2018 at Westminster Hall. The debate is available on UK Parliament TV and is available on Hansard.[328][329] The debate is also available on YouTube.[330][331][332]

It was concluded by Carol Monaghan MP "I think that when the full details of the trial become known, it will be considered one of the biggest medical scandals of the 21st century."

ME charities Invest in ME, ME Association and others commented on the debate.[333][334][335]

ME advocates have produced an analysis of Caroline Dinenage MP (Department of Health and Social Care) who responded on behalf of the government with mixed and inconsistent responses but continued support for the PACE trial.[336].

An Early Day Motion (EDM) 1247 was launched by Carol Monaghan MP in May for ME Awareness week which stated amongst other points "That this House recognises Myalgic Encephalomyelitis (ME) Awareness Week from 6 to 12 May 2018....acknowledges the detrimental effect of the PACE trial and its results, and the work which is being done to reverse this;" [337]. It was supported by 136 MPs and was in the top 1% (No 7/1503 as at July 2018) of all EDM's in the parliamentary session.

A further debate on 'M.E. Treatment and Research' was led by Carol Monaghan MP on 21 June 2018 and the PACE trial was again criticised by many MPs.

Quotes from PACE trial critics[edit | edit source]

Professor Vincent Racaniello

Vincent Racaniello is a virologist at Columbia University in New York in the United States.

"This is a flawed study, it has to be fixed and people are being harmed by it."[338]

"... multiple flaws that are inexcusable."[338]

"In short, the PACE study is a sham, with meaningless results. In this case, the emperor truly has no clothes. Dr. Horton and his editorial team at The Lancet are stark naked."[339]

"I think they are going to ignore, obfuscate, and give their usual responses until we are all dead. I don’t have hope that the PACE authors, or Lancet, will respond in any meaningful way until there is more of an outcry." [340]

Trevor Butterworth

Trevor Butterworth is the Editor of 'Sense About Statistics,' an online collaboration between the American Statistical Association and Sense About Science USA.[148]

"...the way PACE was designed and redesigned means it cannot provide reliable answers to the questions it asked. There is really not a lot that can be said to mitigate that; it’s a terminal prognosis."

Professor James Coyne

Professor Coyne is Professor of Health Psychology, University Medical Center, Groningen and University of the Netherlands; Distinguished Visiting Professor at the Institute for Health Policy, Rutgers, the State University of New Jersey; and Professor Emeritus of Psychology in the Department of Psychiatry, University of Pennsylvania. He is one of the most cited psychologists in the academic literature.

"The data presented are uninterpretable. We can temporarily suspend critical thinking and some basic rules for conducting randomized trials (RCTs), follow-up studies, and analyzing the subsequent data. Even if we do, we should reject some of the interpretations offered by the PACE investigators as unfairly spun to fit what [is] already a distorted positive interpretation of the results."[71]

"The self-report measures do not necessarily capture subjective experience, only forced choice responses to a limited set of statements."[71]

"One of the two outcome measures, the physical health scale of the SF-36 requires forced choice responses to a limited set of statements selected for general utility across all mental and physical conditions."[71]

"The validity [of the] other primary outcome measure, the Chalder Fatigue Scale depends heavily on research conducted by this investigator group and has inadequate validation of its sensitivity to change in objective measures of functioning."[71]

Professor Coyne gave a public talk criticising the PACE trial in Edinburgh in November 2015. Video footage is available[104][105][106], as are a slide show[107], a full[341] and an edited transcript[342][343] and an audio recording.[344]

He spoke again about the PACE study in Belfast in February 2016 where he described it as "a wasteful trainwreck of a study".[108][109]

Professor Coyne has questioned whether the PACE trial paper could ever have been properly peer-reviewed, given the large number of study authors and the small world of British science.[110]


Professors James Coyne and Keith Laws

Professor Coyne and Professor Laws of the University of Hertfordshire have criticised, in a joint letter to Lancet Psychiatry, the long-term follow-up analysis of the PACE trial that was published in 2015.[114] Referring to the results of the study as a whole, they said:

"There are no group differences, and the overall mean short-form 36 (SF-63) physical functioning score is less than 60. It is useful to put this number in context. 77% of the PACE trial participants were women, and the mean age of the trial population was 38 years, with no other disabling medical conditions. Patients with lupus have a mean physical functioning score of 63, patients with class II congestive heart failure have a mean score lower than 60, and normal controls with no long-term health problems have a mean score of 93."

Professor Ronald Davis

Professor Ronald Davis is a world-famous geneticist at Stanford University, known for work that enabled the Human Genome Project.

“I’m shocked that the Lancet published it... The PACE study has so many flaws and there are so many questions you’d want to ask about it that I don’t understand how it got through any kind of peer review.”[26]

Emeritus Professor Jonathan Edwards

Professor Edwards, of University College London, is internationally known for his pioneering work in establishing B-cell depletion therapy as an effective treatment for rheumatoid arthritis.

“It’s a mass of un-interpretability to me…All the issues with the trial are extremely worrying, making interpretation of the clinical significance of the findings more or less impossible....Within the circle who are involved in this field, it seems there were a group who were prepared to all sing by the hymn sheet and agree that PACE was wonderful. But all the issues with the trial are extremely worrying, making interpretation of the clinical significance of the findings more or less impossible.”[26]

Professor Rebecca Goldin

Professor Goldin is Professor of Mathematical Sciences at George Mason University and Director of STATS.org (US).[58]

"The PACE design changed so significantly as to leave many wondering whether there is value in the study itself."

"It seems that the best we can glean from PACE is that study design is essential to good science, and the flaws in this design were enough to doom its results from the start."

Dr Ellen Goudsmit

Dr Goudsmit is a retired health psychologist who has published a number of criticisms of the PACE trial.

"The PACE trial was scientifically extremely poor"[345]

"A treatment like GET is simply not appropriate for a disease like ME which is linked to infection and metabolic abnormalities. Given the close relationship between exertion and symptoms, it follows that asking a patient to increase their activity levels is as logical as advising smokers with lung cancer to gradually increase the number of cigarettes they smoke"[346]

Professor Leonard Jason

Leonard Jason is a professor of psychology at DePaul University in Chicago, Illinois, and director of its Center for Community Research.

“The PACE authors should have reduced the kind of blatant methodological lapses that can impugn the credibility of the research, such as having overlapping recovery and entry/disability criteria.”[26]

"My key points are that the PACE trial investigators were not successful in designing and implementing a valid pacing intervention and patient selection ambiguity further compromised the study’s outcomes."[134]

<Professor Bruce Levin

Professor Levin is a professor of biostatistics at Columbia University and an expert in clinical trial design.

“To let participants know that interventions have been selected by a government committee ‘based on the best available evidence’ strikes me as the height of clinical trial amateurism.”[26]

Professor Arthur Reingold

Professor Reingold is Head of Epidemiology at the University of California, Berkeley.

“Under the circumstances, an independent review of the trial conducted by experts not involved in the design or conduct of the study would seem to be very much in order.”[26]

Dr. Charles Shepherd

Dr Shepherd, medical advisor to the ME Association, has criticised the trial's long-term follow-up analyses:

"Without robust objective evidence relating to improvement and recovery, the ME patient community will continue to regard the PACE trial as a tremendous waste of research funding money".[347]

Dr David Tuller

Dr Tuller is is academic coordinator of the University of California, Berkeley's joint masters program in public health and journalism. He was a reporter and editor for 10 years at the San Francisco Chronicle, served as health editor at Salon.com and frequently writes about health for The New York Times. He has written extensively about the PACE trial.[103]

"The study included a bizarre paradox: participants’ baseline scores for the two primary outcomes of physical function and fatigue could qualify them simultaneously as disabled enough to get into the trial but already 'recovered' on those indicators–even before any treatment. In fact, 13 percent of the study sample was already 'recovered' on one of these two measures at the start of the study."[26]

"In the middle of the study, the PACE team published a newsletter for participants that included glowing testimonials from earlier trial subjects about how much the 'therapy' and 'treatment' helped them. The newsletter also included an article informing participants that the two interventions pioneered by the investigators and being tested for efficacy in the trial, graded exercise therapy and cognitive behavior therapy, had been recommended as treatments by a U.K. government committee 'based on the best available evidence.' The newsletter article did not mention that a key PACE investigator was also serving on the U.K. government committee that endorsed the PACE therapies."[26]

"The PACE team changed all the methods outlined in its protocol for assessing the primary outcomes of physical function and fatigue, but did not take necessary steps to demonstrate that the revised methods and findings were robust, such as including sensitivity analyses. The researchers also relaxed all four of the criteria outlined in the protocol for defining 'recovery.' They have rejected requests from patients for the findings as originally promised in the protocol as 'vexatious.'"[26]

"The PACE claims of successful treatment and 'recovery' were based solely on subjective outcomes. All the objective measures from the trial—a walking test, a step test, and data on employment and the receipt of financial information—failed to provide any evidence to support such claims. Afterwards, the PACE authors dismissed their own main objective measures as non-objective, irrelevant, or unreliable."[26]

"In seeking informed consent, the PACE authors violated their own protocol, which included an explicit commitment to tell prospective participants about any possible conflicts of interest. The main investigators have had longstanding financial and consulting ties with disability insurance companies, having advised them for years that cognitive behavior therapy and graded exercise therapy could get claimants off benefits and back to work. Yet prospective participants were not told about any insurance industry links and the information was not included on consent forms. The authors did include the information in the 'conflicts of interest' sections of the published papers."[26]

"The Lancet Psychiatry follow-up had null findings: Two years or more after randomization, there were no differences in reported levels of fatigue and physical function between those assigned to any of the groups... Yet the authors, once again, attempted to spin this mess as a success."[348]

"This study is a piece of crap."[338]

Dr David Tuller and Julie Rehmeyer

Public health expert Dr Tuller and ME/CFS patient Julie Rehmeyer are both journalists who have written critically about the PACE authors' claims regarding the safety of Graded exercise therapy:[75]

"The study’s primary case definition for identifying participants, called the Oxford criteria, was extremely broad; it required only six months of medically unexplained fatigue, with no other symptoms necessary. Indeed, 16% of the participants didn’t even have exercise intolerance—now recognized as the primary symptom of ME/CFS".

"After the trial began, the researchers tightened their definition of harms, just as they had relaxed their methods of assessing improvement."

"[T]he study was unblinded, so both participants and therapists knew the treatment being administered. Many participants were probably aware that the researchers themselves favored graded exercise therapy and another treatment, cognitive behavior therapy, which also involved increasing activity levels. Such information has been shown in other studies to lead to efforts to cooperate, which in this case could lead to lowered reporting of harms."

Julie Rehmeyer

"... one of the most damaging cases of bad statistical practice that I have personally encountered in my years as a journalist"[149]

"... an object lesson in how our systems can break down. In this case there were serious breakdowns statistically, scientifically, journalistically and in public health."[149]


Dr Michael VanElzakker

"Subjective measures of sick people before & after they are repeatedly told 'You're not sick' is a social psych study, not a clinical trial."[349]

"In 5 years, the UK medical establishment's obdurateness on ME/CFS and PACE will be taught in medical schools as a cautionary tale."[349]

"The PACE trial is a classic case of bad science - researchers are determined to support their theory, even if the data do not."[349]

Dr David Marks

Editor of the Journal of Health Psychology

"The many wrongs committed by psychiatry and medicine to the ME/CFS community can only be righted when the PACE trial is ultimately seen for what it is: a disgraceful confidence trick to reduce patient compensation payments and benefits.” [350]

"Gaslighting has been applied to the entire ME/CFS community by misapplication and misuse of the Biopsychosocial Model".[351]

Principal investigators and researchers[edit | edit source]

The principal investigators on the PACE trial are Professors Peter D. White, Trudie Chalder and Michael Sharpe. Additional authors on the 2011 Lancet paper of the PACE Trial Management Group are Kimberley Goldsmith, Anthony L. Johnson, Laura Potts, Rebecca Walwyn, Julia DeCesare, Hannah L. Baber, Mary Burgess, Lucy V. Clark, Diane L. Cox, Jessica Bavinton, Brian Angus, Gabrielle Murphy, Maurice Murphy, Hazel O'Dowd, David Wilks, and Paul McCrone.

The PACE Trial Steering Committee members included Mansel Aylward.

List of PACE trial publications[edit | edit source]

2003: Trial Registry. BioMed Central. ISRCTN54285094

There is a currently published trial register[352] and there is a version of the register that is no longer available on the web but has been archived.[353] Both versions contain slightly different details. The archived version contains the details of the trial's pre-specified endpoint analyses.

2006: Final protocol version 5.0

This full version of the study protocol, which includes trial materials such as questionnaires and consent forms, was never officially published.[354]

2007: PACE trial protocol

BMC Neurology published the trial's planned methodology, including its planned analyses.[13]

2011: Main trial outcomes

The trial's main outcomes, and some selected secondary outcomes, were reported in The Lancet.[2] Forty-four letters were submitted in a response that the journal's editor described as "swift and damning".[179]

The Science Media Centre organised a press briefing and Expert Opinion on ME/CFS Study, on 17 Feb 2011.[355]

The UK and international media heavily publicised this paper after the PACE authors press conference and in conjunction with the Science Media Centre in February 2011. [25]
[29][30][31][32] [356] [357] [358] [359] [360] [361] [362] [363] [364] [365] [366] [367] [368] [369] [370] [371] [372] [373] [374] [375] [376] [377] [378]

2012: Cost-effectiveness of CBT and GET

This paper was published in the PLoS One journal and concluded that cognitive behavioral therapy and graded exercise therapy had the best probability of being the most cost-effective treatments.[20] The UK media publicised the results from this paper [379][380][381][382][383]. Controversy has broken out over the failure of the study authors to provide the underlying data to Professor James Coyne under PLoS One's data-sharing policy.[197] Journalist David Tuller has criticized the study's assumptions and conclusions.[384]

2013: "Recovery" rates

This paper appeared in Psychological Medicine.[3] The Science Media Centre issued an "expert opinion" about the study.[385]

ME/CFS patient Graham McPhee and others created a video animation - How's that recovery? - explaining problems with the new analyses that had replaced those specified in the study protocol. Sam Carter applied the new fatigue and physical function recovery criteria to the data from the FINE trial and found that doing so increased the number of "recovered" patients six-fold, compared to the original criteria.[386]

Patient-advocate Peter Kemp also criticized the study, stating that the authors had "twisted the SF-36 Physical Function subscale to suit their needs."[387]

Patients created a tongue-in-cheek song video to satirically criticize the recovery paper results.[388]

2013: Statistical analysis plan

Trials Journal published the detailed plan for PACE's data analysis.[389]

2014: Adverse effects

The Journal of Psychosomatic Research published the results on safety and adverse effects.[73]

2015: Secondary mediation analysis

The Lancet Psychiatry published this paper. [21] The UK and international media publicised the results from this paper. [40][41][390] [391] [392] [393] [42] [394] [395] [396] [397] [398] [399]

The paper has been criticised by Byron Hyde.[400]

PACE long-term follow-up

2015: Long-term follow-up

Long-term follow-up results were published in The Lancet Psychiatry in October 2015.[4]

The paper states that at least two years after patients were randomised, "there were no significant differences" in outcomes between the treatment groups. This indicated that APT, CBT and GET added nothing to specialist medical care (SMC), which all groups received. However, the study authors interpreted the results as favouring CBT and GET.

The Science Media Centre published "expert reaction" to the paper.[401] The UK media then publicised the results. [36][37][38][39][42][44] [402][403] [404] [405] [406]

Professors James Coyne and Keith Laws criticised the results as "uninterpretable" and consisting of "null findings."[72] The ME Association also criticized the follow-up study.[407]

2015: Longitudinal mediation analysis

This short paper published in Trials Journal concluded: "Approximately half of the effect of each of CBT and GET [...] on physical function was mediated through reducing avoidance of fearful situations".[408]

Other publications[edit | edit source]

Talks and interviews[edit | edit source]

See also[edit | edit source]

Learn more[edit | edit source]

References[edit | edit source]

  1. 1.0 1.1 White, Peter D.; Sharpe, Michael C.; Chalder, Trudie; DeCesare, Julia C.; Walwyn, Rebecca; PACE trial group (March 8, 2007). "Protocol for the PACE trial: a randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise, as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy". BMC neurology. 7: 6. doi:10.1186/1471-2377-7-6. ISSN 1471-2377. PMC 2147058. PMID 17397525.
  2. 2.00 2.01 2.02 2.03 2.04 2.05 2.06 2.07 2.08 2.09 2.10 White, PD; Goldsmith, KA; Johnson, AL; Potts, L; Walwyn, R; DeCesare, JC; Baber, HL; Burgess, M; Clark, LV; Cox, DL; Bavinton, J; Angus, BJ; Murphy, G; Murphy, M; O'Dowd, H; Wilks, D; McCrone, P; Chalder, T; Sharpe, M; The PACE Trial Management Group (March 5, 2011), "Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial", The Lancet, 377 (9768): 823–836, doi:10.1016/S0140-6736(11)60096-2, PMID 21334061
  3. 3.0 3.1 3.2 White, PD; Goldsmith, K; Johnson, AL; Chalder, T; Sharpe, M; PACE Trial Management Group (October 2013), "Recovery from chronic fatigue syndrome after treatments given in the PACE trial", Psychol Med, 43 (10): 2227-2235, doi:10.1017/S0033291713000020, PMID 3776285
  4. 4.0 4.1 4.2 4.3 4.4 Sharpe, M; Goldsmith, KA; Johnson, AL; Chalder, T; Walker, J; White, PD (October 27, 2015), "Rehabilitative treatments for chronic fatigue syndrome: long-term follow-up from the PACE trial", The Lancet Psychiatry, 2: 1067-74, doi:10.1016/S2215-0366(15)00317-X, PMID 26521770, There was little evidence of differences in outcomes between the randomised treatment groups at long-term follow-up.
  5. 5.0 5.1 #MEAction (October 2015), "Petition: Misleading Claims Should Be Retracted", #MEAction, archived from the original on March 19, 2019
  6. 6.0 6.1 ME Association (May 29, 2015), Our CBT, GET and Pacing Report calls for major changes to therapies offered for ME/CFS
  7. 7.0 7.1 7.2 7.3 Davis, Ronald W; Edwards, Jonathan C W; Jason, Leonard A; Levin, Bruce; Racaniello, Vincent R; Reingold, Arthur L (November 13, 2015), "An open letter to Dr Richard Horton and The Lancet", Virology Blog
  8. iNews UK; Paul Gallagher (August 19, 2016), Chronic Fatigue Syndrome: tribunal orders data from controversial trial to be released
  9. 9.0 9.1 9.2 9.3 NICE guidelines (UK) (August 2007), NICE guidelines (CG53) - Chronic fatigue syndrome / myalgic encephalomyelitis (or encephalopathy): diagnosis and management
  10. 10.0 10.1 White, Peter D (2011), "Managing claims for chronic fatigue the active way", Swiss Re (insurance) (image), archived from the original on July 25, 2013
  11. 11.0 11.1 White, Peter D (2011), "Managing claims for chronic fatigue the active way", Swiss Re (insurance) (webpage), archived from the original on August 24, 2013
  12. University of Edinburgh (2008), RA5a: Research environment and esteem
  13. 13.0 13.1 13.2 White, PD; Sharpe, MC; Chalder, T; DeCesare, JC; Walwyn, R; The PACE trial group (March 8, 2007), "Protocol for the PACE Trial: A randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy", BMC Neurology, doi:10.1186/1471-2377-7-6, PMID 17397525
  14. 14.0 14.1 14.2 Wessely, Simon (November 4, 2015), "The PACE Trial for chronic fatigue syndrome: choppy seas but a prosperous voyage", National Elf Service
  15. PACE Trial Management Group (December 2, 2004), PACE - Manual for Doctors - Standardised Specialist Medical Care (SSMC) (PDF)
  16. 16.0 16.1 PACE Trial Management Group (November 2004), PACE - Manual for Participants - Adaptive Pacing Therapy (APT) for CFS/ME (PDF)
  17. 17.0 17.1 PACE Trial Management Group (November 2004), PACE - Manual for Participants - Cognitive Behaviour Therapy for CFS/ME (PDF)
  18. 18.0 18.1 PACE Trial Management Group (November 2004), PACE - Manual for Participants - Graded Exercise Therapy for CFS/ME (PDF)
  19. "PACE Trial". Queen Mary University Of London. Retrieved July 16, 2022.
  20. 20.0 20.1 20.2 McCrone, P; Sharpe, M; Chalder, T; Knapp, M; Johnson, AL; Goldsmith, K (August 1, 2012), "Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis", PLoS One, doi:10.1371/journal.pone.0040808, PMID 22870204
  21. 21.0 21.1 21.2 Chalder, T; Goldsmith, KA; White, PD; Sharpe, M; Pickles, AR (January 28, 2015), "Rehabilitative therapies for chronic fatigue syndrome: a secondary mediation analysis of the PACE trial", The Lancet Psychiatry, 2 (2): 141-52, doi:10.1016/S2215-0366(14)00069-8, PMID 26359750
  22. 22.0 22.1 Sharpe, M; Chalder, T (February 17, 2011), "London Press Conference: Chronic Fatigue Syndrome - part 1 (video)", The Lancet TV
  23. 23.0 23.1 Sharpe, M (February 17, 2011), "London Press Conference: Chronic Fatigue Syndrome - part 2 (video)", The Lancet TV
  24. 24.0 24.1 Chalder, T (February 17, 2011), "London Press Conference: Chronic Fatigue Syndrome - part 3 (video)", The Lancet TV
  25. 25.0 25.1 Guardian (UK); Sarah Boseley (February 18, 2011), Study finds therapy and exercise best for ME
  26. 26.00 26.01 26.02 26.03 26.04 26.05 26.06 26.07 26.08 26.09 26.10 26.11 26.12 26.13 Tuller, David (October 21, 2015), "TRIAL BY ERROR: The Troubling Case of the PACE Chronic Fatigue Syndrome Study - Part 1", Virology Blog
  27. 27.0 27.1 Tuller, David (October 22, 2015), "TRIAL BY ERROR: The Troubling Case of the PACE Chronic Fatigue Syndrome Study - Part 2", Virology Blog
  28. 28.0 28.1 Tuller, David (October 23, 2015), "TRIAL BY ERROR: The Troubling Case of the PACE Chronic Fatigue Syndrome Study - Part 3", Virology Blog
  29. 29.0 29.1 Reuters (February 17, 2011), Pushing limits can help chronic fatigue patients
  30. 30.0 30.1 WebMD (US) (February 17, 2011), Study Shows Cognitive Behavioral Therapy, Exercise Are Safe Ways to Treat CFS Symptoms
  31. 31.0 31.1 BBC News (February 18, 2011), Brain and body training treats ME, UK study says
  32. 32.0 32.1 CNN News (US) (February 18, 2011), Study supports use of 2 controversial treatments for chronic fatigue
  33. Medical News Today (February 1, 2013), Chronic Fatigue Treatments Lead To Recovery In Trial
  34. Daily Mail (UK) (February 18, 2011), Got ME? Fatigued patients who go out and exercise have best hope of recovery, finds study
  35. New York Times (February 17, 2011), Psychotherapy Eases Chronic Fatigue Syndrome, Study Finds
  36. 36.0 36.1 Evening Standard (UK) (October 28, 2015), Exercise and positive thinking 'can help overcome' Chronic Fatigue Syndrome
  37. 37.0 37.1 Independent (IE) (October 28, 2015), Chronic Fatigue Syndrome sufferers 'can overcome symptoms of ME with positive thinking and exercise' / Oxford University has found ME is not actually a chronic illness
  38. 38.0 38.1 Torjesen, Ingrid (October 28, 2015), "Tackling fear about exercise produces long term benefit in chronic fatigue syndrome", BMJ
  39. 39.0 39.1 Daily Mail (UK) (October 28, 2015), ME can be beaten by taking more exercise and positive thinking, landmark study claims
  40. 40.0 40.1 FoxNews (US) (January 14, 2015), Helping chronic fatigue patients over fears eases symptoms
  41. 41.0 41.1 Guardian (UK) (January 14, 2015), Chronic fatigue syndrome patients’ fear of exercise can hinder treatment - study
  42. 42.0 42.1 42.2 The Telegraph; Sarah Knapton (October 28, 2015), Chronic Fatigue Syndrome sufferers 'can overcome symptoms of ME with positive thinking and exercise
  43. #MEAction (October 28, 2015), "PACE trial controversy grows", #MEAction
  44. 44.0 44.1 Cohen, Jon (October 27, 2015), "Criticism mounts of a long-controversial chronic fatigue study", Science Magazine
  45. ME Action UK (April 16, 2011), The Media and ME
  46. Larun, Lillebeth; Brurberg, Kjetil G; Odgaard-Jensen, Jan; Price, Jonathan R (October 2, 2019). Cochrane Common Mental Disorders Group (ed.). "Exercise therapy for chronic fatigue syndrome". Cochrane Database of Systematic Reviews. 2021 (3). doi:10.1002/14651858.CD003200.pub8. PMC 6953363. PMID 31577366.
  47. British Association for CFS/ME (BACME) (March 2011), Statement on the PACE Trial results
  48. ME Association (October 23, 2013). "MEA opposes plan to put review of NICE ME/CFS Guideline on hold".
  49. NICE guidelines (UK) (February 2014), NICE guidelines (CG53) - Chronic fatigue syndrome / myalgic encephalomyelitis (or encephalopathy): review decision
  50. National Institute for Clinical Excellence. "Surveillance decision | Chronic fatigue syndrome/myalgic encephalomyelitis (or encephalopathy): diagnosis and management | Guidance and guidelines". www.nice.org.uk. Retrieved October 19, 2018.
  51. US Centers for Disease Control and Prevention (CDC) (June 27, 2012), Diagnosis and Management of Chronic Fatigue Syndrome, retrieved March 10, 2016
  52. Egeland, T; Angelsen, A; Haug, R; Henriksen, JO; Lea, TE; Saugstad, OD (October 2015), "What exactly is myalgic encephalomyelitis?", Tidsskr Nor Legeforen (Perspectives), 135 (19): 1756–9, doi:10.4045/tidsskr.15.0089, lay summary
  53. Jason, Leonard A; McManimen, Stephanie; Sunnquist, Madison; Brown, Abigail; Furst, Jacob; Newton, Julia L; Strand, Elin Bolle (January 2016), "Case definitions integrating empiric and consensus perspectives", Fatigue: Biomedicine, Health & Behavior (Article), 4 (1): 1-23, doi:10.1080/21641846.2015.1124520, lay summary
  54. National Institutes of Health (US) (December 9, 2014), NIH Pathways to Prevention Workshop: Advancing the Research on Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome (PDF), archived from the original (PDF) on 2016
  55. 55.0 55.1 55.2 55.3 Tuller, David (October 30, 2015), "PACE trial investigators respond to David Tuller", Virology Blog
  56. 56.0 56.1 56.2 Davis, Ronald W; Edwards, Jonathan C W; Jason, Leonard A; Levin, Bruce; Racaniello, Vincent R; Reingold, Arthur L; Ablashi, Dharam V; Baraniuk, James N; Barcellos, Lisa F; Bateman, Lucinda; Bell, David S; Bested, Alison C; Broderick, Gordon; Chia, John; Chu, Lily; Enlander, Derek; Fletcher, Mary Ann; Friedman, Kenneth; Kaufman, David L; Klimas, Nancy; Lapp, Charles W; Levine, Susan; Light, Alan R; Marshall-Gradisnik, Sonya; Medveczky, Peter G; Nahle, Zaher; Oleske, James M; Podell, Richard N; Shepherd, Charles; Snell, Christopher R; Speight, Nigel; Staines, Donald; Stark, Philip B; Stein, Eleanor; Swartzberg, John; Tompkins, Ronald G; Underhill, Rosemary; Vallings, Rosamund; Van ElZakker, Michael; Weir, William; Zinn, Marcie L; Zinn, Mark A (February 10, 2016), "An open letter to the Lancet - again", Virology Blog
  57. Juenger, J; Schellberg, D; Kraemer, S; Haunstetter, A; Zugck, C; Herzog, W; Haass, M (March 2002), "Health related quality of life in patients with congestive heart failure: comparison with other chronic diseases and relation to functional variables", Heart, 87 (3): 235–241, PMID 1767036
  58. 58.0 58.1 58.2 Goldin, Rebecca (March 21, 2016), "PACE: The research that sparked a patient rebellion and challenged medicine", Sense About Statistics (American Statistical Association) (Review of Study Design)
  59. #MEAction (October 28, 2015), "What's Wrong in the Lancet", #MEAction
  60. #MEAction (October 28, 2015), "What's Wrong in Psychological Medicine", #MEAction
  61. 61.0 61.1 Courtney, Robert (October 29, 2013), FOI Request: PACE Recovery Rates and Positive Outcome Rates (repeat request)
  62. Matthees, Alem (March 24, 2014), FOI Request: Selected data on PACE Trial participants
  63. McPhee, Graham (July 28, 2015), FOI Request: Fitness data for PACE trial
  64. 64.0 64.1 Information Commissioner's Office, UK (March 9, 2016), FOI Decision Notice: to QMUL (PDF)
  65. Edwards, Jonathan CW (January 18, 2015), "(response) Re: Tackling fears about exercise is important for ME treatment", BMJ, 350: h227, doi:10.1136/bmj.h227
  66. 66.0 66.1 Edwards, Jonathan CW (November 1, 2015), "Prof. Jonathan Edwards: PACE trial is 'valueless'", #MEAction
  67. PACE Trial Management Group (June 2006), PACE trial participants' newsletter #1 (PDF)
  68. PACE Trial Management Group (March 2007), PACE trial participants' newsletter #2 (PDF)
  69. 69.0 69.1 PACE Trial Management Group (December 2008), PACE trial participants' newsletter #3 (PDF)
  70. PACE Trial Management Group (February 2011), PACE trial participants' newsletter #4 (PDF)
  71. 71.0 71.1 71.2 71.3 71.4 Coyne, James (October 29, 2015), "Uninterpretable: Fatal flaws in PACE Chronic Fatigue Syndrome follow-up study", PLoS One Blog, archived from the original on May 6, 2016
  72. 72.0 72.1 72.2 Coyne, James (October 29, 2015), "Uninterpretable: Fatal flaws in PACE Chronic Fatigue Syndrome follow-up study", MindTheBrain Blog
  73. 73.0 73.1 Dougall, D; Johnson, A; Goldsmith, K; Sharpe, M; Angus, B; Chalder, T; White, P (July 2014), "Adverse events and deterioration reported by participants in the PACE trial of therapies for chronic fatigue syndrome", Journal of Psychosomatic Research, 77 (1): 20-26, doi:10.1016/j.jpsychores.2014.04.002
  74. 74.0 74.1 Kindlon, Tom (2011), "Reporting of Harms Associated with Graded Exercise Therapy and Cognitive Behavioural Therapy in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome", Bulletin of the IACFS/ME, 19 (2): 59-111
  75. 75.0 75.1 Tuller, David (January 7, 2016), "Trial By Error, Continued: Did the PACE Trial Really Prove that Graded Exercise Is Safe?", Virology Blog
  76. Courtney, Robert (April 2015), "(correspondence) Doubts over the validity of the PACE hypothesis", The Lancet Psychiatry, doi:10.1016/S2215-0366(15)00054-1
  77. Kemp, Peter (February 2016), PACE Trial Analysis
  78. Kennedy, Angela (February 10, 2016), "Summary of my specific concerns about PACE with annotated bibliography", PACE Documents blogspot
  79. Twisk, Frank (January 18, 2016), "(correspondence) PACE: CBT and GET are not rehabilitative therapies", The Lancet Psychiatry, doi:10.1016/S2215-0366(15)00554-4
  80. Mitchell, John T, Jnr (May 17, 2011), "(correspondence) The PACE trial in chronic fatigue syndrome", The Lancet
  81. Feehan, Sarah M; on behalf of the Liverpool ME Support Group (May 17, 2011), "(correspondence) The PACE trial in chronic fatigue syndrome", The Lancet, doi:10.1016/S0140-6736(11)60688-0
  82. Giakoumakis, Jane (May 17, 2011), "(correspondence) The PACE trial in chronic fatigue syndrome", The Lancet, doi:10.1016/S0140-6736(11)60689-2
  83. Invest in ME (IIME) (November 14, 2015), Letter to the Editor of the Lancet – The PACE Trial (PDF)
  84. Guardian (UK); Jane Colby (February 24, 2011), ME – the truth about exercise and therapy
  85. #MEAction (2015). "PRESS RELEASE: 12,000 SIGNATURE PACE PETITION DELIVERED TO THE LANCET". Retrieved June 10, 2020.
  86. #MEAction (October 28, 2015), "PACE Trial Overview", #MEAction
  87. #MEAction (May 2015), "Patient view of the PACE trial controversy" (PDF), #MEAction
  88. https://www.youtube.com/watch?v=7NKsbjU89Zk
  89. 89.0 89.1 Tuller, David (October 30, 2015), "David Tuller responds to PACE trial investigators", Virology Blog
  90. Tuller, David (November 4, 2015), "Trial By Error, Continued: Did the PACE Study Really Adopt a 'Strict Criterion' for Recovery?", Virology Blog
  91. Tuller, David (November 9, 2015), "Trial By Error, Continued: Why has the PACE Study's Sister Trial been Disappeared and Forgotten?", Virology Blog
  92. Tuller, David (November 17, 2015), "Trial By Error, Continued: PACE Team's Work for Insurance Companies Is "Not Related" to PACE. Really?", Virology Blog
  93. Tuller, David (January 4, 2016), "Trial By Error, Continued: Questions for Dr. White and his PACE Colleagues", Virology Blog
  94. Hooper, Malcolm; Williams, Margaret (June 20, 2004), Issues re the use of the Oxford criteria for the MRC “CFS” Trials (PDF)
  95. Hooper, Malcolm; Williams, Margaret (December 17, 2009), Can the MRC PACE Trial be justified (PDF)
  96. Hooper, Malcolm (February 2010), Magical Medicine: How to Make a Disease Disappear (PDF)
  97. Hooper, Malcolm; Williams, Margaret (March 2011), Complaint to the Editor of the Lancet about the PACE Trial Articles (PDF)
  98. 98.0 98.1 Hooper, Malcolm; Williams, Margaret (May 28, 2011), Professor Malcolm Hooper’s Detailed Response to Professor Peter White’s letter to Dr Richard Horton about his complaint re: the PACE Trial articles published in The Lancet (PDF)
  99. Hooper, Malcolm; Williams, Margaret (June 4, 2011), Professor Malcolm Hooper’s further concerns about the PACE Trial article published in The Lancet (PDF)
  100. Hooper, Malcolm; Williams, Margaret (September 2013), The Role of the Science Media Centre and the Insurance Industry in ME/CFS: the facts behind the fiction (PDF)
  101. Hooper, Malcolm; Williams, Margaret (September 2013), Key Concerns about the PACE trial (PDF)
  102. Hooper, Malcolm; Williams, Margaret (November 14, 2015), PACE Trial Key Dates and Chronology of Complaint (PDF)
  103. 103.0 103.1 List of ME/CFS articles published at Virology Blog
  104. 104.0 104.1 104.2 Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - video part 1, Edinburgh
  105. 105.0 105.1 105.2 Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - video part 2, Edinburgh
  106. 106.0 106.1 106.2 Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - video part 3, Edinburgh
  107. 107.0 107.1 107.2 Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - slide show, Edinburgh
  108. 108.0 108.1 108.2 Coyne, James (February 8, 2016), The scandal of the £5m PACE trial for ME - video
  109. 109.0 109.1 109.2 Coyne, James (February 8, 2016), The scandal of the £5m PACE trial for ME - slide show
  110. 110.0 110.1 Coyne, James (November 25, 2015), "Was independent peer review of the PACE trial articles possible?", MindTheBrain Blog
  111. Coyne, James, "ME/CFS", QuickThoughts Blog
  112. Laws, Keith (November 1, 2015), "PACE - Thoughts about Holes", LawsDystopia Blog
  113. Laws, Keith (November 6, 2015), "PACE - Song for the Siren", LawsDystopia Blog
  114. 114.0 114.1 Coyne, James; Laws, Keith (January 18, 2016), "(comment) Results of the PACE follow-up study are uninterpretable", The Lancet Psychiatry
  115. Rehmeyer, Julie (November 13, 2015), "Hope for Chronic Fatigue Syndrome", Slate
  116. 116.0 116.1 Rehmeyer, Julie; Tuller, David (March 18, 2017). "Getting It Wrong on Chronic Fatigue Syndrome". The New York Times, Sunday Review.
  117. Cite error: Invalid <ref> tag; no text was provided for refs named <ref name=
  118. Bailey, Lucy (January 27, 2016), "My thoughts about the PACE trial", Lucibee's Blog
  119. Bailey, Lucy (October 2017), "A Case for Retraction ?", The Lancet Infectious Diseases, doi:10.1016/S1473-3099(17)30527-3
  120. https://lucibee.wordpress.com/2018/05/09/pace-trial-whatever-happened-to-actigraphy/
  121. Vink, Mark (March 30, 2016), "The PACE Trial Invalidates the Use of Cognitive Behavioral and Graded Exercise Therapy in Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome: A Review", J Neurol Neurobiol, 2 (3), doi:10.16966/2379-7150.124
  122. Schneider, Leonid (April 5, 2016), "Does The Lancet care about patients?", ForBetterScience Blog
  123. 123.0 123.1 Schneider, Leonid (February 8, 2016), "PACE trial and other clinical data sharing: patient privacy concerns and parasite paranoia", ForBetterScience Blog
  124. Schneider, Leonid, "Index of PACE Trial articles", ForBetterScience Blog
  125. 125.0 125.1 Gelman, Andrew (December 23, 2015), "To keep science honest, study data must be shared", StatNews
  126. Gelman, Andrew (December 25, 2015), "More on the PACE (chronic fatigue syndrome study) scandal", Statistical Modeling, Causal Inference, and Social Science (blog)
  127. Gelman, Andrew (January 5, 2016), "PACE study and the Lancet: Journal reputation is a two-way street", Statistical Modeling, Causal Inference, and Social Science (blog)
  128. Gelman, Andrew (July 9, 2017), "A Memoir of Chronic Fatigue Illustrates the Failures of Medical Research", New Yorker (US)
  129. Helmfrid, Sten (September 2016), "Studies on Cognitive Behavioral Therapy and Graded Exercise Therapy for ME/CFS are misleading", Socialmedicinsk tidskrift
  130. Lee, Sonia (February 23, 2017), PACE Trial: Critical Appraisal (slides), doi:10.6084/m9.figshare.4685074.v1
  131. Lee, Sonia (February 23, 2017), PACE Trial: Critical Appraisal (video)
  132. https://meaustralia.net/2018/06/28/research-waste-in-me-and-cfs-trials/
  133. https://www.biorxiv.org/content/early/2017/05/07/133926
  134. 134.0 134.1 Jason, Leonard A (February 2017), "The PACE trial missteps on pacing and patient selection", Journal of Health Psychology, 22 (9): 1141-1145, doi:10.1177/1359105317695801
  135. Myhill, Sarah (August 22, 2017), MAIMES (Medical Abuse in ME Sufferers) - The Time Has Come To End The Abuse
  136. https://www.melbournebioanalytics.org/first-news-item/
  137. Anderssen, Alex (September 5, 2016), "Lancet Rejects Scientists' PACE Letter", #MEAction
  138. Racaniello, Vincent (August 21, 2016), "TWiV 403: It's not easy being vaccine", This Week In Virology (podcast)
  139. #MEAction (March 2016), "#MEAction delivers Lancet petition, makes Wall Street Journal", #MEAction
  140. #MEAction (November 16, 2015), "Call for HHS to Investigate Pace", #MEAction
  141. https://twitter.com/lacooperUK/status/863505581298130945
  142. https://twitter.com/lacooperUK/status/863701801165606913
  143. http://limitedcapability.blogspot.co.uk/2017/05/millionsmissing-protest-london-120517.html
  144. White, PD (March 31, 2006), Letter from Professor Peter White re Theft of patient data (PDF)
  145. Hooper, Malcolm (February 2010), Magical Medicine: How to Make a Disease Disappear (PDF), pp. 254 to 256
  146. http://www.meaction.net/2016/04/26/centre-for-welfare-reform-criticises-pace-trial
  147. Duffy, Simon; Centre for Welfare Reform (UK) (April 20, 2016), "The Misleading Research at the Heart of Disability Cuts", Huffington Post (UK)
  148. 148.0 148.1 Butterworth, Trevor (March 21, 2016), "Editorial: On PACE", Sense About Statistics (American Statistical Association)
  149. 149.0 149.1 149.2 Rehmeyer, Julie (August 8, 2016), "Rehmeyer makes statisticians' jaws drop over PACE", #MEAction
  150. UK Parliament (February 6, 2013), UK House of Lords, Debates the PACE Trial - 6 February 2013 (video)
  151. UK Parliament (February 6, 2013), UK House of Lords, Debates the PACE Trial - 6 February 2013 (transcript)
  152. Hooper, Malcolm; Williams, Margaret (February 6, 2013), Comments on the PACE debate held in House of Lords (Grand Committee) on 6th February 2013 (PDF)
  153. Hooper, Malcolm; Williams, Margaret (February 1, 2017), Concerns about Public Funding for the PACE Trial - Committee of Public Accounts (PDF)
  154. White, PD; Goldsmith, KA; Johnson, AL; Walwyn, R; Baber, HL; Chalder, T; Sharpe, M (May 17, 2011), "(correspondence) The PACE trial in chronic fatigue syndrome – Authors' reply", The Lancet, 377 (9780): 1834–1835, doi:10.1016/S0140-6736(11)60651-X
  155. Murray, Robin; Agardy, Susanna; Carter, Samuel; Courtney, Robert; Cox, Duncan; Maryhew, Carly; Shepherd, Charles; White, Peter (July 22, 2013), "(correspondence) Six letters concerning the paper by White et al (2013) on the PACE Trial", Psychological Medicine, republished by ME Association UK, 43 (8): 1787–1787, Editor: we have published six of the letters which cover the main criticisms, and invited Professor White to reply to them
  156. Chalder, T; Goldsmith, KA; White, PD; Sharpe, M; Pickles, AR (April 2015), "(response) Author's reply - Methods and outcome reporting in the PACE trial", The Lancet Psychiatry, 2 (4): e10–e11, doi:10.1016/S2215-0366(15)00114-5
  157. Sharpe, M; Goldsmith, KA; Johnson, AL; Chalder, T; Walker, J; White, PD (February 2016), "(correspondence) Authors' reply - Patient reaction to the PACE trial", The Lancet Psychiatry, 3 (2): e8–e9, doi:10.1016/S2215-0366(16)00018-3
  158. Kindlon, Tom (August 30, 2013), "(correspondence) Re: College was right not to disclose deliberations about chronic fatigue treatment trial, tribunal rules", BMJ, doi:10.1136/bmj.f5355
  159. White, PD (September 25, 2013), "(response) Re: People want to learn as much as possible from the PACE trial for chronic fatigue syndrome", BMJ, 347: f5731, doi:10.1136/bmj.f5731
  160. (various authors) (October 15, 2013), "(31 responses) Re: PACE trial authors' reply to letter by Kindlon", BMJ (347): f5963, doi:10.1136/bmj.f5963
  161. Coyne, James (November 4, 2015), "@Mental_Elf asked me to join PACE investigators in live debate. I agreed, they did not.", Twitter
  162. Guardian (UK); Robin McKie (August 21, 2011), Chronic fatigue syndrome researchers face death threats from militants
  163. Wessely, Simon (August 27, 2011), "Mind the gap - It's time to stop separating psychiatry and neurology", Spectator (UK)
  164. Wessely, Simon (July 29, 2011), "Malicious' harassment of ME researchers", BBC - Today
  165. Zimmer, Carl (August 21, 2011), "Chronic Fatigue Syndrome: Death threats for scientists?", Discover Magazine
  166. Lowe, Derek (September 6, 2011), "Chronic Fatigue: Enough Energy Left for Death Threats, Anyway", Science Translational Medicine Blog
  167. The Telegraph (July 29, 2011), ME researchers 'receive death threats from sufferers'
  168. "ME/CFS: Harassment of Researchers", Stuff and Nonsense Blog, November 17, 2012
  169. BBC News; Fielden, Tom (July 21, 2011), 'Torrent of abuse' hindering ME research
  170. Hawkes, Nigel (July 22, 2011), "Dangers of research into chronic fatigue syndrome", BMJ, doi:10.1136/bmj.d3780
  171. Wessely, Simon; Marsh, Stefanie (August 6, 2011). "Interview with Professor Simon Wessely". The Times. Archived from the original on August 6, 2011.
  172. The Sunday Times (May 5, 2013), This man faced death threats and abuse. His crime? He suggested that ME was a mental illness
  173. The Telegraph (September 28, 2012), It’s safer to insult the Prophet Mohammed than to contradict the armed wing of the ME brigade
  174. Tymes Trust (August 2014), Behind the scenes: Setting up the UK CFS/ME Research Collaborative (UK CMRC) (PDF)
  175. 175.0 175.1 175.2 Information Commissioner's Office, UK (March 18, 2015), FOI Decision Notice: to QMUL (PDF)
  176. 176.0 176.1 176.2 Kings College London (December 11, 2015), FOI Request: Response from Kings College London to James Coyne (PDF)
  177. 177.0 177.1 Sheridan, Anna (November 1, 2015), FOI Request: Raw 6min walking test data after treatment
  178. 178.0 178.1 McPhee, Graham (July 28, 2015), FOI Request: Fitness data for PACE trial
  179. 179.0 179.1 The Lancet (May 17, 2011), "Editorial: Patients' power and PACE", The Lancet, doi:10.1016/S0140-6736(11)60696-X
  180. 180.0 180.1 Swan, Norman; Sharpe, Michael; Horton, Richard (April 18, 2011), "Health Report - Comparison of treatments for chronic fatigue syndrome - the PACE trial", ABC Radio National (Australia) - Health Report, archived from the original on April 18, 2011
  181. Kennedy, Angela (November 19, 2012), "Statement re Simon Wessely and claims of harassment", Academia
  182. Lewandowsky, Stephan; Bishop, Dorothy (January 25, 2016), "Research integrity: Don't let transparency damage science", Nature News
  183. Lewandowsky, Stephan (February 4, 2016), "Most Christians are definitely not terrorists", Shaping Tomorrows World (blogs), archived from the original on September 21, 2017
  184. Tuller, David (February 1, 2016), "Trial By Error, Continued: A Few Words About "Harassment"", Virology Blog
  185. #MEAction (February 1, 2016), Tuller: PACE authors "wrapping themselves in victimhood"
  186. Science Media Centre; Crawley, Esther (October 2011), Threats of Persecution (PDF), Science Media Centre, p. 16, archived from the original (PDF) on August 7, 2014
  187. Science Media Centre; Blithell, Claire (February 2013), "Supporting experts targeted by extremists" (PDF), Science Media Centre (Review of First Three Years in Mental Health Research): 10, archived from the original (PDF) on April 18, 2016
  188. Hale, Catherine (December 17, 2015), "The politics of stigma with ME/CFS", Catherine Hale (blog)
  189. MEMilitant (October 8, 2017), "RC Psych previously smeared patients - Will this change?", Twitter, archived from the original on March 28, 2018
  190. Tatchell, Peter (September 21, 2016), "Isaac Marks - Lessons not Learnt", Twitter
  191. Tatchell, Peter (September 23, 2016), "Worrying how the DWP treats disabled people", Twitter
  192. 192.0 192.1 "Changing the narrative #2: warring factions, divide & rule and death threats". valerieeliotsmith. January 14, 2019. Retrieved August 14, 2019.
  193. 193.0 193.1 King's College London (December 12, 2012). "Freedom of information act request 138299, response 341512". www.whatdotheyknow.com. Retrieved March 22, 2019.
  194. King's College London (January 17, 2017). "Freedom of Information Act request 370916, response 921879" (PDF).
  195. D.G. (February 19, 2016), "Reader's comment on Leonid Schneider's blog - PACE team disregarded the MRC data sharing policy", ForBetterScience Blog
  196. Coyne, James (December 4, 2015), "Update on my formal request for release of the PACE trial data", QuickThoughts Blog
  197. 197.0 197.1 Coyne, James (February 14, 2016), "A call for the unconditional release of the PLOS One PACE data Part 1", QuickThoughts Blog
  198. McCrone, Paul; Sharpe, Michael; Chalder, Trudie; Knapp, Martin; Johnson, Anthony L.; Goldsmith, Kimberley A.; White, Peter D. (August 1, 2012). van Baal, Pieter H. M. (ed.). "Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis". PLoS ONE. 7 (8): e40808. doi:10.1371/journal.pone.0040808. ISSN 1932-6203. PMC 3411573. PMID 22870204.
  199. Coyne, James (March 7, 2016), "Update: PLoS One affirms my (and anyone else's) right to PACE data published there", QuickThoughts Blog
  200. Science Media Centre; Fox, Fiona (October 31, 2013), "SMC - malicious use of FOI against researchers", Science Media Centre ((email))
  201. (various authors) (September 27, 2015), "Peter White complaining about PACE Trial FOI request and calling for changes to FOI laws", Phoenix Rising (ME/CFS support forums)
  202. Information Commissioner's Office, UK (March 29, 2016), FOI Decision Notice: to QMUL (PDF)
  203. Information Commissioner's Office, UK (October 27, 2015), FOI Decision Notice: to QMUL (PDF)
  204. Courtney, Robert (October 26, 2012), FOI Request: PACE Trial Recovery Rates and Positive Outcome Rates
  205. Sheridan, Anna (September 3, 2013), FOI Request: 6min walking test data - Recovered patients in PACE trial
  206. JohnTheJack (June 29, 2016), "Using public money to keep publicly funded data from the public", JohnTheJack Blog
  207. Anderssen, Alex (July 9, 2016), "QMUL spend £250,000 on PACE data tribunal", #MEAction
  208. Eliot Smith, Valerie (July 15, 2016), "Short Update on the Progress of the PACE Trial judgment (QMUL v IC and Matthees)", ValerieEliotSmith Blog
  209. Information Commissioner's Office, UK (August 12, 2016), FOI Decision Notice: to QMUL (PDF)
  210. 210.0 210.1 Eliot Smith, Valerie (August 16, 2016), "Tribunal orders release of PACE Trial data (QMUL v the IC and Matthees)", ValerieEliotSmith Blog
  211. Queen Mary University of London (QMUL) (August 16, 2016), "Statement: Disclosure of PACE trial data under the Freedom of Information Act", QMUL website
  212. PACE Trial Management Group; (via FOI request) (March 9, 2006), PACE trial protocol: Full Trial Consent Form with Missing Therapist and No Cover (PDF)
  213. Coyne, James (November 11, 2015), "Why the scientific community needs the PACE trial data to be released", MindTheBrain Blog
  214. Coyne, James (December 2, 2015), "What it takes for Queen Mary to declare a request for scientific data "vexatious"", QuickThoughts Blog
  215. Coyne, James (December 18, 2015), "King's College London stalls some more, reiterating refusal to release the PACE trial data", QuickThoughts Blog
  216. Coyne, James (December 22, 2015), "Recognizing when "protecting patient privacy" is mere excuse for not sharing data", QuickThoughts Blog
  217. Coyne, James (January 2, 2016), "Glimpses into the assault on data sharing", QuickThoughts Blog
  218. Coyne, James (January 31, 2016), "Further insights into war against data sharing: Science Media Centre's letter writing campaign to UK Parliament", QuickThoughts Blog
  219. Coyne, James (February 20, 2016), "As major medical journals balk, BMJ moves forward with routine data sharing", QuickThoughts Blog
  220. Coyne, James (March 9, 2016), "UK expert: AIDS data should not be shared until requesters shown to be HIV", QuickThoughts Blog
  221. Coyne, James (March 26, 2016), "'We don't share data.' Why Peter White's Wall Street Journal letter can be ignored", QuickThoughts Blog
  222. Davis, Ronald W; Levin, Bruce; Racaniello, Vincent R; Tuller, David (December 17, 2015), "Open letter: A request for data from the PACE trial", Virology Blog
  223. Tuller, David (January 19, 2016), "At least we're not vexatious", Virology Blog
  224. Anderssen, Alex (May 14, 2016), "Racianello: PACE Obfuscation will continue "until we are all dead"", #MEAction
  225. Emerge Australia (March 20, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  226. ME/CFS Australia (South Australia) (March 30, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  227. European ME Alliance (EMEA); ME-Vereniging (Belgium); Foreningen for Myalgisk Encefalomyelitis (Denmark); ME Foreningen (Denmark); Suomen CFS-Yhdistys (Finland); Fatigatio e.V. (Germany); Het Alternatief (Netherlands); ME félag Íslands (Iceland); Irish ME Trust (Ireland); Associazione Malati di CFS (Itali); Norges ME-forening (Norway); Liga SFC (Spain); Riksföreningen för ME-patienter (RME) (Sweden); Verein ME/CFS Schweiz (Switzerland); Invest in ME Research (UK) (March 12, 2016), Open Letter to QMUL - Request for the release of PACE trial data (PDF)
  228. Phoenix Rising (March 7, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  229. Action for ME (February 12, 2016). "Open Letter to QMUL - Request for the release of PACE trial data".
  230. Invest in ME (IIME) (February 12, 2016), Open Letter to The Lancet - Request for the release of PACE trial data
  231. Invest in ME (IIME) (February 19, 2016), Open Letter to MRC - Request for the release of PACE trial data
  232. ME Association (February 9, 2016). "Open Letter to QMUL - Request for the release of PACE trial data".
  233. The Young ME Sufferers Trust (Tymes Trust) (February 16, 2016). "Open Letter to QMUL - Request for the release of PACE trial data".
  234. ME Research UK (February 18, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  235. Hope for ME and Fibro Northern Ireland (February 16, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  236. Welsh Association of ME & CFS Support (WAMES) (February 17, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  237. 25% ME Group (February 10, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  238. Irish ME Trust (February 22, 2016), Open Letter to QMUL - Request for the release of PACE trial data (PDF)
  239. National ME/FM Action Network (Canada) (February 14, 2016), Open Letter to The Lancet - Request for the release of PACE trial data
  240. Wake Up Call Beweging (WUCB); ME-gids (March 7, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  241. Groep ME Den-Haag (February 24, 2016), Open Letter to QMUL - Request for the release of PACE trial data
  242. ME/cvs Vereniging; ME/CVS Stichting Nederland; Steungroep ME en Arbeidsongeschiktheid (March 15, 2016), Open Letter to QMUL - Request for the release of PACE trial data (PDF)
  243. Smith, Richard (December 16, 2015), "QMUL and King's college should release data from the PACE trial", BMJ Blogs
  244. Smith, Richard; Roberts, Ian (April 29, 2016), "Time for sharing data to become routine: the seven excuses for not doing so are all invalid", F1000Research, 2016 (5): 781, doi:10.12688/f1000research.8422.1
  245. Coyne, James (August 18, 2016), "Release the PACE trial data: My submission to the UK Tribunal", QuickThoughts Blog
  246. Ellis, Clark (January 25, 2016), "PACE trial's forbidden fruit - is the data really poisonous?", AutoDidact Blog
  247. Ellis, Clark (August 29, 2016), "PACE and the interests of trial participants", AutoDidact Blog
  248. ME Association (March 16, 2016), PACE Trial data release : Our March website poll gathers 1,322 votes so far
  249. Wall Street Journal; Amy Dockser Marcus (March 7, 2016), Patients, Scientists Fight Over Research-Data Access
  250. ME Association (March 7, 2016), Patients, Scientists Fight Over Research-Data Access (Wall Street Journal)
  251. http://www.meassociation.org.uk/2016/03/patients-scientists-fight-over-research-data-access-wall-street-journal-7-march-2016/
  252. Kennedy, Brian; Stephenson, Darryl; Watson, Nigel. "First-tier tribunal: Information Rights Appeal EA/2015/0269" (PDF). p. 40. The evidence of [expert witness] Professor Anderson that third parties could not identify participants from the information alone and that, when pressed, he said that the chance of an "activist" being able to discover information that would lead to individual identification was remote, it was clear that his assessment of activist behaviour was, in our view, grossly exaggerated and the only actual evidence was that an individual at a seminar had heckled Professor Chalder. The identity of those questioning the research, who had signed an open letter or supported it, was impressive.
  253. https://valerieeliotsmith.com/2015/11/26/queen-mary-university-of-london-to-appeal-information-commissioners-decision-on-disclosure-of-pace-trial-data/
  254. https://dl.dropboxusercontent.com/u/23608059/OCR-Queen%20Mary%20University%20of%20London%20EA-2015-0269%20%2812-8-16%29.pdf
  255. Anderssen, Alex (August 16, 2016), "Tribunal orders release of PACE data", #MEAction
  256. http://www.meaction.net/2016/07/09/qmul-spends-on-pace-tribunal/?mc_cid=4073cfdba0&mc_eid=2db0572c47
  257. https://johnthejack.com/2016/06/29/using-public-money-to-keep-publicly-funded-data-from-the-public
  258. http://www.qmul.ac.uk/media/news/items/smd/179331.html
  259. http://www.qmul.ac.uk/media/news/items/smd/181216.html
  260. https://twitter.com/CoyneoftheRealm/status/778643034800005120
  261. https://sites.google.com/site/pacefoir/pace-ipd_foia-qmul-2014-f73.xlsx?attredirects=0
  262. https://sites.google.com/site/pacefoir/pace-ipd_foia-%20qmul-%202014-f73.xlsx
  263. Centre for Welfare Reform (UK) (August 19, 2016), "Major breakthrough on PACE trial", Centre for Welfare Reform (UK)
  264. http://www.tandfonline.com/doi/abs/10.1080/21641846.2017.1259724?journalCode=rftg20&
  265. http://www.meaction.net/2016/12/14/the-pace-trial-where-recovery-doesnt-mean-getting-your-health-back/
  266. https://www.researchgate.net/publication/315482747_PACE_trial_claims_of_recovery_are_not_justified_by_the_data_A_Rejoinder_to_Sharpe_Chalder_Johnson_Goldsmith_and_White_2017
  267. https://www.qmul.ac.uk/wolfson/media/wolfson/current-projects/PACE-Data-Sharing-Policy.pdf
  268. Coyne, James (March 18, 2017), "Don't bother to apply: PACE investigators issue guidance for researchers requesting access to data", QuickThoughts Blog
  269. http://journals.sagepub.com/toc/hpqa/22/9
  270. https://twitter.com/newhealthpsych/status/891389836954931200
  271. http://www.centreforwelfarereform.org/news/the-making-opace-scandal/00335.html
  272. http://www.meaction.net/2017/07/30/the-pace-trial-the-making-of-a-medical-scandal/
  273. https://jcoynester.wordpress.com/2017/07/29/pace-gate-the-making-of-a-medical-scandal
  274. https://jcoynester.wordpress.com/2017/08/01/part-2-what-to-look-for-in-the-special-issue-of-journal-of-health-psychology-concerning-the-pace-trial/
  275. "expert reaction to Journal of Health Psychology's Special Issue on The PACE Trial | Science Media Centre". web.archive.org. July 31, 2017. Retrieved September 13, 2019.
  276. https://twitter.com/johnthejack/status/895013220875980800
  277. http://www.meassociation.org.uk/2017/08/the-times-scientists-trade-insults-over-myalgic-encephalomyelitis-me-study-01-august-2017/
  278. http://www.meassociation.org.uk/2017/08/the-times-behind-the-story-a-battle-of-prescriptions-01-august-2017/
  279. https://www.seeker.com/health/a-new-clue-is-helping-to-solve-the-mystery-behind-chronic-fatigue-syndrome
  280. https://twitter.com/MBVanElzakker/status/897337300971081728
  281. http://www.medicalindependent.ie/100315/is_it_just_me_or_is_this_a_real_disease
  282. http://www.twitlonger.com/show/n_1sq55c3
  283. http://www.meassociation.org.uk/wp-content/uploads/mecfs-research-funding-report-2016.pdf
  284. Rehmeyer, Julie (September 21, 2016), "Bad science misled millions with chronic fatigue syndrome. Here's how we fought back", Stat News
  285. Dimmock, Mary (August 18, 2016), "AHRQ agrees: GET useless, CBT ineffective", #MEAction
  286. The PLOS ONE Editors (May 2, 2017). "Expression of Concern: Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis". PLOS ONE. 12 (5): e0177037. doi:10.1371/journal.pone.0177037. ISSN 1932-6203. PMC 5412692. PMID 28463341.
  287. "Data sharing in clinical research: challenges and open opportunities". PLoS. May 2, 2017. Retrieved July 19, 2020.
  288. http://retractionwatch.com/2017/05/02/plos-upgrades-flag-controversial-pace-chronic-fatigue-syndrome-trial-authors-surprised/
  289. http://www.meassociation.org.uk/2017/07/cdc-removes-cbt-and-get-as-recommended-treatments-for-mecfs-11-july-2017/
  290. https://undark.org/2017/07/26/cdc-chronic-fatigue-graded-exercise/ CDC Removes Reference to Disputed ME/CFS Therapies From Website
  291. http://www.npr.org/sections/health-shots/2017/10/02/554369327/for-people-with-chronic-fatigue-syndrome-more-exercise-isnt-better
  292. https://www.nytimes.com/2017/11/27/well/new-recognition-for-chronic-fatigue.html?smid=tw-share
  293. Medical Research Council, M. R. C. (August 28, 2018). "Criticism of the PACE trial". mrc.ukri.org. Retrieved April 9, 2019.
  294. "The claim that the cure for the crippling fatigue of ME/CFS was to change your mind always seemed bizarre. Now it really is on the way out… | HealthInsightUK". Retrieved April 23, 2019.
  295. https://www.meaction.net/2018/02/05/the-failure-of-clinical-guidance-for-people-with-me/
  296. https://www.meaction.net/2018/04/24/a-song-for-me-blowin-in-the-wind/
  297. http://www.virology.ws/2018/06/19/trial-by-error-an-open-letter-to-the-lancet-two-years-on/
  298. http://www.virology.ws/2018/07/10/trial-by-error-yet-another-appeal-to-the-lancet-with-more-on-board/
  299. https://www.thetimes.co.uk/article/call-for-review-of-flawed-me-research-in-lancet-letter-l75rvcprh
  300. https://www.bmj.com/content/362/bmj.k3621.short?rss=1
  301. "The Times: Call for review of 'flawed' ME research in Lancet letter | August 21, 2018". Retrieved April 9, 2019.
  302. "Preparing children for starting primary school". August 27, 2018. ISSN 0140-0460. Retrieved April 9, 2019.
  303. https://www.researchgate.net/publication/322568480_Rethinking_the_treatment_of_chronic_fatigue_syndrome-A_reanalysis_and_evaluation_of_findings_from_a_recent_major_trial_of_graded_exercise_and_CBT
  304. Wilshire, Carolyn E.; Kindlon, Tom; Courtney, Robert; Matthees, Alem; Tuller, David; Geraghty, Keith; Levin, Bruce (March 22, 2018). "Rethinking the treatment of chronic fatigue syndrome-a reanalysis and evaluation of findings from a recent major trial of graded exercise and CBT". BMC psychology. 6 (1): 6. doi:10.1186/s40359-018-0218-3. ISSN 2050-7283. PMC 5863477. PMID 29562932.
  305. http://www.sciencemediacentre.org/wp-content/uploads/2018/03/Science-Media-Centre-Factsheet-CFS-ME-Final-Version.pdf
  306. http://www.sciencemediacentre.org/reanalysis-of-the-pace-trial/
  307. expert reaction to reanalysis of the PACE trial for chronic fatigue syndrome (CFS) treatments
  308. https://www.s4me.info/threads/science-media-centre-cfs-me-factsheet-for-journalists-the-illness-and-the-controversy.3104/
  309. http://www.dailymail.co.uk/wires/pa/article-5532233/Findings-chronic-fatigue-study-not-reliable.html
  310. https://www.huffingtonpost.co.uk/2018/03/22/findings-of-chronic-fatigue-study-not-reliable_n_19401888.html
  311. http://www.thisismoney.co.uk/wires/pa/article-5532233/Findings-chronic-fatigue-study-not-reliable.html
  312. http://www.meassociation.org.uk/2018/03/reanalysis-of-the-pace-trial-finds-impressive-claims-for-recovery-following-cbt-and-get-are-not-statistically-reliable-22-march-2018/
  313. https://www.healtheuropa.org/controversy-me-pace-trial/85888/
  314. https://www.thecanary.co/discovery/analysis-discovery/2018/03/22/the-mainstream-medical-community-just-declared-war-on-people-living-with-me/
  315. https://www.jwatch.org/na46472/2018/04/06/chronic-fatigue-treatment-redux-questioning-efficacy-cbt
  316. https://www.europeanhealthjournal.com/2018/04/26/rethinking-the-treatment-of-chronic-fatigue-syndrome-a-reanalysis-and-evaluation-of-findings-from-a-recent-major-trial-of-graded-exercise-and-cbt/
  317. Sharpe, Michael; Goldsmith, Kim; Chalder, Trudie (March 12, 2019). "The PACE trial of treatments for chronic fatigue syndrome: a response to WILSHIRE et al". BMC Psychology. 7 (1): 15. doi:10.1186/s40359-019-0288-x. ISSN 2050-7283.
  318. Wilshire, Carolyn E.; Kindlon, Tom (March 26, 2019). "Response: Sharpe, Goldsmith and Chalder fail to restore confidence in the PACE trial findings". BMC Psychology. 7 (1): 19. doi:10.1186/s40359-019-0296-x. ISSN 2050-7283. PMID 30914065.
  319. https://www.magonlinelibrary.com/doi/abs/10.12968/bjhc.2018.24.3.112
  320. Davenport, Todd E; Stevens, Staci R; VanNess, J Mark; Stevens, Jared; Snell, Christopher R (October 2019). "Checking our blind spots: current status of research evidence summaries in ME/CFS". British Journal of Sports Medicine. 53 (19): 1198–1198. doi:10.1136/bjsports-2018-099553. ISSN 0306-3674.
  321. https://www.amazon.co.uk/Health-Psychology-Theory-Research-Practice/dp/1526408244/ref=pd_lpo_sbs_14_img_0?_encoding=UTF8&psc=1&refRID=QGYXJNF0PF8EA2M764JA
  322. https://www.amazon.co.uk/Psychology-Crisis-Brian-Hughes/dp/1352003007
  323. http://www.drmyhill.co.uk/wiki/My_Complaint_to_the_GMC_about_the_PACE_authors
  324. https://www.change.org/p/the-general-medical-council-i-am-showing-my-support-for-dr-myhill-s-complaint-to-the-gmc-about-the-pace-authors</
  325. https://ico.org.uk/media/action-weve-taken/decision-notices/2018/2258289/fs50687719.pdf
  326. https://www.dropbox.com/s/xbos0l3k6ylr0ew/ICO%20decision%20minutes.pdf?dl=0
  327. http://www.carol.monaghan.scot/2018/02/07/pace-trial/
  328. UK Parliament (February 20, 2018), PACE trial and its effect on people with ME (video)
  329. UK Parliament (February 20, 2018), PACE trial and its effect on people with ME (transcript)
  330. UK Parliament (February 20, 2018), PACE trial and its effect on people with ME (alternate video #2)
  331. UK Parliament (February 20, 2018), PACE trial and its effect on people with ME (alternate video #3)
  332. UK Parliament (February 20, 2018), PACE trial and its effect on people with ME (alternate video #4)
  333. http://www.investinme.org/IIMER-Newslet-1802-02.shtml
  334. http://www.meassociation.org.uk/2018/02/government-funded-me-cfs-trial-one-of-greatest-medical-scandals-of-21st-century-20-february-2018/
  335. https://www.roydswithyking.com/pace-trial-scandal-me-cfs/
  336. https://www.meaction.net/2018/02/26/read-about-the-westminster-hall-debate-on-the-pace-trial-and-its-effects-on-people-with-me/
  337. https://www.parliament.uk/edm/2017-19/1247
  338. 338.0 338.1 338.2 Tuller, David; Racaniello, Vincent (July 10, 2016), "TWiV 397: Trial by Error", This Week In Virology (podcast) (video)
  339. http://www.virology.ws/2016/08/29/once-again-lancet-stumbles-on-pace/
  340. http://www.meaction.net/2016/05/14/racianello-pace-obfuscation-will-continue-until-we-are-all-dead/
  341. Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - complete transcript (PDF), Edinburgh
  342. Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - summarised transcript (PDF), Edinburgh
  343. 343.0 343.1 Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - transcript links, Edinburgh
  344. Coyne, James (November 16, 2015), A skeptical look at the PACE chronic fatigue trial - audio recording, Edinburgh
  345. Goudsmit, Ellen (December 13, 2014), Response to article in the magazine published by the UK charity MCS-Aware
  346. Goudsmit, Ellen (February 19, 2016), The PACE trial. Are graded activity and cognitive-behavioural therapy really effective treatments for ME? (PDF)
  347. Shepherd, Charles (January 18, 2016), "(correspondence) Patient reaction to the PACE trial", The Lancet Psychiatry
  348. Tuller, David (January 19, 2016), "Trial By Error, Continued: More Nonsense from The Lancet Psychiatry", Virology Blog
  349. 349.0 349.1 349.2 VanElzakker, Michael (2016), twitter comments
  350. https://inews.co.uk/essentials/news/health/scientists-furious-row-pace-trial-journal-special-edition/
  351. https://twitter.com/newhealthpsych/status/891931633980506113
  352. White, PD (May 22, 2003), "Trial Registry ISRCTN54285094", BioMed Central
  353. White, PD, "Trial Registry (Archive) ISRCTN54285094", BioMed Central
  354. PACE Trial Management Group (February 1, 2006), PACE Trial Protocol: Final Version 5.0 (PDF)
  355. Science Media Centre (February 17, 2011), Expert Opinion on ME/CFS Study
  356. http://www.nytimes.com/2011/02/18/health/research/18fatigue.html?ref=science
  357. http://www.foxnews.com/health/2011/02/18/pushing-limits-help-chronic-fatigue-patients.html
  358. https://web.archive.org/web/20110221183606/http://news.sky.com/skynews/Home/UK-News/Chronic-Fatigue-Syndrome-ME-Could-Be-Reversed-With-Counselling-And-Exercise-Research-Suggests/Article/201102315935405?lpos=UK_News_Second_Home_Page_Article_Teaser_Region_0&lid=ARTICLE_15935405_Chronic_Fatigue_Syndrome_ME_Could_Be_Reversed_With_Counselling_And_Exercise,_Research_Suggests
  359. http://www.meassociation.org.uk/2011/02/pace-study-results-–%C2%A0sky-news-today-18-february-2011/
  360. https://www.theguardian.com/society/2011/feb/18/study-exercise-therapy-me-treatment
  361. http://www.netdoctor.co.uk/healthy-eating/news/a20654/counselling-and-exercise-appear-best-for-me/
  362. http://www.express.co.uk/news/uk/229817/Trial-offers-hope-for-ME-sufferers
  363. http://www.independent.co.uk/life-style/health-and-families/health-news/got-me-just-get-out-and-exercise-say-scientists-2218377.html
  364. http://www.webmd.boots.com/news/20110217/me-cfs-pacing-yourself-isnt-the-answer
  365. http://www.mirror.co.uk/lifestyle/sex-relationships/could-new-techniques-ease-living-117621
  366. https://web.archive.org/web/20110223231102/http://www.itv.com/news/new-me-breakthrough57275/
  367. http://www.meassociation.org.uk/2011/01/physiotherapy-journal-urged-gentle-approach-to-prescribed-exercise-for-people-with-me-19-january-2011/
  368. http://www.huffingtonpost.com/jacob-teitelbaum-md/pace-study-may-as-well-sa_b_833621.html
  369. https://web.archive.org/web/20110221070520/http://www.cbc.ca/news/health/story/2011/02/18/chronic-fatigue-exercise-behaviour-therapy.html
  370. http://www.bbc.co.uk/news/health-12493009
  371. http://www.scotsman.com/news/me-sufferers-given-hope-as-scottish-team-leads-way-to-new-therapy-1-1501751
  372. http://www.scotsman.com/lifestyle/is-exercise-always-good-for-the-body-1-1589145
  373. http://www.meassociation.org.uk/2011/04/is-exercise-always-good-for-the-body-edinburgh-evening-news-15-april-2011/
  374. https://web.archive.org/web/20110221092107/http://www.cbc.ca/news/health/story/2011/02/18/chronic-fatigue-exercise-behaviour-therapy.html
  375. http://www.msnbc.msn.com/id/41651311/ns/health-health_care/#.UNHy5uTtRXM
  376. http://tinyurl.com/grdmf3b
  377. http://www.therapytoday.net/article/show/2317/
  378. http://www.primarycarereports.co.uk/uk.html/
  379. http://www.bbc.co.uk/news/health-19076398
  380. http://www.nursingtimes.net/nursing...fatigue-syndrome/5047819.article?referrer=RSS
  381. http://www.independent.co.uk/life-style/health-and-families/health-news/two-chronic-fatigue-syndrome-treatments-offer-good-value-8000997.html
  382. http://www.huffingtonpost.co.uk/2012/08/02/how-to-spot-symptoms-chronic-fatigue-syndrome_n_1732004.html
  383. http://www.nhs.uk/news/2012/08august/Pages/Pacing-for-chronic-fatigue-syndrome-not-cost-effective.aspx
  384. Racaniello, Vincent (December 22, 2015), "Revisiting the PLoS One economics analysis of PACE", Virology Blog
  385. Science Media Centre (January 31, 2013), "Expert reaction to new research into therapies for Chronic Fatigue Syndrome/ME", Science Media Centre
  386. Carter, Samuel (February 15, 2016), "(correspondence) Exploring changes to PACE trial outcome measures using anonymised data from the FINE trial", PubMed Commons
  387. Kemp, Peter (February 17, 2016), The PACE Trial: Making up Recovery to suit themselves
  388. ME Analysis (April 27, 2014), ME Recovery Song (video)
  389. Walwyn, R; Potts, L; McCrone, P; Johnson, AL; DeCesare, JC; Baber, HL; Goldsmith, KA; Sharpe, M; Chalder, T; White, PD (November 13, 2013), "A randomised trial of adaptive pacing therapy, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome (PACE): statistical analysis plan", Trials Journal, doi:10.1186/1745-6215-14-386
  390. http://www.bbc.co.uk/news/health-30795506
  391. http://www.economist.com/news/science-and-technology/21639438-controversial-trial-mysterious-disease-continues-yield-insights-fear
  392. http://www.dailymail.co.uk/health/article-2909029/Chronic-fatigue-victims-suffer-fear-exercise-anxious-activities-aggravate-condition.html
  393. http://www.independent.co.uk/life-style/health-and-families/health-news/sufferers-of-chronic-fatigue-syndrome-can-benefit-from-exercise-9976254.html
  394. http://www.bmj.com/content/350/bmj.h227
  395. https://www.sciencedaily.com/releases/2015/01/150113204351.htm
  396. http://www.nhs.uk/news/2015/01January/Pages/Therapy-and-exercise-may-help-some-with-CFS.aspx
  397. https://medicalxpress.com/news/2015-01-beliefs-key-symptoms-disability-chronic.html
  398. http://www.medicalnewstoday.com/articles/287972.php
  399. http://www.webmd.boots.com/news/20150114/cfs-no-need-to-fear-exercise
  400. Hyde, Byron (January 22, 2015), "Follow the money", TheOtherSideOfTheStretcher Blog
  401. Science Media Centre (October 28, 2015), "Expert reaction to long-term follow-up study from the PACE trial on rehabilitative treatments for CFS/ME, and accompanying comment piece", Science Media Centre
  402. http://www.bbc.co.uk/programmes/p036fnz0
  403. http://www.mediafire.com/file/94xezajptugoiy2/Prof+Michael+Sharpe+commenting+on+their+latest+PACE+trial+follow-up+study+-+BBC+Radio+4+-+281015.mp3
  404. https://uk.news.yahoo.com/positive-thinking-exercise-could-help-091553348.html#yax6KeT
  405. http://www.webmd.boots.com/news/20151028/study-long-term-benefits-of-cfs-me-treatment
  406. http://www.techtimes.com/articles/100484/20151028/chronic-fatigue-syndrome-is-not-chronic-illness-and-sufferers-who-exercise-think-positively-overcome-symptoms-study.htm
  407. ME Association (October 28, 2015), Press release: We challenge the PACE Trial follow-up report in today’s ‘Lancet Psychiatry’
  408. Goldsmith, KA; Chalder, T; White, PD; Sharpe, M; Pickles, AR (November 17, 2015), "Longitudinal mediation in the PACE randomised clinical trial of rehabilitative treatments for chronic fatigue syndrome: modelling and design considerations", Trials Journal / Paperity
  409. Sharpe, Michael; Chalder, Trudie; White, Peter D. (February 2015). "The planning, implementation and publication of a complex intervention trial for chronic fatigue syndrome: the PACE trial". BJPsych Bulletin. 39 (1): 24–27. doi:10.1192/pb.bp.113.045005. ISSN 2056-4694.
  410. Tuller, David (February 27, 2016), Interview with David Tuller, Amsterdam (video)
  411. Tuller, David (February 28, 2016), Speech by David Tuller, Amsterdam (video)