Outcome switching
Outcome switching or outcome swapping is when authors of a clinical trial "move the goal posts" during a trial, which may be done to achieve the desired results or may accidentally affect the trial's findings.[citation needed] For example, changing the primary outcome that is used to decide if a treatment is successful from the distance walked in 6 minutes to the percentage of patients who rated their symptoms as "better" or "much better" on a patient questionnaire.
The PACE trial authors, in a clinical trial of ME/CFS patients undergoing GET/CBT, employed this tactic.
Pre-specified outcomes[edit | edit source]
When a clinical trial has a protocol published in advance, it will typically include pre-specified primary outcomes, these are the main measures used to determine if an intervention or drug is effective. Secondary outcomes are considered to be less important. For example, change in average pain level measured with a questionnaire, biological test results or physical measurements of ability.[citation needed]
Outcome swapping is the process of changing these primary outcomes during the trial or prior to publication.[citation needed] For example, a secondary outcome may be changed with a primary outcome, which may give then change the results reported in the trial publication.
In the PACE trial, outcome swapping led to results showing that both CBT and GET were moderately effective, but when a secondary analysis used the original pre-specified outcomes this showed the interventions were less effective than the previously published results.[citation needed]
Articles on Outcome switching in clinical trials[edit | edit source]
- How Outcome Switching is Corrupting Medical Research[1] - Psychology Today
- For my next trick...[2] - The Economist
- Is Outcome Switching Still A Problem In Clinical Trials?[3] - clinicalleader.com
- How researchers dupe the public with a sneaky practice called "outcome switching"[4] - Vox
Tracking outcome switching
PACE trial[edit | edit source]
- In 2016, Julie Rehmeyer gave the talk Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE Trial Slideshow given at the 2016 Joint Statistics Meetings[6] (Notes may be be viewed by clicking the “Notes” icon just above the comments section in the slideshow link.)
- David Tuller spoke about and answered questions on the PACE trial and its flaws.
- Feb 28, 2016, David Tuller gave a speech with Q&As.[7]
- Feb 27, 2016, An Interview with David Tuller, held at The Forgotten Plague Conference, discussing the flaws of the Pace trial.[8]
- PACE trial - Release of Data
- Geraghty (2017) discussed outcome switching and other PACE trial flaws.[9]
SMILE trial[edit | edit source]
In the SMILE trial, school attendance was swapped from a primary outcome to a secondary outcome during the trial, with all primary outcomes then based only on questionnaire results, despite the unblinded treatment which encouraged children to believe they would recover and no longer see themselves as ill.[10] The Archives of Disease in Childhood held an investigation but failed to retract the study, instead publishing an extensive editor's note.[10]
Learn more[edit | edit source]
See also[edit | edit source]
- Alem Matthees won a Freedom of Information Act tribunal for the release of the PACE trial data.
References[edit | edit source]
- ↑ Lane, Christopher (April 30, 2016). "How Outcome Switching is Corrupting Medical Research". Psychology Today. Retrieved August 11, 2018.
- ↑ "For my next trick..." The Economist. March 26, 2016. Retrieved August 11, 2018.
- ↑ Miseta, Ed (March 7, 2016). "Is Outcome Switching Still A Problem In Clinical Trials". clinicalleader.com. Retrieved August 11, 2018.
- ↑ Belluz, Julia (December 29, 2015). "How researchers dupe the public with a sneaky practice called "outcome switching"". Vox. Retrieved August 11, 2018.
- ↑ "Tracking switched outcomes in clinical trials". COMPare. Retrieved August 11, 2018.
- ↑ Rehmeyer, Julie (August 1, 2016). "Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE trial". slideshare.net. Retrieved August 11, 2018 – via SlideShare.
- ↑ Tuller, David (March 28, 2016). "Lezing dr David Tuller met Nederlandse ondertiteling". YouTube. ME/cvs Vereniging.
- ↑ Tuller, David (March 4, 2016). "Interview with David Tuller (Amsterdam, 27th February 2016)". YouTube. Frank Twisk.
- ↑ Geraghty, Keith (May 2017). "Further Commentary on the PACE Trial: Biased Methods and Unreliable Outcomes". Journal of Health Psychology. 22 (9): 1209-1216. doi:10.1177/1359105317714486.
- ↑ 10.0 10.1 Brown, Nick (July 2019). "Editor's Note on Correction to Crawley et al 2018". Archives of Disease in Childhood.
