Bayesian reasoning

From MEpedia, a crowd-sourced encyclopedia of ME and CFS science and history

Bayesian reasoning, also called Bayesian inference or probabilistic reasoning, is a means of assessing probability in order to incorporate new information with the most accuracy. It encourages assessing confidence in a hypothesis as a matter of degree that may be adjusted depending on the reliability of new information that tends either to confirm or refute the hypothesis.[1]

Bayes Theorum[edit | edit source]

Bayesian reasoning is derived from Bayes Theorum.[1]

Use in medicine[edit | edit source]

Bayesian reasoning comes up in medicine and scientific research with regard to the correct interpretation of test results, particularly in accurately accounting for the possibility of a false positive or false negative. Clinicians and patients alike frequently show difficulty accurately incorporating those possibilities to predict how reliable a given test result is.

To illustrate the difference Bayesian reasoning can make in a health care setting, artificial intelligence researcher Eliezer S. Yudkowsky offers the following hypothetical. Imagine if it were the case that:

"1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies. A woman in this age group had a positive mammography in a routine screening.  What is the probability that she actually has breast cancer?"[2]

Yudkowsky cites studies in the 1970s through the 1990s in which only 15% doctors got the type of question right.[2] Most estimated that the woman had a 70 or 80% chance of having breast cancer in light of the positive mammogram.[2] In fact, the odds the hypothetical woman has breast cancer is 7.8%. This is because of the large number of false positives: since 99% of women in the age group do not have breast cancer and of them, 9.6% still test positive (a false negative), testing a group of 10,000 women would produce 950 false positives. Meanwhile, only 100 women (1% of the 10,000 women in the data sample) would have breast cancer, and the mammogram would detect it 80% of the time, producing 80 true positives. Thus only 80 of 1030 positive mammograms, or 7.8%, actually reflected the presence of cancer in this hypothetical.[2]

This example emphasizes the necessity of exercising caution when revising a belief based on new information. Prior to the mammogram, a woman in this hypothetical would have expected to have a 1% chance of having breast cancer. The positive mammogram result changes the prediction, but by far less than one might estimate. Bayesian reason encourages careful attention to how much new evidence should weigh on the revision of a hypothesis.

Criticism[edit | edit source]

As Bayesian reasoning gained popularity, some critics have pointed out that it is only as useful as the evidence incorporated. They warn that Bayesian reasoning could offer legitimacy to dangerously false conclusions if based on poor evidence.[3][4]

Learn more[edit | edit source]

References[edit | edit source]

  1. 1.0 1.1 Dvorsky, George. "How Bayes' Rule Can Make You A Better Thinker". io9. Retrieved February 26, 2019.
  2. 2.0 2.1 2.2 2.3 "Yudkowsky - Bayes' Theorem". yudkowsky.net. Retrieved February 26, 2019.
  3. Horgan, John. "Bayes's Theorem: What's the Big Deal?". Scientific American Blog Network. Retrieved February 26, 2019.
  4. Flam, F.D. (September 29, 2014). "The Odds, Continually Updated". The New York Times. ISSN 0362-4331. Retrieved February 26, 2019.