Bayes theorem—a statistical method worth knowing about!

August 28, 2020 at 5:22 p.m.

By -

While my knowledge of mathematics is limited I am intrigued by the subject and more so with statistics and its application. Of which I admit to know less. However, one statistical method of particular value is known as Baye’s rule or theorem.  It was derived to analyze evidence, change our minds as we get new information, and make rational decisions in the face of uncertainty. Today the rule is used to measure the likelihood of being correct when predicting one particular event. This ingenious and powerful mathematical formula was developed by an obscure eighteenth century minister in England, Thomas Bayes (1702-1761).  Unfortunately Bayes published no original mathematics during his life. His reason for not publishing  his essay can hardly have been fear of controversy. Perhaps he thought his discovery was useless; but if a pious clergyman like Bayes thought his work could prove the existence of God, surely he would have published it. Some thought Bayes was too modest. Others wondered whether he was unsure about his mathematics. Whatever the reason, Bayes made an important contribution to a significant problem—and suppressed it.  When he died, he bequeathed his papers to a friend, Richard Price. Price was an amateur mathematician, who developed Bayes’s ideas and probably deserves some of the glory.  After Price, however, Bayes’s theorem lapsed into obscurity until the illustrious French mathematician Pierre Simon Laplace extended and applied it in clever ways in the early 19th century.

Reverend Bayes set out his ideas in an essay entitled “Essay towards solving a problem in the doctrine of chances.”   It was published posthumously in 1763 and outlined a radically new way to approach and compute probabilities.  Bayes method, however, was largely ignored by statisticians. However, that is not the case today.  According to Sharon McGrayne in her book, The Theory That Would Not Die, Bayes’s theory affects all of us. “ It’s a logic for reasoning about the broad spectrum of life that lies in the gray areas between absolute truth and total uncertainty. We often have information about only a small part of what we wonder about. Yet we all want to predict something based on our past experiences; we change our beliefs as we acquire new information. After suffering years of passionate scorn, Bayes has provided a way of thinking rationally about the world around us.” 

Statisticians find Bayes’s theorem mathematically easy to use but conceptually powerful. It turns out to have incredibly deep consequences and is applicable to almost every fiend of inquiry, from finance and genetics to political science and historical studies.  Bayes is particularly of value today during the coronavirus crisis for use in diagnostic testing.  A new disease like Covid-19 brings a number of uncertainties and there is growing need to discover the basic reproduction number, the rate at which new cases arise, the infection fatality rate and the proportion of people with the virus that it kills.  Bayesian reasoning is a means to integrate what you previously thought with what you have learned and come to a conclusion that incorporates them both.  Today, Bayesian frameworks and methods, powered by computer support are at the heart of various models of epidemiology and other scientific fields.

One spectacular earlier success occurred during the Second World War, when Alan Turing developed Bayes to break Enigma, the German navy’s secret code, and in the process helped to both save Britain and invent modern electronic computers and software. The U.S. Navy used it to search for a missing H-bomb and to locate Soviet subs; RAND Corporation used it to assess the likelihood of a nuclear accident; and Harvard and Chicago researchers used it to verify the authorship of the Federalist Papers.

John Allen Paulos, a famous mathematician, sums up the theory as he says “ simply.”  You begin with a provisional hypothesis about the world and assign to it an initial probability called the prior probability.  After actively collecting or happening upon some potentially relevant evidence, you use Bayes’s theorem to recalculate the probability of the hypothesis in light of the new evidence.  This revised probability is called the posterior probabililty.  Specifically Bayes’s theorem states that the posterior probability of a hypothesis is equal to the product of (a) the prior probability of the hypothesis and (b) the conditional probability of the evidence given the hypothesis, divided by (c) the probability of the new evidence. Simple enough.

Final thoughts

In discovering its value for science, many supporters underwent a near-religious conversion yet had to conceal their use of Bayes’s rule and pretend they employed something else. It was not until the twenty-first century that the method lost its stigma and was widely and enthusiastically embraced.

Max Sherman is a medical writer and pharmacist retired from the medical device industry. He has taught college courses on regulatory and compliance issues at Ivy Tech, Grace College and Butler University. Sherman has an unquenchable thirst for knowledge on all levels.  Eclectic Science, the title of his column,  touches on famed doctors and scientists, human senses, aging,  various diseases, and little-known facts about many species, including their contributions to scientific research. His new book “Science Snippets” is available from Amazon and other book sellers. He can be reached by email at  [email protected]

While my knowledge of mathematics is limited I am intrigued by the subject and more so with statistics and its application. Of which I admit to know less. However, one statistical method of particular value is known as Baye’s rule or theorem.  It was derived to analyze evidence, change our minds as we get new information, and make rational decisions in the face of uncertainty. Today the rule is used to measure the likelihood of being correct when predicting one particular event. This ingenious and powerful mathematical formula was developed by an obscure eighteenth century minister in England, Thomas Bayes (1702-1761).  Unfortunately Bayes published no original mathematics during his life. His reason for not publishing  his essay can hardly have been fear of controversy. Perhaps he thought his discovery was useless; but if a pious clergyman like Bayes thought his work could prove the existence of God, surely he would have published it. Some thought Bayes was too modest. Others wondered whether he was unsure about his mathematics. Whatever the reason, Bayes made an important contribution to a significant problem—and suppressed it.  When he died, he bequeathed his papers to a friend, Richard Price. Price was an amateur mathematician, who developed Bayes’s ideas and probably deserves some of the glory.  After Price, however, Bayes’s theorem lapsed into obscurity until the illustrious French mathematician Pierre Simon Laplace extended and applied it in clever ways in the early 19th century.

Reverend Bayes set out his ideas in an essay entitled “Essay towards solving a problem in the doctrine of chances.”   It was published posthumously in 1763 and outlined a radically new way to approach and compute probabilities.  Bayes method, however, was largely ignored by statisticians. However, that is not the case today.  According to Sharon McGrayne in her book, The Theory That Would Not Die, Bayes’s theory affects all of us. “ It’s a logic for reasoning about the broad spectrum of life that lies in the gray areas between absolute truth and total uncertainty. We often have information about only a small part of what we wonder about. Yet we all want to predict something based on our past experiences; we change our beliefs as we acquire new information. After suffering years of passionate scorn, Bayes has provided a way of thinking rationally about the world around us.” 

Statisticians find Bayes’s theorem mathematically easy to use but conceptually powerful. It turns out to have incredibly deep consequences and is applicable to almost every fiend of inquiry, from finance and genetics to political science and historical studies.  Bayes is particularly of value today during the coronavirus crisis for use in diagnostic testing.  A new disease like Covid-19 brings a number of uncertainties and there is growing need to discover the basic reproduction number, the rate at which new cases arise, the infection fatality rate and the proportion of people with the virus that it kills.  Bayesian reasoning is a means to integrate what you previously thought with what you have learned and come to a conclusion that incorporates them both.  Today, Bayesian frameworks and methods, powered by computer support are at the heart of various models of epidemiology and other scientific fields.

One spectacular earlier success occurred during the Second World War, when Alan Turing developed Bayes to break Enigma, the German navy’s secret code, and in the process helped to both save Britain and invent modern electronic computers and software. The U.S. Navy used it to search for a missing H-bomb and to locate Soviet subs; RAND Corporation used it to assess the likelihood of a nuclear accident; and Harvard and Chicago researchers used it to verify the authorship of the Federalist Papers.

John Allen Paulos, a famous mathematician, sums up the theory as he says “ simply.”  You begin with a provisional hypothesis about the world and assign to it an initial probability called the prior probability.  After actively collecting or happening upon some potentially relevant evidence, you use Bayes’s theorem to recalculate the probability of the hypothesis in light of the new evidence.  This revised probability is called the posterior probabililty.  Specifically Bayes’s theorem states that the posterior probability of a hypothesis is equal to the product of (a) the prior probability of the hypothesis and (b) the conditional probability of the evidence given the hypothesis, divided by (c) the probability of the new evidence. Simple enough.

Final thoughts

In discovering its value for science, many supporters underwent a near-religious conversion yet had to conceal their use of Bayes’s rule and pretend they employed something else. It was not until the twenty-first century that the method lost its stigma and was widely and enthusiastically embraced.

Max Sherman is a medical writer and pharmacist retired from the medical device industry. He has taught college courses on regulatory and compliance issues at Ivy Tech, Grace College and Butler University. Sherman has an unquenchable thirst for knowledge on all levels.  Eclectic Science, the title of his column,  touches on famed doctors and scientists, human senses, aging,  various diseases, and little-known facts about many species, including their contributions to scientific research. His new book “Science Snippets” is available from Amazon and other book sellers. He can be reached by email at  [email protected]

Have a news tip? Email [email protected] or Call/Text 360-922-3092

e-Edition


e-edition

Sign up


for our email newsletters

Weekly Top Stories

Sign up to get our top stories delivered to your inbox every Sunday

Daily Updates & Breaking News Alerts

Sign up to get our daily updates and breaking news alerts delivered to your inbox daily

Latest Stories


2-Vehicle Crash On CR 400E
Emergency personnel investigate the scene of Friday morning's two-vehicle accident on CR 400E, north of CR 100N.

G & G The Only Bidder On 3 Warsaw Projects
If it wasn’t for G & G Hauling & Excavating, the city of Warsaw wouldn’t have had any bidders on the three projects opened Friday at the Board of Public Works and Safety meeting.

Board Of Works Approves Pier, Parking & Art Contracts
To move forward on the bid process for the demolition of the Center Lake pier, the Warsaw Board of Public Works and Safety on Friday approved a supplemental agreement between the city and A & Z Engineering for the Center Lake Recreational Trail project.

Turkey Trot Set For Downtown Warsaw On Black Friday
If your family is going to need to work off all the food and drink they consumed on Thanksgiving, there’s going to be a run downtown Warsaw on Black Friday.

Less Than Two Weeks Until Halloween, But Events Start Sooner
Trick-or-treat hours and Halloween events have be set in several towns in the area.