AI ALIGNMENT FORUM
AF

Wikitags

Bayes' Theorem

Edited by bjr, Ben Pace, a_soulless_automaton, Vladimir Nesov, et al. last updated 19th Feb 2024

Bayes' Theorem (also known as Bayes' Law) is a law of probability that describes the proper way to incorporate new evidence into prior probabilities to form an updated probability estimate. It is commonly regarded as the foundation of consistent rational reasoning under uncertainty. Bayes Theorem is named after Reverend Thomas Bayes who proved the theorem in 1763. 

Bayes' theorem commonly takes the form:

P(A|B)=P(B|A)P(A)P(B)

where A is the proposition of interest, B is the observed evidence, P(A) and P(B) are prior probabilities, and P(A|B) is the posterior probability of A.

With the posterior odds, the prior odds and the likelihood ratio written explicitly, the theorem reads:

P(A|B)P(¬A|B)=P(A)P(¬A)⋅P(B|A)P(B|¬A)

 

Visualisation of Bayes' Rule

Bayes.png
Subscribe
4
Subscribe
4
Discussion0
Discussion0
Posts tagged Bayes' Theorem
62Radical Probabilism
Abram Demski
5y
39
10Bayesian Utility: Representing Preference by Probability Measures
Vladimir Nesov
16y
0
30Bayesian Probability is for things that are Space-like Separated from You
Scott Garrabrant
7y
1
18Radical Probabilism [Transcript]
Abram Demski, Ben Pace
5y
5
21Bayesian Evolving-to-Extinction
Abram Demski
5y
13
15The role of Bayesian ML in AI safety - an overview
Marius Hobbhahn
2y
0
6Kelly bettors
DanielFilan
7y
0
59RL with KL penalties is better seen as Bayesian inference
Tomek Korbak, Ethan Perez
3y
9
39Introduction To The Infra-Bayesianism Sequence
Diffractor, Vanessa Kosoy
5y
50
Add Posts