AI ALIGNMENT FORUM
AF

1036
Wikitags

Bayes' Theorem

Edited by bjr, Ben Pace, a_soulless_automaton, Vladimir_Nesov, et al. last updated 19th Feb 2024

Bayes' Theorem (also known as Bayes' Law) is a law of probability that describes the proper way to incorporate new evidence into prior probabilities to form an updated probability estimate. It is commonly regarded as the foundation of consistent rational reasoning under uncertainty. Bayes Theorem is named after Reverend Thomas Bayes who proved the theorem in 1763. 

Bayes' theorem commonly takes the form:

P(A|B)=P(B|A)P(A)P(B)

where A is the proposition of interest, B is the observed evidence, P(A) and P(B) are prior probabilities, and P(A|B) is the posterior probability of A.

With the posterior odds, the prior odds and the likelihood ratio written explicitly, the theorem reads:

P(A|B)P(¬A|B)=P(A)P(¬A)⋅P(B|A)P(B|¬A)

 

Visualisation of Bayes' Rule

Bayes.png
Subscribe
Discussion
4
Subscribe
Discussion
4
Posts tagged Bayes' Theorem
62Radical Probabilism
abramdemski
5y
39
10Bayesian Utility: Representing Preference by Probability Measures
Vladimir_Nesov
16y
0
30Bayesian Probability is for things that are Space-like Separated from You
Scott Garrabrant
7y
1
18Radical Probabilism [Transcript]
abramdemski, Ben Pace
5y
5
23Bayesian Evolving-to-Extinction
abramdemski
6y
13
15The role of Bayesian ML in AI safety - an overview
Marius Hobbhahn
3y
0
6Kelly bettors
DanielFilan
7y
0
59RL with KL penalties is better seen as Bayesian inference
Tomek Korbak, Ethan Perez
3y
9
39Introduction To The Infra-Bayesianism Sequence
Diffractor, Vanessa Kosoy
5y
50
Add Posts