Log Odds

Log odds are an alternate way of expressing probabilities, which simplifies the process of updating them with new evidence. Unfortunately, it is difficult to convert between probability and log odds. The log odds is the log of the odds. Thus, the log odds of A are

$logit\left(P\right(A\left)\right)=log\left(P\right(A\left)/P\right(\neg A\left)\right)$.

Updating Log odds

$P\left(A|B\right)=P\left(B|A\right)\frac{P\left(A\right)}{P\left(B\right)}$

$P\left(\neg A|B\right)=P\left(B|\neg A\right)\frac{P\left(\neg A\right)}{P\left(B\right)}$

$\frac{P\left(A|B\right)}{P\left(\neg A|B\right)}=\frac{P\left(B|A\right)}{P\left(B|\neg A\right)}\frac{P\left(A\right)}{P\left(\neg A\right)}$

$\log \left(\frac{P\left(A|B\right)}{P\left(\neg A|B\right)}\right)=\log \left(\frac{P\left(B|A\right)}{P\left(B|\neg A\right)}\right)+\log \left(\frac{P\left(A\right)}{P\left(\neg A\right)}\right)$

$logit\left(P\right(A|B\left)\right)=\log \left(\frac{P\left(B|A\right)}{P\left(B|\neg A\right)}\right)+logit\left(P\right(A\left)\right)$

Thus, in order to find the posterior log odds $logit\left(P\right(A|B\left)\right)$, one simply adds the prior log odds $logit\left(P\right(A\left)\right)$ by the log of the likelihood ratio $\log \left(\frac{P\left(B|A\right)}{P\left(B|\neg A\right)}\right)$.

The base of the logarithm determines what units the log odds are measured in, and doesn't matter so long as it's consistent. The natural log is usually used.

Examples

Suppose you have a box that has a 5% chance of containing a diamond. You also have a diamond detector that beeps half of the time if there is a diamond, and one fourth of the time if there is not. You wave the diamond detector over the box and it beeps.

The prior log odds of the box containing a diamond are ln(1/19) = -2.94. The log of the likelihood ratio of a beep is ln((1/2)/(1/4)) = ln(2) = 0.69. The posterior log odds are -2.94 + 0.69 = -2.23. This corresponds to an odds ratio of e^-2.23 = 0.108:1, and thus a probability of 0.108/1.108 = 0.097 = 9.7%. The correct answer is actually 9.5%. There was error due to rounding.

See also

• Odds ratio
• Likelihood ratio