AI ALIGNMENT FORUMTags
AF

Quantilization

EditHistorySubscribe
Discussion (0)
Help improve this page
EditHistorySubscribe
Discussion (0)
Help improve this page
Quantilization
See also
Random Tag
Contributors
4plex

A Quantilizer is a proposed AI design which aims to reduce the harms from Goodhart's law and specification gaming by selecting reasonably effective actions from a distribution of human-like actions, rather than maximizing over actions. It it more of a theoretical tool for exploring ways around these problems than a practical buildable design.

See also

  • Rob Miles's Quantilizers: AI That Doesn't Try Too Hard
  • Arbital page on Quantilizers
Posts tagged Quantilization
Most Relevant
2
38Soft optimization makes the value target bigger
Jeremy Gillen
3mo
1
4
13Quantilizers maximize expected utility subject to a conservative cost constraint
Jessica Taylor
7y
0
4
9Another view of quantilizers: avoiding Goodhart's Law
Jessica Taylor
7y
0
3
27When to use quantilization
Ryan Carey
4y
0
2
14Quantilizers and Generative Models
Adam Jermyn
8mo
4
1
5Quantilizer ≡ Optimizer with a Bounded Amount of Output
itaibn0
1y
0
1
20Recursive Quantilizers II
Abram Demski
2y
15
1
8Stable Pointers to Value III: Recursive Quantilization
Abram Demski
5y
0
Add Posts