AI ALIGNMENT FORUM
AF

Wikitags

Superstimuli

Edited by brook, Multicore, Ruben Bloom, et al. last updated 8th Feb 2022

Humans evolved various desires that promoted survival and reproductive success in the ancestral environment. Superstimuli are modern inventions that satisfy desires better than anything in the ancestral environment could but are detrimental to survival, reproduction, or other high-level goals.

See also:, ,

A candy bar is a superstimulus: it contains more concentrated sugar, salt, and fat than anything that exists in the ancestral environment.   A candy bar matches taste buds that evolved in a hunter-gatherer environment, but it matches those taste buds much more strongly than anything that actually existed in the hunter-gatherer environment. The signal that once reliably correlated to healthy food has been hijacked, blotted out with a point in tastespace that wasn't in the training dataset - an impossibly distant outlier on the old ancestral graphs. 

-- Eliezer Yudkowsky, Superstimuli and the Collapse of Western Civilisation

Notable Posts

  • Superstimuli and the Collapse of Western Civilization
  • Adaptation-Executers, not Fitness-Maximizers

External Links

  • Cute, Sexy, Sweet, Funny by Daniel Dennett at TED

See Also

  • Adaptation executers
Subscribe
1
Subscribe
1
Evolutionary Psychology
Evolutionary psychology
Wireheading
Akrasia
Goodhart's Law
Discussion0
Discussion0
Posts tagged Superstimuli
34Two Neglected Problems in Human-AI Safety
Wei Dai
7y
21
Add Posts