AI ALIGNMENT FORUM
AF

LessWrong Jargon

v1.89.0Jan 21st 2023 GMT (+14/-10)
v1.88.0Jan 21st 2023 GMT (+39)
v1.87.0Oct 5th 2020 GMT (+31/-17)
v1.86.0Oct 3rd 2020 GMT (+253/-233) I added letters in order to make the terms easier to find
v1.85.0Sep 18th 2020 GMT (-41)
v1.84.0Sep 18th 2020 GMT (+796/-568)
v1.83.0Apr 8th 2018 GMT (-1)
v1.82.0Jun 11th 2017 GMT (+338) Black swan
v1.81.0Apr 14th 2017 GMT (-2)
v1.80.0Apr 14th 2017 GMT (+65)
Load More (10/90)
jimrandomh v1.89.0Jan 21st 2023 GMT (+14/-10) LW2
Program Den v1.88.0Jan 21st 2023 GMT (+39) LW1
Ruby v1.87.0Oct 5th 2020 GMT (+31/-17) LW2
WrongPlanet v1.86.0Oct 3rd 2020 GMT (+253/-233) I added letters in order to make the terms easier to find LW1
brook v1.85.0Sep 18th 2020 GMT (-41) LW1
brook v1.84.0Sep 18th 2020 GMT (+796/-568) LW1
Deku-shrub v1.83.0Apr 8th 2018 GMT (-1) LW1
alti v1.82.0Jun 11th 2017 GMT (+338) Black swan LW1
Deku-shrub v1.81.0Apr 14th 2017 GMT (-2) LW1
Deku-shrub v1.80.0Apr 14th 2017 GMT (+65) LW1
Load More (10/90)
Program Den
Ruby
WrongPlanet
brook
brook
Deku-shrub
Deku-shrub
Deku-shrub
alti
jimrandomh
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)
Discuss this wiki(0)

TAI: Threats ofTransformative Artificial Intelligence

TAI: Threats of Artificial Intelligence

See Belief update.

See also: Category:Jargon, Acronym Finder

  • :Category:Jargon
  • , Acronym Finder

ADBOC

ADBOC:Agree Denotationally, But Object Connotatively

Connotatively. Discussion in When Truth Isn'Isn't Enough

AFAICT

AFAICT: As Far As I Can Tell

Affect

Affect: Mood or emotion as demonstrated in external physical signs.

: When positive attributions combine with the halo effect in a positive feedback loop.

AGI

AGI: Artificial general intelligence

: Bad rules for thinking itself, capable of protecting false beliefs.

Bayesian:

1.

  • A theory of probability based on updating subjective estimates in the light of new evidence; contrastedevidence. Contrasted with the more objective frequentist approach.

    2. approach, which views probability as being the mean of an infinite series of the same experiment.

  • Probablistic reasoning in general.

    3.

  • Good, well done reasoning in general.

: A fictional secret society of Bayesians.

: What you do to your beliefs, opinions and cognitive structure when new evidence comes along.

Black swan

swan: In the usage of Nassim Nicholas Taleb, a black swan is a rare event whose magnitude is so high as to impact the average of a series, aseries. These are characteristic of 'fat-tailed' distributions, as opposed to the thin-tailed distributions such as the normal distributionindistribution, in which rare events are vanishinglytoo unlikely to have such a large impact.

:Roman Empire chariot-racing teams that became part of politics. Used in place of real party names. See Mind-killer.killer.

: Coherent Extrapolated Volition

, "In poetic terms, our coherent extrapolated volition is our wish if we knew more, thought faster, were more the people we wished we were, had grown up farther together; where the extrapolation converges rather than diverges, where our wishes cohere rather than interfere; extrapolated as we wish that extrapolated, interpreted as we wish that interpreted."

Clever arguer

arguer:Someone skilled at writing convincing-sounding arguments for an existing belief. Inventing clever arguments for a belief does not change the truth value of the belief.

: A moral theory that places value on the consequences of actions. Covered in more depth here.

: What to have when you may have been quite wrong for a long time.

:Rhetorical techniques crafted to exploit human cognitive biases. Considered bad behaviour even if the belief you want to communicate is good.

Deontology/ deontological ethics

Deontological ethics (from Greek deon, "obligation, duty"; and -logia) is anethics: An approach to ethics that judges the morality of an action based on the action'action's adherence to a rule or rules. See Wikipedia article on deontological ethics for more. Contrast consequentialism.

EEA

EEA: Environment of Evolutionary Adaptedness

Adaptedness. An Evolutionary psychology term synonymous with the more commonly-used "ancestral environment". For humans, refers to the state of tribal bands of hunter-gatherers.

Egan'Egan's law

: "It all adds up to normality." Surprising truths do not make the sky orange and grey; it stays blue.

: Edited To Add (though some would rather you say "Edit:" instead)

: Eliezer Yudkowsky

FAI

FAI: Friendly AI

: Onomatopoetic vernacular for an intelligence explosion.

: An argument which can be used...

Read More (863 more words)

Rationalism
;

The mode of thinking within the rationalist movement

Rationalism
; The mode of thinking within the
rationalist movement
Rationalist taboo

Black swan

In the usage of Nassim Nicholas Taleb, a black swan is a rare event whose magnitude is so high as to impact the average of a series, a characteristic of fat-tailed distributions, as opposed to the thin-tailed distributions such as the normal distributionin which rare events are vanishingly unlikely to have such a large impact.


A

ADBOC: Agree Denotationally, But Object Connotatively. Discussion in When Truth Isn'Isn't Enough

B

Black swan: In the usage of Nassim Nicholas Taleb, a black swan is a rare event whose magnitude is so high as to impact the average of a series. These are characteristic of 'fat-tailed''fat-tailed' distributions, as opposed to thin-tailed distributions such as the normal distribution, in which rare events are too unlikely to have a large impact.

C

D

Deontology/ deontological ethics: An approach to ethics that judges the morality of an action based on the action'action's adherence to a rule or rules. See Wikipedia article on deontological ethics for more. Contrast consequentialism.

E

Egan'Egan's law: "It all adds up to normality." Surprising truths do not make the sky orange and grey; it stays blue.

F

Fuzzies: The desired but less useful counterpart to utils. They make you feel you'you're altruistic and socially contributing.

H

I

I don'don't know: Something that can'can't be entirely true if you can even formulate a question.

Inferential distance: The number of inferences, or intermediate steps, it takes someone to get from their existing knowledge to an understanding of the point you'you're making. See also illusion of transparency.

K

L

M

MWI: Many-Worlds Interpretation, an interpretation of quantum mechanics advocated in Eliezer Yudkowsky'Yudkowsky's quantum mechanics sequence

N

O

One-box: One of the choices for Newcomb'Newcomb's problem.

Omega: A hypothetical superintelligent being, canonically found in Newcomb'Newcomb's problem.

P

Password: The answer you guess instead of actually understanding the problem. See Guessing the teacher'teacher's password

PD: Prisoner'Prisoner's dilemma

Privileging the hypothesis: The fallacy of singling out a specific hypothesis for investigation when there isn'isn't enough evidence at hand to select this hypothesis over others. e.g."We have no idea who committed the murder, so let'let's consider the possibility that Mortimer Q. Snodgrass did it, and investigate him."

Q

R

Reversed stupidity is not intelligence: "The world'world's greatest fool may say the Sun is shining, but that doesn'doesn't make it dark out."

Reality is normal: See also: Egan'Egan's Law
Semantic stopsign: A term that looks like an explanation but, on closer examination, doesn'doesn't actually explain anything. Also called curiosity stopper.

S

Solomonoff induction: A formalized version of Occam'Occam's razor based on Kolmogorov complexity.

Steel man: A term for the opposite of a Straw Man: the strongest possible form of an opponent'opponent's argument, even if they didn'didn't make it themself.

T

tl;dr : Too long; didn'didn't read. Polite use: one-line summary at top of your long article. Impolite use: dismissive response to another'another's long piece of writing or unparagraphed slab of text.

Two-box: One of the choices for Newcomb'Newcomb's problem.

U

W

Y

This is a short list of common terms and phrasesphrases, i.e., jargon used on LessWrong.LessWrong.