Tor Økland Barstad

Here is a simplistic diagram of an argument-network. Real-world examples would typically be larger, more interconnected, and not shaped like trees. Here are some of the concepts that will be touched upon in this post: * Argument networks: Imagine rigorous and extensive argumentation being organized into a network, where each...

Summary / Preamble AI Alignment has various sub-areas. The area I focus on here is ways we might use a superintelligent AGI-system to help with creating an aligned AGI-system, even if the AGI we start out with isn’t fully aligned. Imagine a superintelligence that “pretends” to be aligned. Such an...

Summary / Preamble In AGI Ruin: A List of Lethalities, Eliezer writes “A cognitive system with sufficiently high cognitive powers, given any medium-bandwidth channel of causal influence, will not find it difficult to bootstrap to overpowering capabilities independent of human infrastructure.” I have larger error-bars than Eliezer on some AI-safety-related...