AI ALIGNMENT FORUM
AF

Max Ra

Message

Max Ra

Message

Max Ra

Max Ra — AI Alignment Forum

[Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now?

Max Ra4y00

Thanks for the elaboration, looking forward to the next posts. :)

[Intro to brain-like-AGI safety] 1. What's the problem & Why work on it now?

Max Ra4y00

For another thing, out-of-control AGIs will have asymmetric advantages over good AGIs—like the ability to steal resources, to manipulate people and institutions via lying and disinformation; to cause wars, pandemics, blackouts, gray goo, and so on; and to not have to deal with coordination challenges across different (human) actors with different beliefs and goals. More on this topic here.

Is your claim that out-of-control AGIs will all-things-considered have an advantage? Because I expect the human environment to be very hostile towards AGIs that are... (read more)

Responses to Christiano on takeoff speeds?

Answer by Max RaNov 16, 202110

Thanks for asking, I just read the post and was also interested in other people's thoughts.

My thoughts while reading:

Is the emergence of humans really a good example for a significantly discontinuous jump? I spontaneously imagined that the first humans weren't actually performing much better than other apes, and that it took a lot of time of cultural development before humans started clearly dominating via using their increased strategizing/planning/coordinating capabilities.
Paul seemed unconvinced of the potential for major insights (or a "secret sauce")

... (read more)