AI ALIGNMENT FORUM
Petrov Day
AF

108
Magdalena Wache
Ω81212
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
There should be more AI safety orgs
Magdalena Wache2y44

Thanks for writing this! I agree.

I used to think that starting new AI safety orgs is not useful because scaling up existing orgs is better:

  • they already have all the management and operations structure set up, so there is less overhead than starting a new org
  • working together with more people allows for more collaboration

And yet, existing org do not just hire more people. After talking to a few people from AIS orgs, I think the main reason is that scaling is a lot harder than I would intuitively think.

  • larger orgs are harder to manage, and scaling up does not necessarily mean that much less operational overhead.
  • coordinating with many people is harder than with few people. Bigger orgs take longer to change direction.
  • reputational correlation between the different projects/teams

We also see the effects of coordination costs/"scaling being hard" in industry, where there is a pressure towards people working longer hours. (It's not common that companies encourage employees to work part-time and just hire more people.)

Reply
56The Local Interaction Basis: Identifying Computationally-Relevant and Sparsely Interacting Features in Neural Networks
1y
1
26Interpretability Externalities Case Study - Hungry Hungry Hippos
2y
11
56Finite Factored Sets in Pictures
3y
2
AI Safety Mentors and Mentees Program
2 years ago
(+198)
Causal Scrubbing
2 years ago
(+98)