If the preservation of an agent's boundary is necessary for that agent's safety, how can that boundary/membrane be protected?

How agent boundaries get violated

In order to protect boundaries, we must first understand how they get violated.

Let’s say there’s a cat, and it gets stabbed by a sword. That’s a boundary violation (a.k.a. membrane piercing). In order for that to have happened, three conditions must have been met:

There was a sword.
The cat and the sword collided.
The cat wasn’t strong enough to resist penetration from the sword.

More generally, in order for any existing membrane to be pierced, three conditions must have all been met:

There was a potential threat. (E.g., a sword, or a person with a sword.)
The moral patient and the threat collided.
The victim failed to adequately defend itself. (Because if the cat was better at self-defense — if its skin was thicker or if it was able to dodge — then it would not have been successfully stabbed.)

Protecting agent boundaries

Each of these three conditions then implies ways of preventing boundary violations (a.k.a. membrane piercing):

1. There was a potential threat.

→ Minimize potential threats

2. There was a collision.

→ Minimize dangerous collisions
- → Predict and prevent collisions before they occur.
- → Prevent collisions by putting distance between threats and moral patients.
- → Prevent premeditated collisions by pre-committing to retribution.

3. The victim failed to defend itself.

→ Empower the membranes of humans and other moral patients to be better at self-defense.

How human societies already try to solve this problem

As a helpful analogy, here’s some examples of how modern human societies try to solve this problem:

Minimize potential threats

Restrict access to weapons (e.g., nukes, bioweapons, etc.)
Minimize potential perpetrators (i.e., e.g., some fictional societies predict and eliminate potential psychopaths).

Minimize dangerous collisions

Protect high-risk individuals, e.g. put them witness protection
Prevent collisions before they occur, e.g. predictive policing, traffic lights.
Police crimes after they occur.

Empower membranes to be better at self-defense

Infosec defense: Use good security practices and strong encryption.
Biological defense: Develop and use beneficial vaccines.
Manipulation defense: Reduce unhelpful cognitive biases and emotional insecurities.

How this applies to AI safety:

Minimize poten...