AI ALIGNMENT FORUM
AF

359
Sergei Smirnov
020
Message
Dialogue
Subscribe

Research Engineer, PhD Student | Technical AI Safety | https://www.linkedin.com/in/seriozh1/ 

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No posts to display.
No wikitag contributions to display.
Towards a scale-free theory of intelligent agency
Sergei Smirnov5mo01

Rational subagents will never bid more than the reward they actually expect.

One might bid higher to mislead others and benefit more in the long run.

Reply
Towards a scale-free theory of intelligent agency
Sergei Smirnov6mo00

I think that what active inference is missing is the ability to model strategic interactions between different goals


The strategic‑interaction gap you highlight echoes David Kirsh’s pragmatic‑vs‑epistemic distinction (I’m collaborating with him): current scale‑free frameworks capture pragmatic, world‑altering moves, yet overlook epistemic actions—internal simulations and information‑seeking that update the agent’s belief state without changing the environment—exactly where those goal negotiations seem to unfold.

Reply