You might be interested in some of my open drafts about optimization;
One distinction that I pretty strongly hold as carving nature at its joint is (what I call) optimization vs agents. Optimization has no concept of a utility function, and it just about the state going up an ordering. Agents are the thing that has a utility function, which they need for picking actions with probabilistic outcomes.
I feel very on-board with this research aesthetic.
Here are just some nit-picks/notational confusions I had while reading this;
The sequence p,step(p),step(step(p)),…, i.e., n↦stepn(p), is the computation seeded at p (or a “trajectory” in dynamical systems terminology)....A property P is achieved by a computation s if there exists some number of steps n such that s(n)∈P...
It took me a second to figure out what s(n) referred to, partly because the first s was not rendered in LaTeX, partly because it was n... (read more)
I would especially especially love it if it popped out a .tex file that I could edit, since I'm very likely to be using different language on LW than I would in a fancy academic paper.