Introduction Singular learning theory (SLT) is a theory of learning dynamics in Bayesian statistical models. It has been argued that SLT could provide insights into the training dynamics of deep neural networks. However, a theory of deep learning inspired by SLT is still lacking. In particular it seems important to...
Overview * Solving the problem of mesa-optimization would probably be easier if we understood how models do search internally * We are training GPT-type models on the toy task of solving mazes and studying them in both a mechanistic interpretability and behavioral context. * This post lays out our model...
Epistemic status: MSFP blog post day. General and very speculative ideas. Proposition : Deconfusing metaethics might be a promising way to increase our chances of solving AI alignment. What do I mean by metaethics? Metaethics here is understood as an ideal procedure that humans are approximating when they reason about...