AI ALIGNMENT FORUM
Tags
AF

Superposition

EditHistorySubscribe

Help improve this page

EditHistorySubscribe

Help improve this page

Contributors

You are viewing revision 1.0.0, last edited by duck_master

Posts about the concept of superposition - that is, neural nets representing concepts as a superposition of many neurons.

Posts tagged Superposition

5

69[Interim research report] Taking features out of superposition with sparse autoencoders

Lee Sharkey, Dan Braun, Beren Millidge

2y

14

1

91Toward A Mathematical Framework for Computation in Superposition

Dmitry Vaintrob, Jake Mendel, Kaarel Hänni

11mo

8

1

57Circuits in Superposition: Compressing many small neural networks into one

Lucius Bushnaq, Jake Mendel

2mo

0

2

33Superposition is not "just" neuron polysemanticity

7mo

1

1

22Some costs of superposition

Linda Linsefors

9mo

8

0

110Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

Zac Hatfield-Dodds

1y

12

0

110Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

Zac Hatfield-Dodds

1y

12

0

56Comparing Anthropic's Dictionary Learning to Ours

1y

1

1

39Open Source Sparse Autoencoders for all Residual Stream Layers of GPT2-Small

Joseph Isaac Bloom

10mo

12

0

33Growth and Form in a Toy Model of Superposition

Liam Carroll, Edmund Lau

1y

0

0

32Interpretability with Sparse Autoencoders (Colab exercises)

CallumMcDougall

1y

0

0

33Toy Models of Superposition

2y

2

0

31Paper: Superposition, Memorization, and Double Descent (Anthropic)

2y

11

0

31Paper: Superposition, Memorization, and Double Descent (Anthropic)

2y

11

0

21Some open-source dictionaries and dictionary learning infrastructure

1y

4