AI ALIGNMENT FORUMTags
AF

Transformers

EditHistorySubscribe

Help improve this page

EditHistorySubscribe

Help improve this page

Contributors

Posts tagged Transformers

1

49How LLMs are and are not myopic

2mo

5

2

31Residual stream norms grow exponentially over the forward pass

Stefan Heimersheim, Alex Turner

5mo

6

1

27Tracr: Compiled Transformers as a Laboratory for Interpretability | DeepMind

9mo

3

0

17Concrete Steps to Get Started in Transformer Mechanistic Interpretability

9mo

2

1

18Brief Notes on Transformers

1y

2

1

17Building a transformer from scratch - AI safety up-skilling challenge

Marius Hobbhahn

1y

0

1

9The positional embedding matrix and previous-token heads: how do they actually work?

2mo

1

1

11New Tool: the Residual Stream Viewer

1d

0

Add Posts