x

AI ALIGNMENT FORUM
AF

Transformers — AI Alignment Forum

Transformers

This page is a stub.

1

1

Posts tagged Transformers

1

62How LLMs are and are not myopic

2y

7

1

72Modern Transformers are AGI, and Human-Level

2y

30

2

33Residual stream norms grow exponentially over the forward pass

StefanHex, TurnTrout

3y

6

1

27Tracr: Compiled Transformers as a Laboratory for Interpretability | DeepMind

3y

9

0

17Concrete Steps to Get Started in Transformer Mechanistic Interpretability

3y

5

1

8AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them

2y

0

1

143Transformers Represent Belief State Geometry in their Residual Stream

2y

4

1

28Attention SAEs Scale to GPT-2 Small

Connor Kissane, robertzk, Arthur Conmy, Neel Nanda

2y

0

1

20Brief Notes on Transformers

3y

2

1

21Understanding mesa-optimization using toy models

tilmanr, rusheb, Guillaume Corlouer, Dan Valentine, afspies, mivanitskiy, Can

3y

0

1

17Building a transformer from scratch - AI safety up-skilling challenge

Marius Hobbhahn

3y

0

0

13Deconfusing In-Context Learning

Arjun Panickssery

2y

0

1

16New Tool: the Residual Stream Viewer

2y

1

1

9The positional embedding matrix and previous-token heads: how do they actually work?

2y

1

Add Posts