This website requires javascript to properly function. Consider activating javascript to get access to all site functionality.
AI ALIGNMENT FORUM
Tags
AF
Login
Transformers
Edit
History
Subscribe
Discussion
(0)
Help improve this page
Edit
History
Subscribe
Discussion
(0)
Help improve this page
Transformers
Random Tag
Contributors
Posts tagged
Transformers
Most Relevant
1
57
How LLMs are and are not myopic
janus
9mo
7
1
67
Modern Transformers are AGI, and Human-Level
Abram Demski
1mo
30
2
32
Residual stream norms grow exponentially over the forward pass
Stefan Heimersheim
,
Alex Turner
1y
6
1
27
Tracr: Compiled Transformers as a Laboratory for Interpretability | DeepMind
Cinera Verinia
1y
9
0
17
Concrete Steps to Get Started in Transformer Mechanistic Interpretability
Neel Nanda
1y
5
1
8
AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them
Roman Leventov
4mo
0
1
122
Transformers Represent Belief State Geometry in their Residual Stream
Adam Shai
9d
3
1
28
Attention SAEs Scale to GPT-2 Small
Connor Kissane
,
robertzk
,
Arthur Conmy
,
Neel Nanda
3mo
0
1
20
Brief Notes on Transformers
Adam Jermyn
2y
2
1
21
Understanding mesa-optimization using toy models
tilmanr
,
rusheb
,
Guillaume Corlouer
,
Dan Valentine
,
Alex Spies
,
Michael Ivanitskiy
,
Can
1y
0
1
17
Building a transformer from scratch - AI safety up-skilling challenge
Marius Hobbhahn
2y
0
0
13
Deconfusing In-Context Learning
Arjun Panickssery
2mo
0
1
16
New Tool: the Residual Stream Viewer
Adam Yedidia
7mo
1
1
9
The positional embedding matrix and previous-token heads: how do they actually work?
Adam Yedidia
9mo
1