AI ALIGNMENT FORUM
AF

Extrapolating GPT-N performance

Aug 21, 2023 by Lukas Finnveden

In 2020, I wrote a post extrapolating how fast language models would improve on certain benchmarks, if they were scaled up. I've since followed-up with a couple of posts on how well those extrapolations seem to be holding up.

Read the last post for graphs with the most data-points on them. Read the first post for details and thoughts about how this exercise might be useful.

39Extrapolating GPT-N performance
Lukas Finnveden
5y
19
33PaLM in "Extrapolating GPT-N performance"
Lukas Finnveden
3y
15
20PaLM-2 & GPT-4 in "Extrapolating GPT-N performance"
Lukas Finnveden
2y
6