Scaling Laws

Applied to Google's new text-to-image model - Parti, a demonstration of scaling benefits by exactapproximations at 4d

Applied to Causal confusion as an argument against the scaling hypothesis by Robert Kirk at 6d

Applied to [linkpost] The final AI benchmark: BIG-bench by RomanS at 17d

Applied to Ethan Caballero on Private Scaling Progress by Raymond Arnold at 2mo

Applied to [Link] Training Compute-Optimal Large Language Models by nostalgebraist at 3mo

Applied to Compute Trends — Comparison to OpenAI’s AI and Compute by Lennart Heim at 3mo

Applied to Compute Trends Across Three eras of Machine Learning by Lennart Heim at 3mo

Applied to Estimating training compute of Deep Learning models by Lennart Heim at 5mo

Applied to How I'm thinking about GPT-N by delton137 at 5mo

Applied to How to measure FLOP/s for Neural Networks empirically? by Jaime Sevilla at 7mo

Applied to Compute Research Questions and Metrics - Transformative AI and Compute [4/4] by Lennart Heim at 7mo

Applied to My ML Scaling bibliography by gwern at 8mo

Applied to /r/MLScaling: new subreddit for NN scaling research/discussion by gwern at 8mo

Applied to Compute Governance and Conclusions - Transformative AI and Compute [3/4] by Lennart Heim at 8mo

Applied to NVIDIA and Microsoft releases 530B parameter transformer model, Megatron-Turing NLG by Kaj Sotala at 8mo

Applied to Forecasting Compute - Transformative AI and Compute [2/4] by Lennart Heim at 9mo

Applied to Proposal: Scaling laws for RL generalization by flodorner at 9mo

Applied to What is Compute? - Transformative AI and Compute [1/4] by Lennart Heim at 9mo