Trends in Machine Learning
In the last few decades the field of Machine Learning has seen rapid advances. More is to come in the next few decades. Understanding better what has happened and might happen will lead us to better AI governance and prioritization of AI risk.
This sequence is a compilation of publication from Epoch. We are researching trends in the inputs and performance of Machine Learning systems.
Our core research program centers around trends in parameters, compute and data. This is motivated from previous work on ML scaling, showing regular improvements in capabilities associated with these three factors.