Summary * We are a new research organization working on investigating trends in Machine Learning and forecasting the development of Transformative Artificial Intelligence * This work is done in close collaboration with other organizations, like Rethink Priorities, Open Philanthropy, and MIT CSAIL * We will be hiring for 2-4 full-time...
Summary Using our dataset of milestone Machine Learning models, and our recent analysis of compute trends in ML, we project forward 70 years worth of trends in the amount of compute used to train Machine Learning models. Our simulations account for (a) uncertainty in estimates of the growth rates in...
https://arxiv.org/abs/2202.05924 What do you need to develop advanced Machine Learning systems? Leading companies don’t know. But they are very interested in figuring it out. They dream of replacing all these pesky workers with reliable machines who take no leave and have no morale issues. So when they heard that throwing...
by Jaime Sevilla, Lennart Heim, Marius Hobbhahn, Tamay Besiroglu, and Anson Ho You can find the complete article here. We provide a short summary below. In short: To estimate the compute used to train a Deep Learning model we can either: 1) directly count the number of operations needed or...