AI Timelines
Trend in compute used in training for headline AI results
Compute used in the largest AI training runs appears to have roughly doubled every 3.5 months between 2012 and 2018. Details According to Amodei and Hernandez, on the OpenAI Blog: …since 2012, the amount of compute …