Hardware and AI Timelines

Trends in DRAM price per gigabyte

The price of a gigabyte of DRAM has fallen by about a factor of ten every 5 years from 1957 to 2020. Since 2010, the price has fallen much more slowly, at a rate that

AI Timelines

2019 recent trends in GPU price per FLOPS

We estimate that in recent years, GPU prices have fallen at rates that would yield an order of magnitude over roughly: 17 years for single-precision FLOPS 10 years for half-precision FLOPS 5 years for half-precision

No Picture
AI Timelines

Electrical efficiency of computing

Computer performance per watt has probably doubled every 1.5 years between 1945 and 2000. Since then the trend slowed. By 2015, performance per watt appeared to be doubling every 2.5 years. Details In 2011 Jon

No Picture
Hardware and AI Timelines

Nordhaus hardware price performance dataset

This page contains the data from Appendix 2 of William Nordhaus’ The progress of computing in usable formats. Notes This data was collected from Appendix 2 of The progress of computing, using Tabula (a program for turning

No Picture
AI Timelines

2018 price of performance by Tensor Processing Units

Tensor Processing Units (TPUs) perform around 1 GFLOPS/$, when purchased as cloud computing. Details In February 2018, Google Cloud Platform blog says their TPUs can perform up to 180 TFLOPS, and currently cost $6.50/hour. This

No Picture
AI Timelines

2015 FLOPS prices

In April 2015, the lowest GFLOPS prices we could find were approximately $3/GFLOPS. However recent records of hardware performance from 2015 and earlier imply substantially lower prices, suggesting that something confusing has happened with these