…since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month-doubling time (by comparison, Moore’s Law had an 18-month doubling period). Since 2012, this metric has grown by more than 300,000x (an 18-month doubling period would yield only a 12x increase)…
They give the following figure, and some of their calculations. We have not verified their calculations, or looked for other reports on this issue.
We welcome suggestions for this page or anything on the site via our feedback box, though will not address all of them.
An analysis of historical growth supports the possibility of radical increases in growth rate. Naive extrapolation of long-term trends would suggest massive increases in growth rate over the coming century, although growth over the last
Published 23 January 2014, last updated Aug 7 2022 ‘Human-level AI’ refers to AI which can reproduce everything a human can do, approximately. Several variants of this concept are worth distinguishing. Contents DetailsVariations in the meaning