Hardware and AI Timelines – Page 3

Brain performance in TEPS

Traversed Edges Per Second (TEPS) is a benchmark for measuring a computer’s ability to communicate information internally. Given several assumptions, we can also estimate the human brain’s communication performance in terms of TEPS, and use this

Glial Signaling

The presence of glial cells may increase the capacity for signaling in the brain by a small factor, but is unlikely to qualitatively change the nature or extent of signaling in the brain. Support Number

Scale of the Human Brain

The brain has about 10¹¹ neurons and 1.8-3.2 x 10¹⁴ synapses. These probably account for the majority of computationally interesting behavior. Support Number of neurons in the brain The number of neurons in the brain is about 10¹¹. For

Neuron firing rates in humans

Our best guess is that an average neuron in the human brain transmits a spike about 0.1-2 times per second. Support Bias from neurons with sparse activity When researchers measure neural activity, they can fail to see neurons

Metabolic Estimates of Rate of Cortical Firing

Cortical neurons are estimated to spike around 0.16 times per second, based on the amount of energy consumed by the human neocortex. They seem unlikely to spike much more than once per second on average, based on this

Current FLOPS prices

In November 2017, we estimate the price for one GFLOPS to be between $0.03 and $3 for single or double precision performance, using GPUs (therefore excluding some applications). Amortized over three years, this is $1.1

The cost of TEPS

A billion Traversed Edges Per Second (a GTEPS) can be bought for around $0.26/hour via a powerful supercomputer, including hardware and energy costs only. We do not know if GTEPS can be bought more cheaply elsewhere. We estimate that

Wikipedia history of GFLOPS costs

This is a list from Wikipedia, showing hardware configurations that authors claim perform efficiently, along with their prices per GFLOPS at different times in recent history. In it, prices generally fall at around an order of magnitude every five years, and

Trends in the cost of computing

Posted 10 Mar 2015 Computing power available per dollar has probably increased by a factor of ten roughly every four years over the last quarter of a century (measured in FLOPS or MIPS). Over the past 6-8 years, the