The compute used to train the final model in the 2017 Transformer paper was roughly 1/10,000th of the training compute required for GPT-3

A manufacturer-by-manufacturer overview of the chips, accelerators, and infrastructure powering modern AI systems.

2 debates·4,147 claims·630 news stories