Training the original GPT-3 model cost approximately $500,000

A manufacturer-by-manufacturer overview of the chips, accelerators, and infrastructure powering modern AI systems.

AI research advances and the benchmarks used to measure progress.