For a given level of intelligence, making Mixture of Experts (MOE) models sparser can save a significant amount of flops

A manufacturer-by-manufacturer overview of the chips, accelerators, and infrastructure powering modern AI systems.

AI research advances and the benchmarks used to measure progress.