Epoch AI unveiled Inference Performance Index, a new benchmark that measures AI chips by how many users they can serve

Specialised processors such as GPUs used to train and run AI models.

Standardized methods for evaluating AI system performance. Enables comparison across models, tasks, and metrics.