Google validated 4,917 Hugging Face open-source models on TorchTPU, achieving a 98% pass rate and 97% numerical parity relative to GPU baselines.

From the articleGoogle Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUsAlso in Switch Your PyTorch Model From Nvidia to Google TPUs With One Line: TorchTPU Is Now Open Source, Switch Your PyTorch Model From Nvidia to Google TPUs With One Line: TorchTPU Is Now Open Source, Google Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUs, Google open-sources TorchTPU to bring native PyTorch support to its TPUs