TorchTPU achieved 52% model FLOPs utilization training Qwen 3 8B using TorchTitan across up to 8,192 Ironwood TPU v7x chips.

From the articleGoogle Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUsAlso in Switch Your PyTorch Model From Nvidia to Google TPUs With One Line: TorchTPU Is Now Open Source, Google open-sources TorchTPU to bring native PyTorch support to its TPUs, Google Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUs, Switch Your PyTorch Model From Nvidia to Google TPUs With One Line: TorchTPU Is Now Open Source