The Decoder· Maximilian Schreiner·· 6 days agoAI score60
Google ships four TPU variants in one year as it ramps up competition with Nvidia
Google ships four TPU variants in one year as it ramps up competition with Nvidia
AI summary
Google added two systems to its eighth-generation TPU lineup: the TPU 8tx for confidential computing, which keeps data and model weights protected during active use, and the TPU 8i Max, which places two TPU 8i chips on one package to double compute, memory and memory bandwidth in the same rack. Both are built on existing silicon with new packaging, networking and memory configurations, and Google says it has shipped four TPU systems in a single year for the first time. Google also released TorchTPU as open source and supports vLLM and SGLang, as it markets TPUs to external customers, now nearly 100 of them.
Source: The Decoder · the-decoder.com