#inference

Google's Ironwood TPU bets the datacenter on inference, not training

Google's seventh-generation TPU is its first purpose-built for inference — superpods of up to 9,216 chips — a hardware signal that serving, not training, is now the dominant AI cost.