Big Tech
MediumWatch
Google's Ironwood TPU bets the datacenter on inference, not training
Google's seventh-generation TPU is its first purpose-built for inference — superpods of up to 9,216 chips — a hardware signal that serving, not training, is now the dominant AI cost.
StaffPrincipalArchitect
Source ↗