GoKawiilMeta runs Google TPU inference in production via new PyTorch-native SGLang engine
Google and Meta jointly released a PyTorch-native version of the SGLang inference engine, called TorchTPU, letting Google's tensor processing units serve AI workloads without requiring a switch to Google's JAX framework. Meta's PyTorch-TPU lead Zongwei Zhou said the engine is already running in production at Meta, built with help from RadixArk, the startup founded by SGLang's creators. A matching PyTorch-native version of the vLLM inference engine was also released as open source.