Google open-sources TorchTPU, native PyTorch backend for TPUs
Read original source →developers.googleblog.com
TorchTPU makes TPU a native PyTorch device via torch.device("tpu"), so existing apps move to TPUs with a config change and no rewrite. Google also shipped PyTorch-native vLLM and SGLang engines on TPU, built with Inferact and RadixArk.
6 sources
Announcing New vLLM and SGLang Inference Engines on TPUdevelopers.googleblog.com
Hugging Face ❤️ TorchTPU: TPUs, Nativelyhuggingface.co
Google open-sources TorchTPU, a native PyTorch back end for TPUsgithub.com
Google Open-Sources TorchTPU, a Native PyTorch Backend for Cloud TPUsmarktechpost.com
Google has joined Amazon in attacking Nvidia’s stronghold with AI app developerstechcrunch.com
More stories today
Score-centering RL paper compiles train-inference mismatch methods
Nathan Lambert·1 hour agoDatabricks and SAP partner on end-to-end enterprise data and AI
Databricks and SAP announced a joint push to connect data and AI capabilities end to end for enterprise AI transformation. The post argues capable models still lack the business context needed to deliver value.
Databricks Blog·1 hour ago
NVIDIA tutorial runs Nemotron-3.5 Lightning on DGX Spark via TensorRT Edge-LLM
The trtedge CLI downloads a model and builds TensorRT engines for Spark's new 64GB configuration, tested with TensorRT Edge-LLM 0.11.1 and TensorRT 10.16.1.11. DSpark speculative decoding speeds generation, and the same runtime deploys to Jetson Thor, DRIVE AGX Thor and IGX Thor.
NVIDIA Developer Blog·1 hour ago
Tweet outlines building an AI-native engineering org
A single X post by sgondala2, shared on Hacker News, sketches how to structure an engineering organization around AI. No concrete metrics, tooling, or case data appear in the available snippet.
Hacker News·2 hours agoNVIDIA Halos SAFE links road testing and simulation for AV safety
NVIDIA Halos SAFE AV connects real-world testing, simulation, and vehicle hardware into one continuous evaluation loop. Omniverse NuRec reconstructs real driving scenarios while Cosmos generates variations across traffic, weather, and edge cases.
YouTube·2 hours ago
vLLM adds PLE disk offload support on nightly builds
A merged vLLM pull request adds PLE disk offload, landing in nightly builds rather than a tagged release. The change lets PLE data be paged to disk instead of held in memory.
r/LocalLLaMA·2 hours ago
Vercel's fx coding agent hits v0.0.16 at 5.97 MiB
Guillermo Rauch·2 hours ago
Databricks blog argues deliberate decisions drive enterprise AI value
Databricks' blog post frames rising expectations and spreading experimentation as the backdrop for its argument that enterprise AI value comes from deliberate decision-making rather than fast adoption.
