Nvidia

DeepSeek releases DeepInfer inference framework for Nvidia and Huawei chips: DeepSeek released DeepInfer, its large-scale model inference framework, on October 20. It supports Nvidia GPUs and Huawei Ascend chips, offers distributed inference, speculative decoding and structured output, and aims to improve throughput and latency while cutting computing costs and energy use.

AI Infrastructure • TechNode

Nvidia claims DSX POD cuts AI data center deployment from six months to 14 days: Nvidia unveiled the DSX POD, a modular containerized version of its Vera Rubin reference architecture, at GTC Berlin. The company claims it can cut AI data center deployment from six months to 14 days.

AI Infrastructure • Techmeme

Google releases developer tool to run PyTorch apps off Nvidia GPUs: Google released a developer tool that lets PyTorch users move their apps off Nvidia GPUs. It joins Amazon in targeting Nvidia's stronghold with AI app developers.

AI Infrastructure • TechCrunch AI

Nvidia launches new open models to run AI agents in enterprise data centers and on PCs: Nvidia launched new open models designed to run AI agents in enterprise data centers and on PCs. The release supports on-device, private AI agents for organizations that want to use their own models.

Nvidia • TechCrunch AI

Amazon launches TorchNeuron open-source framework for PyTorch on Trainium chips in public beta: Amazon launched TorchNeuron, an open-source framework in public beta that lets developers run PyTorch code on its Trainium chips without rewriting. The tool aims to ease switching from Nvidia to Amazon's AI chips.

AI Development • Techmeme

ByteDance, Alibaba, and Tencent • Nvidia

ByteDance, Alibaba, Tencent reportedly order over 3 million Nvidia RTX PRO 5500 GPUs: Reuters, citing sources, reports ByteDance, Alibaba, and Tencent have ordered more than 3 million of Nvidia's new RTX PRO 5500 graphics cards, with a collective sticker price above $35 billion. The companies are rushing to secure less powerful, export-compliant chips.

Tenstorrent • Tenstorrent

Tenstorrent raises $1.5B at $6.2B valuation for open-weight AI chips: Tenstorrent raised $1.5 billion at a $6.2 billion valuation to remain independent and scale open-weight AI chips, TechCrunch reported. The Nvidia challenger had drawn acquisition interest earlier this year.