Nvidia

DeepSeek releases DeepInfer inference framework for Nvidia and Huawei chips: DeepSeek released DeepInfer, its large-scale model inference framework, on October 20. It supports Nvidia GPUs and Huawei Ascend chips, offers distributed inference, speculative decoding and structured output, and aims to improve throughput and latency while cutting computing costs and energy use.

AI Infrastructure • TechNode

Nvidia claims DSX POD cuts AI data center deployment from six months to 14 days: Nvidia unveiled the DSX POD, a modular containerized version of its Vera Rubin reference architecture, at GTC Berlin. The company claims it can cut AI data center deployment from six months to 14 days.

AI Infrastructure • Techmeme

Google releases developer tool to run PyTorch apps off Nvidia GPUs: Google released a developer tool that lets PyTorch users move their apps off Nvidia GPUs. It joins Amazon in targeting Nvidia's stronghold with AI app developers.

AI Infrastructure • TechCrunch AI

Nvidia launches new open models to run AI agents in enterprise data centers and on PCs: Nvidia launched new open models designed to run AI agents in enterprise data centers and on PCs. The release supports on-device, private AI agents for organizations that want to use their own models.

Nvidia • TechCrunch AI

Amazon launches TorchNeuron open-source framework for PyTorch on Trainium chips in public beta: Amazon launched TorchNeuron, an open-source framework in public beta that lets developers run PyTorch code on its Trainium chips without rewriting. The tool aims to ease switching from Nvidia to Amazon's AI chips.

AI Development • Techmeme