Cost

Technology

• DeepSeek releases DeepInfer inference framework for Nvidia and Huawei chips: DeepSeek released DeepInfer, its large-scale model inference framework, on October 20. It supports Nvidia GPUs and Huawei Ascend chips, offers distributed inference, speculative decoding and structured output, and aims to improve throughput and latency while cutting computing costs and energy use.

  AI Infrastructure • TechNode

  Permalink