DeepSeek open-sources DeepInfer to cut the cost of running AI models

DeepSeek has released DeepInfer, its internal AI inference framework, as open source, giving developers access to technology used to run the company’s AI models at scale while aiming to reduce computing costs and energy consumption. Announced Tuesday, the framework powers DeepSeek V4.1 Flash and includes optimized computing kernels, distributed inference, speculative decoding, and scheduling tools designed to improve processing speed and efficiency. Inference refers to the process of running a trained AI model to generate responses, with computing requirements representing a significant expense for companies operating large AI services. DeepSeek said the release would help developers improve performance and lower the costs of deploying AI models, while providing insights into production techniques that major AI companies often keep proprietary. The framework currently supports Nvidia SM100 GPUs and Huawei Ascend 950 processors, with the company planning to add support for future DeepSeek models and further optimizations. Open source AI gains momentum as developers move toward local deployment The announcement comes as openly available AI models gain traction among developers and bu...