Deepinfer

DeepSeek open-sources DeepInfer, its production inference engine

DeepSeek has released DeepInfer, the inference framework it uses internally to serve its large-scale production systems, as an open-source project. The initial release supports the DeepSeek-V4.1-Flash model and includes optimized kernels, parallelism strategies, speculative decoding, asynchronous scheduling, and batch-invariant deterministic inference.