DeepSeek's October 2026 open-source release of DeepInfer left out a cache system, the split between prompt processing and answer generation, and load balancing across machines

From the articleDeepSeek open-sources DeepInfer, the engine that runs its AI models