ContextQMD
Back to Sglang

Multi-Node Deployment

docs/references/multi_node_deployment/multi_node_index.rst

0.5.11505 B
Original Source

Multi-Node Deployment

.. toctree:: :maxdepth: 1 :caption: Multi-Node Deployment

multi_node.md deploy_on_k8s.md lws_pd/lws_pd_deploy.md rbg_pd/deepseekv32_pd.md

  • Deploying DeepSeek with PD Disaggregation and Large-Scale Expert Parallelism on 96 H100 GPUs <https://lmsys.org/blog/2025-05-05-large-scale-ep/>_
  • Deploying Kimi K2 with PD Disaggregation and Large-Scale Expert Parallelism on 128 H200 GPUs <https://lmsys.org/blog/2025-07-20-k2-large-scale-ep/>_