Back to Pytorch Lightning

Run on a multi-node cluster

docs/source-pytorch/clouds/cluster.rst

2.6.41.3 KB
Original Source

########################### Run on a multi-node cluster ###########################

.. raw:: html

<div class="display-card-container">
    <div class="row">

.. displayitem:: :header: Run single or multi-node on Lightning Studios :description: The easiest way to scale models in the cloud. No infrastructure setup required. :col_css: col-md-6 :button_link: lightning_ai.html :height: 160 :tag: basic

.. displayitem:: :header: Run on an on-prem cluster :description: Learn to train models on a general compute cluster. :col_css: col-md-6 :button_link: cluster_intermediate_1.html :height: 160 :tag: intermediate

.. displayitem:: :header: Run with Torch Distributed :description: Run models on a cluster with torch distributed. :col_css: col-md-6 :button_link: cluster_intermediate_2.html :height: 160 :tag: intermediate

.. displayitem:: :header: Run on a SLURM cluster :description: Run models on a SLURM-managed cluster :col_css: col-md-6 :button_link: cluster_advanced.html :height: 160 :tag: intermediate

.. displayitem:: :header: Integrate your own cluster :description: Learn how to integrate your own cluster :col_css: col-md-6 :button_link: cluster_expert.html :height: 160 :tag: expert

.. raw:: html

  </div>
</div>