.. _gpu:

Accelerator: GPU training

.. raw:: html

<div class="display-card-container">
    <div class="row">

.. Add callout items below this line

.. displayitem:: :header: Prepare your code (Optional) :description: Prepare your code to run on any hardware :col_css: col-md-4 :button_link: accelerator_prepare.html :height: 150 :tag: basic

.. displayitem:: :header: Basic :description: Learn the basics of single and multi-GPU training. :col_css: col-md-4 :button_link: gpu_basic.html :height: 150 :tag: basic

.. displayitem:: :header: Intermediate :description: Learn about different distributed strategies, torchelastic and how to optimize communication layers. :col_css: col-md-4 :button_link: gpu_intermediate.html :height: 150 :tag: intermediate

.. displayitem:: :header: Advanced :description: Train models with billions of parameters :col_css: col-md-4 :button_link: gpu_advanced.html :height: 150 :tag: advanced

.. displayitem:: :header: Expert :description: Develop new strategies for training and deploying larger and larger models. :col_css: col-md-4 :button_link: gpu_expert.html :height: 150 :tag: expert

.. displayitem:: :header: FAQ :description: Frequently asked questions about GPU training. :col_css: col-md-4 :button_link: gpu_faq.html :height: 150

.. raw:: html

    </div>
</div>