Back to Pytorch Lightning

Level 24: Add a new accelerator or Strategy

docs/source-pytorch/levels/expert_level_24.rst

2.6.41.3 KB
Original Source

:orphan:

########################################### Level 24: Add a new accelerator or Strategy ###########################################

Integrate a new accelerator or distributed strategy.


.. raw:: html

<div class="display-card-container">
    <div class="row">

.. Add callout items below this line

.. displayitem:: :header: 1: Develop a new strategy :description: Develop new strategies for training and deploying larger and larger models. :col_css: col-md-6 :button_link: ../accelerators/gpu_expert.html :height: 150 :tag: expert

.. displayitem:: :header: 2: Customize checkpointing with new strategies. :description: Customize checkpointing for custom distributed strategies and accelerators. :col_css: col-md-6 :button_link: ../common/checkpointing_expert.html :height: 150 :tag: expert

.. displayitem:: :header: 3: Register a new strategy :description: Enable a new strategy to be used in Lightning. :col_css: col-md-6 :button_link: ../advanced/strategy_registry.html :height: 150 :tag: expert

.. displayitem:: :header: 4: Create a new precision technique :description: Create new precision techniques and enable them through Lightning. :col_css: col-md-6 :button_link: ../common/precision_expert.html :height: 150 :tag: expert

.. raw:: html

    </div>
</div>