Back to Pytorch Lightning

Level 18: Master TPUs

docs/source-pytorch/levels/advanced_level_20.rst

2.6.4990 B
Original Source

:orphan:

##################### Level 18: Master TPUs #####################

Master cloud TPU training with profiling and scaling techniques.


.. raw:: html

<div class="display-card-container">
    <div class="row">

.. Add callout items below this line

.. displayitem:: :header: Run on cloud TPUs :description: Scale massive models using cloud TPUs. :col_css: col-md-4 :button_link: ../accelerators/tpu_intermediate.html :height: 180 :tag: intermediate

.. displayitem:: :header: Explore advanced TPU scaling techniques :description: Dive into XLA and advanced techniques to optimize TPU-powered models. :col_css: col-md-4 :button_link: ../accelerators/tpu_advanced.html :height: 180 :tag: advanced

.. displayitem:: :header: Profile TPU code :description: Learn to profile TPU code. :col_css: col-md-4 :button_link: ../tuning/profiler_advanced.html :height: 180 :tag: advanced

.. raw:: html

    </div>
</div>