ContextQMD
Back to Pytorch

Distributed Optimizers

docs/source/distributed.optim.md

2.11.0320 B
Original Source
{eval-rst}
.. role:: hidden
    :class: hidden-section

Distributed Optimizers

:::{warning} Distributed optimizer is not currently supported when using CUDA tensors :::

{eval-rst}
.. automodule:: torch.distributed.optim
    :members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer