Back to Deepspeed

Mixture of Experts (MoE)

docs/code-docs/source/moe.rst

0.18.9144 B
Original Source

Mixture of Experts (MoE)

Layer specification

.. autoclass:: deepspeed.moe.layer.MoE :members: