Back to Colossalai

Cluster Utilities

docs/source/en/features/cluster_utils.md

0.5.1496 B
Original Source

Cluster Utilities

Author: Hongxin Liu

Prerequisite:

Introduction

We provide a utility class colossalai.cluster.DistCoordinator to coordinate distributed training. It's useful to get various information about the cluster, such as the number of nodes, the number of processes per node, etc.

API Reference

{{ autodoc:colossalai.cluster.DistCoordinator }}

<!-- doc-test-command: echo -->