Command Line Tool

Author: Shenggui Li

Prerequisite:

• Distributed Training
• Colossal-AI Overview

Introduction

Colossal-AI provides command-line utilities for the user. The current command line tools support the following features.

• verify Colossal-AI build
• launch distributed jobs
• tensor parallel micro-benchmarking

Check Installation

To verify whether your Colossal-AI is built correctly, you can use the command colossalai check -i. This command will inform you information regarding the version compatibility and cuda extension.

<figure style={{textAlign: "center"}}> <figcaption>Check Installation Demo</figcaption> </figure>

Launcher

To launch distributed jobs on single or multiple nodes, the command colossalai run can be used for process launching. You may refer to Launch Colossal-AI for more details.

<!-- doc-test-command: echo -->