Installation

vLLM supports the following hardware platforms:

• GPU
  • NVIDIA CUDA
  • AMD ROCm
  • Intel XPU
• CPU
  • Intel/AMD x86
  • ARM AArch64
  • Apple silicon
  • IBM Z (S390X)

Hardware Plugins

vLLM supports third-party hardware plugins that live outside the main vllm repository. These follow the Hardware-Pluggable RFC.

A list of all supported hardware can be found on the vLLM website, see Universal Compatibility - Hardware.

If you want to add new hardware, please contact us on Slack or Email.