Requirements#

Supported Hardwares#

Platform

Device

Description

NVIDIA

CUDA GPUs

Full feature support (default)

MetaX

MetaX GPUs

MetaX platform

Moore Threads

MUSA GPUs

Moore Threads MUSA platform

TXDA

Tsingmicro GPUs

Tsingmicro TXDA platform

NPU

Ascend NPU

Ascend 910B / CANN 8.0+

Operating system#

Linux (official), WSL2 (limited support)

Software#

  • Python >= 3.10 (3.12 recommended)

  • PyTorch >= 2.3

  • CUDA >= 12.1 (NVIDIA GPU), or MUSA SDK (Moore Threads / MetaX), or CANN 8.0+ (NPU)

  • TransformerEngine (optional, for TE-accelerated layers)

Source Build Requirements#

  • CMake 3.18+

  • Git 2.17+