Requirements#

This section includes requirements about using FlagTree, including supported platforms and dependencies. FlagTree can be successfully installed and run only when all requirements are met.

System software requirements#

You may need the following system softwares:

  • Ubuntu

  • Python 3.x

Backends, Triton versions, and branches#

Each backend is based on different versions of Triton, and therefore resides in different protected branches. All these protected branches have equal status. CI/CD runners are provisioned for every backend listed in the table.

Branch

Vendor

Backend

Triton version

main

NVIDIA
AMD
x86_64 cpu
ILUVATAR
Moore Threads
KLX
MetaX
HYGON

nvidia
amd
triton-shared
iluvatar
mthreads
xpu
metax
hcu

3.1
3.1
3.1
3.1
3.1
3.0
3.0
3.1

triton_v3.2.x

NVIDIA
AMD
Huawei Ascend
Moore Threads
Cambricon

nvidia
amd
ascend
mthreads
cambricon

3.2

triton_v3.3.x

NVIDIA
AMD
x86_64 cpu
ARM China
Tsingmicro
Enflame
ARM64 cpu

nvidia
amd
triton-shared
aipu
tsingmicro
enflame
cpu

3.3

triton_v3.4.x

NVIDIA
AMD
Sunrise

nvidia
amd
sunrise

3.4

triton_v3.5.x

NVIDIA
AMD
Enflame

nvidia
amd
enflame

3.5

triton_v3.6.x

NVIDIA
AMD
Enflame
HYGON
Moore Threads
Thrive

nvidia
amd
enflame
hcu
mthreads
damoacademy

3.6

Features on different branches#

FlagTree’s extension components are currently available on some backends:

Branch

Backend

Triton version

Extension components

triton_v3.6.x

nvidia
enflame

3.6

TLE-Lite
TLE-Struct GPU
TLE-Raw
HINTS

triton_v3.6.x

mthreads

3.6

TLE-Lite
TLE-Struct GPU

triton_v3.2.x

ascend

3.2

TLE-Struct DSA
FLIR
HINTS

triton_v3.3.x

tsingmicro

3.3

TLE-Lite
TLE-Struct DSA
FLIR

triton_v3.3.x

aipu

3.3

FLIR
HINTS

Backend integrations#

The following backends have been integrated into FlagTree. For new vendors, you can refer to the following code links for your integrations: