后端支持#
下表总结了当前支持的通信后端及其对应的功能。
Backend |
NCCL |
IXCCL |
CNCL |
MCCL |
XCCL |
DUCCL |
HCCL |
MUSACCL |
RCCL |
TCCL |
ECCL |
PCCL |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
Mode |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
Homo/Hetero |
send |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
recv |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
broadcast |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
gather |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
☓/☓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
☓/☓ |
scatter |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
☓/☓ |
reduce |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
allreduce |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
allgather |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
reducescatter |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
alltoall |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
☓/☓ |
alltoallv |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
☓/☓ |
group ops |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/☓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
✓/✓ |
注意 Homo 和 Hetero 模式分别指同构集群和异构集群之间的通信。 所有原生集合通信库可通过以下链接查看（按字母顺序排列）：
CNCL，寒武纪通信库。
DUCCL，DU 集合通信库。
ECCL，燧原集合通信库。
HCCL，昇腾通信库。
IXCCL，天数智芯 Corex 集合通信库。
MCCL，MetaX 集合通信库。
MUSACCL，摩尔线程集合通信库。
NCCL，NVIDIA 集合通信库。
PCCL，Sunrise 集合通信库。
RCCL，ROCm 集合通信库。
TCCL，清微智能集合通信库。
XCCL，昆仑芯 XPU 集合通信库。
此外，FlagCX 支持三种用于主机端通信的集合通信库：