Documentation#
FlagOS
A unified, open-source system software stack designed for a variety of AI chips
FlagOS OverviewFlagOS Core Libraries
FlagGems
A high-performance general-purpose operator library implemented with the Triton programming language and its extended languages.
FlagTree
An open-source, unified compiler for multiple AI chips.
FlagScale
A comprehensive toolkit designed to support the entire lifecycle of large models.
FlagCX
A scalable and adaptive unified communication library for cross-chip environments.
Plugin Systems
Megatron-LM-FL
A fork of Megatron-LM that introduces a plugin-based architecture for supporting diverse AI chips, built on top of FlagOS, a unified open-source AI system software stack.
vllm-plugin-FL
A plugin for the vLLM inference/serving framework, built on FlagOS's unified multi-chip backend — including the unified operator library FlagGems and the unified communication library FlagCX.
TransformerEngine-FL
A fork of TransformerEngine that introduces a plugin-based architecture for supporting diverse AI chips, built on top of FlagOS, a unified open-source AI system software stack.
verl-FL
A fork of verl (Volcano Engine Reinforcement Learning for LLMs) that extends the upstream library with multi-chip/multi-hardware support via the FlagOS ecosystem.
FlagOS Open-Source Tools
KernelGen
An operator auto-generation tool.
FlagRelease
A platform dedicated to the automatic migration, adaptation and release of large models for multi-architecture AI chips.
FlagPerf
An integrated AI hardware evaluation engine.
Additional Resources
FlagOS-Robo
An integrated training and inference framework for AI models used in robots, so-called Embodied Intelligence.
FlagOS Skills
Compatible with Claude Code, Cursor, Codex, and any agent supporting the Agent Skills standard.
Online Laboratory
An online laboratory providing cloud-based development environments.