sglang-plugin-FL Documentation#
Overview
Have a quick view of sglang-plugin-FL, and also some basic concepts.
Getting Started
Outlines the installation requirements for sglang-plugin-FL and provides step-by-step instructions from running an inference.
User Guide
Guides you how to dispatch operators between FlagGems, vendor-specific, and PyTorch.
API Reference
API reference for the operator dispatch system and configuration options.