vllm-plugin-FL Documentation#
Overview
Have a quick view of vllm-plugin-FL, and also some basic concepts.
Getting Started
Outlines the installation requirements for vllm-plugin-FL and provides step-by-step instructions from running an inference.
User Guide
Guides you how to dispatch operators between FlagGems, vendor-specific, and PyTorch.
User Guide
Guides you how to dispatch operators between FlagGems, vendor-specific, and PyTorch.