Skip to main content
Back to top
Ctrl
+
K
← Back to FlagOS Documentation
← Back to FlagOS Documentation
Search
Ctrl
+
K
vllm-plugin-FL Documentation
📑 Release Notes
Release Notes
📚 Guides
vllm-plugin-FL Overview
Features
Operator dispatch mechanism
Getting Started
Requirements
Install software for running an inference task
Run an inference task
Qwen2.5-1.5B inference on Iluvatar BI-V150
Operator dispatch user guide
Quick start
Configure backend selection
Policy context management
Add new operators and vendor backends
📖 References
Dispatch API Reference
Index
