User Guide

This section guides you on how to test FlagGems-vLLM operators and use the operators in the vLLM inference workflows.

• Run tests and benchmark
  • Import smoke test
  • Run tests
  • Run benchmark
• Use operators