Install FlagGems-sglang#
For a fresh installation of FlagGems-sglang, follow the steps below.
Install build dependencies.
pip install -U 'scikit-build-core>=0.11' pybind11 ninja cmake
Clone and install FlagGems-sglang.
git clone https://github.com/flagos-ai/FlagGems-sglang.git cd FlagGems-sglang pip install .
For development, use editable installation:
pip install --no-build-isolation -e .
To run the test suites, install the test dependencies as well:
pip install -e '.[test]'
Optionally select the backend explicitly. The runtime detects the device on import; set
DNN_VENDORto force a specific backend instead:export DNN_VENDOR=nvidia
Verify the installation#
python -c "import flaggems_sglang; print(flaggems_sglang.device, flaggems_sglang.vendor_name); print(len(flaggems_sglang.all_registered_ops()), 'operators')"