Install FlagGems-vLLM

Install FlagGems-vLLM#

For a fresh installation of FlagGems-vLLM, follow the steps below.

  1. Install dependencies.

    pip install -U 'scikit-build-core>=0.11' pybind11 ninja cmake
    
  2. Clone and install FlagGems-vLLM.

    git clone https://github.com/flagos-ai/FlagGems-vllm.git
    cd FlagGems-vllm
    pip install .
    

    For development, use editable installation:

    pip install --no-build-isolation -e .
    

    To run tests, install the test dependencies as well:

    pip install -e '.[test]'