[Bug] ERROR: No matching distribution found for vllm==0.6.3.post2.dev1; extra == "srt-hip"

[pseudotensor]

Checklist

• 1. I have searched related issues but cannot get the expected help.
• 2. The bug has not been fixed in the latest version.
• 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
• 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 5. Please use English, otherwise it will be closed.

Describe the bug

Trying to install sglang for AMD, but hitting this issue. I was following this: https://docs.sglang.ai/start/install.html#method-2-from-source

Happens with latest sglang or the version 0.4.2 specified in the instructions.

base) root@6e2c9e6215c7:/# conda activate sglang
(sglang) root@6e2c9e6215c7:/# conda install python=3.10 -y
Channels:
 - defaults
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/sglang

  added / updated specs:
    - python=3.10


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    bzip2-1.0.8                |       h5eee18b_6         262 KB
    ca-certificates-2024.12.31 |       h06a4308_0         128 KB
    ld_impl_linux-64-2.40      |       h12ee557_0         710 KB
    libffi-3.4.4               |       h6a678d5_1         141 KB
    openssl-3.0.15             |       h5eee18b_0         5.2 MB
    pip-24.2                   |  py310h06a4308_0         2.3 MB
    python-3.10.16             |       he870216_1        26.9 MB
    setuptools-75.1.0          |  py310h06a4308_0         1.7 MB
    sqlite-3.45.3              |       h5eee18b_0         1.2 MB
    tk-8.6.14                  |       h39e8969_0         3.4 MB
    tzdata-2025a               |       h04d1e81_0         117 KB
    wheel-0.44.0               |  py310h06a4308_0         109 KB
    xz-5.4.6                   |       h5eee18b_1         643 KB
    zlib-1.2.13                |       h5eee18b_1         111 KB
    ------------------------------------------------------------
                                           Total:        42.9 MB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main
  _openmp_mutex      pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu
  bzip2              pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6
  ca-certificates    pkgs/main/linux-64::ca-certificates-2024.12.31-h06a4308_0
  ld_impl_linux-64   pkgs/main/linux-64::ld_impl_linux-64-2.40-h12ee557_0
  libffi             pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1
  libgcc-ng          pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1
  libgomp            pkgs/main/linux-64::libgomp-11.2.0-h1234567_1
  libstdcxx-ng       pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1
  libuuid            pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0
  ncurses            pkgs/main/linux-64::ncurses-6.4-h6a678d5_0
  openssl            pkgs/main/linux-64::openssl-3.0.15-h5eee18b_0
  pip                pkgs/main/linux-64::pip-24.2-py310h06a4308_0
  python             pkgs/main/linux-64::python-3.10.16-he870216_1
  readline           pkgs/main/linux-64::readline-8.2-h5eee18b_0
  setuptools         pkgs/main/linux-64::setuptools-75.1.0-py310h06a4308_0
  sqlite             pkgs/main/linux-64::sqlite-3.45.3-h5eee18b_0
  tk                 pkgs/main/linux-64::tk-8.6.14-h39e8969_0
  tzdata             pkgs/main/noarch::tzdata-2025a-h04d1e81_0
  wheel              pkgs/main/linux-64::wheel-0.44.0-py310h06a4308_0
  xz                 pkgs/main/linux-64::xz-5.4.6-h5eee18b_1
  zlib               pkgs/main/linux-64::zlib-1.2.13-h5eee18b_1



Downloading and Extracting Packages:
Preparing transaction: done
Verifying transaction: done

(sglang) root@6e2c9e6215c7:/# git clone  https://github.com/sgl-project/sglang.git
fatal: destination path 'sglang' already exists and is not an empty directory.
(sglang) root@6e2c9e6215c7:/# cd sglang
(sglang) root@6e2c9e6215c7:/sglang# pip install --upgrade pip
Requirement already satisfied: pip in /opt/conda/envs/sglang/lib/python3.10/site-packages (24.2)
Collecting pip
  Using cached pip-25.0-py3-none-any.whl.metadata (3.7 kB)
Using cached pip-25.0-py3-none-any.whl (1.8 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 24.2
    Uninstalling pip-24.2:
      Successfully uninstalled pip-24.2
Successfully installed pip-25.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv.
 Use the --root-user-action option if you know what you are doing and want to suppress this warning.
(sglang) root@6e2c9e6215c7:/sglang# pip install -e "python[all_hip]"
Obtaining file:///sglang/python
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Collecting requests (from sglang==0.4.2)
  Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting tqdm (from sglang==0.4.2)
  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting numpy (from sglang==0.4.2)
  Downloading numpy-2.2.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Collecting IPython (from sglang==0.4.2)
  Downloading ipython-8.31.0-py3-none-any.whl.metadata (4.9 kB)
Collecting setproctitle (from sglang==0.4.2)
  Using cached setproctitle-1.3.4-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10 kB)
Collecting decorator (from IPython->sglang==0.4.2)
  Downloading decorator-5.1.1-py3-none-any.whl.metadata (4.0 kB)
Collecting exceptiongroup (from IPython->sglang==0.4.2)
  Downloading exceptiongroup-1.2.2-py3-none-any.whl.metadata (6.6 kB)
Collecting jedi>=0.16 (from IPython->sglang==0.4.2)
  Downloading jedi-0.19.2-py2.py3-none-any.whl.metadata (22 kB)
Collecting matplotlib-inline (from IPython->sglang==0.4.2)
  Downloading matplotlib_inline-0.1.7-py3-none-any.whl.metadata (3.9 kB)
Collecting pexpect>4.3 (from IPython->sglang==0.4.2)
  Downloading pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB)
Collecting prompt_toolkit<3.1.0,>=3.0.41 (from IPython->sglang==0.4.2)
  Downloading prompt_toolkit-3.0.50-py3-none-any.whl.metadata (6.6 kB)
Collecting pygments>=2.4.0 (from IPython->sglang==0.4.2)
  Downloading pygments-2.19.1-py3-none-any.whl.metadata (2.5 kB)
Collecting stack_data (from IPython->sglang==0.4.2)
  Downloading stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting traitlets>=5.13.0 (from IPython->sglang==0.4.2)
  Downloading traitlets-5.14.3-py3-none-any.whl.metadata (10 kB)
Collecting typing_extensions>=4.6 (from IPython->sglang==0.4.2)
  Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests->sglang==0.4.2)
  Downloading charset_normalizer-3.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (35 kB)
Collecting idna<4,>=2.5 (from requests->sglang==0.4.2)
  Downloading idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting urllib3<3,>=1.21.1 (from requests->sglang==0.4.2)
  Downloading urllib3-2.3.0-py3-none-any.whl.metadata (6.5 kB)
Collecting certifi>=2017.4.17 (from requests->sglang==0.4.2)
  Using cached torch-2.5.1-cp310-cp310-manylinux1_x86_64.whl.metadata (28 kB)
INFO: pip is looking at multiple versions of sglang[srt-hip] to determine which version is compatible with other requirements. This could take a while.
ERROR: Ignored the following yanked versions: 0.2.1
ERROR: Could not find a version that satisfies the requirement vllm==0.6.3.post2.dev1; extra == "srt-hip" (from sglang[srt-hip]) (from versions: 0.0.1, 0.1.0, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6, 0.1.7, 0.2.0, 0.2.1.post1, 0.2.2, 0.2.3, 0.2.4, 0.2.5, 0.2.6, 0.2.7, 0.3.0, 0.3.1, 0.3.2, 0.3.3, 0.4.0, 0.4.0.post1, 0.4.1, 0.4.2, 0.4.3, 0.5.0, 0.5.0.post1, 0.5.1, 0.5.2, 0.5.3, 0.5.3.post1, 0.5.4, 0.5.5, 0.6.0, 0.6.1, 0.6.1.post1, 0.6.1.post2, 0.6.2, 0.6.3, 0.6.3.post1, 0.6.4, 0.6.4.post1, 0.6.5, 0.6.6, 0.6.6.post1, 0.7.0)
ERROR: No matching distribution found for vllm==0.6.3.post2.dev1; extra == "srt-hip"
(sglang) root@6e2c9e6215c7:/sglang#

Reproduction

See above

Environment

runpod AMD 8*mi300

[pseudotensor]

Same with python 3.12

[zhaochenyang20]

Thanks. We will ask AMD for help.

[zhaochenyang20]

@pseudotensor Stay tuned.z

[pseudotensor]

I ended up using docker image on runpod and it works, so some instructions aren't quite good I guess, even though the Dockerfile seems to be similar to what I did.

I'm unblocked for now.

[zhaochenyang20]

@pseudotensor Could you give us your solution? Thanks! We will update in our docs.

[pseudotensor]

I didn't have a solution to that issue, just used docker image instead.

Command:

python3 -m sglang.launch_server --model-path deepseek-ai/DeepSeek-V3 --host 0.0.0.0 --port 5000 --trust-remote-code  --context-length 65536 --tp 8 --random-seed 1234 --download-dir /root/.cache/huggingface/hub/

image: lmsysorg/sglang:v0.4.2-rocm620

[zhaochenyang20]

Thanks!

[Epliz]

The problem is that the version of vllm indicated at

sglang/python/pyproject.toml

Line 36 in 9f635ea

srt_hip = ["sglang[runtime_common]", "torch", "vllm==0.6.3.post2.dev1"]

is not a public tag from the vllm repository. Probably is one in a ROCm fork?