(/data1/ai-llm/env/my-vllm-gpu) [root@localhost vllm-gpu]# TORCH_CUDA_ARCH_LIST="6.1;7.0;8.0" CMAKE_CUDA_ARCHITECTURES="61" python setup.py develop
[05/16/25 14:05:57] WARNING git too old -> timestamp is '%cI' git.py:122
running develop
/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!********************************************************************************Please avoid running ``setup.py`` and ``easy_install``.Instead, use pypa/build, pypa/installer or otherstandards-based tools.See https://github.com/pypa/setuptools/issues/917 for details.********************************************************************************!!easy_install.initialize_options(self)
/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!********************************************************************************Please avoid running ``setup.py`` directly.Instead, use pypa/build, pypa/installer or otherstandards-based tools.See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.********************************************************************************!!self.initialize_options()
running egg_info
writing vllm.egg-info/PKG-INFO
writing dependency_links to vllm.egg-info/dependency_links.txt
writing entry points to vllm.egg-info/entry_points.txt
writing requirements to vllm.egg-info/requires.txt
writing top-level names to vllm.egg-info/top_level.txt
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'vllm.egg-info/SOURCES.txt'
running build_ext
-- Build type: RelWithDebInfo
-- Target device: cuda
-- Found python matching: /data1/ai-llm/env/my-vllm-gpu/bin/python.
-- Found CUDAToolkit: /usr/local/cuda/include (found version "12.4.99")
-- PyTorch: CUDA detected: 12.4
-- PyTorch: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- PyTorch: CUDA toolkit directory: /usr/local/cuda
-- PyTorch: Header version is: 12.4
-- Found Python: /data1/ai-llm/env/my-vllm-gpu/bin/python (found version "3.12.9") found components: Interpreter
CMake Warning at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:140 (message):Failed to compute shorthash for libnvrtc.so
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)CMakeLists.txt:81 (find_package)CMake Warning (dev) at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FindPackageHandleStandardArgs.cmake:430 (message):The package name passed to find_package_handle_standard_args() (nvtx3) doesnot match the name of the calling package (Caffe2). This can lead toproblems in calling code that expects find_package() result variables(e.g., `_FOUND`) to follow a certain pattern.
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:178 (find_package_handle_standard_args)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)CMakeLists.txt:81 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.-- Could NOT find nvtx3 (missing: nvtx3_dir)
CMake Warning at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:184 (message):Cannot find NVTX3, find old NVTX instead
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)CMakeLists.txt:81 (find_package)-- USE_CUDNN is set to 0. Compiling without cuDNN support
-- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
-- USE_CUDSS is set to 0. Compiling without cuDSS support
-- USE_CUFILE is set to 0. Compiling without cuFile support
CMake Warning at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/utils.cmake:328 (message):In the future we will require one to explicitly pass TORCH_CUDA_ARCH_LISTto cmake instead of implicitly setting it as an env variable. This willbecome a FATAL_ERROR in future version of pytorch.
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:331 (torch_cuda_get_nvcc_gencode_flag)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)CMakeLists.txt:81 (find_package)-- Added CUDA NVCC flags for: -gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_80,code=sm_80
CMake Warning at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:121 (append_torchlib_if_found)CMakeLists.txt:81 (find_package)-- CUDA target architectures: 6.1;7.0;8.0
-- CUDA supported target architectures: 7.0;8.0
-- FetchContent base directory: /data1/ai-llm/vllm-gpu/.deps
-- Enabling cumem allocator extension.
-- CMake Version: 4.0.2
-- CUTLASS 3.9.0
-- Found CUDAToolkit: /usr/local/cuda/targets/x86_64-linux/include (found version "12.4.99")
-- CUDART: /usr/local/cuda/lib64/libcudart.so
-- CUDA Driver: /usr/local/cuda/lib64/stubs/libcuda.so
-- NVRTC: /usr/local/cuda/lib64/libnvrtc.so
-- Default Install Location: install
-- CUDA Compilation Architectures: 70;72;75;80;86;87;89;90;90a
-- Enable caching of reference results in conv unit tests
-- Enable rigorous conv problem sizes in conv unit tests
-- Grid Dependency Control (GDC) is enabled for SM100 kernels (required for programmatic dependent launches).
-- Using the following NVCC flags:--expt-relaxed-constexpr-ftemplate-backtrace-limit=0-DCUTLASS_TEST_LEVEL=0-DCUTLASS_TEST_ENABLE_CACHED_RESULTS=1-DCUTLASS_CONV_UNIT_TEST_RIGOROUS_SIZE_ENABLED=1-DCUTLASS_DEBUG_TRACE_LEVEL=0-Xcompiler=-Wconversion-Xcompiler=-fno-strict-aliasing-lineinfo
-- Configuring cublas ...
-- cuBLAS Disabled.
-- Configuring cuBLAS ... done.
-- Building Marlin kernels for archs: 8.0
-- Building AllSpark kernels for archs: 8.0
-- Not building scaled_mm_c3x_sm90 as no compatible archs found in CUDA target architectures
-- Not building scaled_mm_c3x_100 as no compatible archs found in CUDA target architectures
-- Building scaled_mm_c2x for archs: 8.0
-- Not building sparse_scaled_mm_c3x as no compatible archs found in CUDA target architectures
-- Not building NVFP4 as no compatible archs were found.
-- Not building CUTLASS MLA as no compatible archs were found.
-- Not building grouped_mm_c3x as no compatible archs found in CUDA target architectures
-- Not building Machete kernels as no compatible archs found in CUDA target architectures
-- Enabling C extension.
-- Marlin MOE generation script hash: 99151b8355873acc953d469b11b21f1b
-- Last run Marlin MOE generate script hash:
-- Marlin MOE generation completed successfully.
-- Building Marlin MOE kernels for archs: 8.0
-- Enabling moe extension.
CMake Warning (dev) at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:1564 (cmake_parse_arguments):The BUILD_COMMAND keyword was followed by an empty string or no value atall. Policy CMP0174 is not set, so cmake_parse_arguments() will unset theARG_BUILD_COMMAND variable rather than setting it to an empty string.
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2145:EVAL:2 (__FetchContent_doPopulation)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2145 (cmake_language)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2384 (__FetchContent_Populate)cmake/external_projects/flashmla.cmake:30 (FetchContent_MakeAvailable)CMakeLists.txt:717 (include)
This warning is for project developers. Use -Wno-dev to suppress it.CMake Warning (dev) at /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:1564 (cmake_parse_arguments):The CONFIGURE_COMMAND keyword was followed by an empty string or no valueat all. Policy CMP0174 is not set, so cmake_parse_arguments() will unsetthe ARG_CONFIGURE_COMMAND variable rather than setting it to an emptystring.
Call Stack (most recent call first):/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2145:EVAL:2 (__FetchContent_doPopulation)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2145 (cmake_language)/data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/cmake/data/share/cmake-4.0/Modules/FetchContent.cmake:2384 (__FetchContent_Populate)cmake/external_projects/flashmla.cmake:30 (FetchContent_MakeAvailable)CMakeLists.txt:717 (include)
This warning is for project developers. Use -Wno-dev to suppress it.-- FlashMLA is available at /data1/ai-llm/vllm-gpu/.deps/flashmla-src
-- Build type: RelWithDebInfo
-- Target device: cuda
-- Found Python: /data1/ai-llm/env/my-vllm-gpu/bin/python (found version "3.12.9") found components: Interpreter Development.Module Development.SABIModule
CMake Warning at .deps/vllm-flash-attn-src/CMakeLists.txt:75 (message):Pytorch version 2.4.0 expected for CUDA build, saw 2.6.0 instead.-- CUDA target architectures: 7.0;8.0
-- CUDA supported target architectures: 8.0
-- FA2_ARCHS: 8.0
-- FA3_ARCHS: 8.0
-- vllm-flash-attn is available at /data1/ai-llm/vllm-gpu/.deps/vllm-flash-attn-src
-- Configuring done (11.3s)
-- Generating done (0.1s)
-- Build files have been written to: /data1/ai-llm/vllm-gpu/build/temp.linux-x86_64-cpython-312
[76/285] Building CUDA object vllm-flash-attn/CMakeFiles/_vllm_fa2_C.dir/csrc/flash_attn/src/flash_fwd_split_hdim96_fp16_sm80.cu.o[130/285] Building CUDA object vllm-flash-attn/CMakeFiles/_vllm_fa3_C.dir/hopper/instantiations/flash_fwd_hdim256_bf16_softcap_sm80.cu.o
[134/285] Building CUDA object vllm-flash-attn/CMakeFiles/_vllm_fa3_C.dir/hopper/instantiations/flash_fwd_hdim256_bf16_split_softcapall_sm80.cu.o[202/285] Building CUDA object vllm-flash-attn/CMakeFiles/_vllm_fa3_C.dir/hopper/instantiations/flash_fwd_hdim256_fp16_paged_split_sm80.cu.o
[285/285] Linking CXX shared module vllm-flash-attn/_vllm_fa3_C.abi3.so
-- Install configuration: "RelWithDebInfo"
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/_moe_C.abi3.so
-- Set non-toolchain portion of runtime path of "/data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/_moe_C.abi3.so" to ""
-- Install configuration: "RelWithDebInfo"
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa2_C.abi3.so
-- Set non-toolchain portion of runtime path of "/data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa2_C.abi3.so" to ""
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/__init__.py
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/flash_attn_interface.py
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/__init__.py
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/rotary.py
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/__init__.py
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/rotary.py
-- Install configuration: "RelWithDebInfo"
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa3_C.abi3.so
-- Set non-toolchain portion of runtime path of "/data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa3_C.abi3.so" to ""
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/__init__.py
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/flash_attn_interface.py
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/__init__.py
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/rotary.py
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/__init__.py
-- Up-to-date: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/rotary.py
-- Install configuration: "RelWithDebInfo"
-- Install configuration: "RelWithDebInfo"
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/cumem_allocator.abi3.so
-- Set non-toolchain portion of runtime path of "/data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/cumem_allocator.abi3.so" to ""
-- Install configuration: "RelWithDebInfo"
-- Installing: /data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/_C.abi3.so
-- Set non-toolchain portion of runtime path of "/data1/ai-llm/vllm-gpu/build/lib.linux-x86_64-cpython-312/vllm/_C.abi3.so" to ""
copying build/lib.linux-x86_64-cpython-312/vllm/_moe_C.abi3.so -> vllm
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa2_C.abi3.so -> vllm/vllm_flash_attn
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/_vllm_fa3_C.abi3.so -> vllm/vllm_flash_attn
copying build/lib.linux-x86_64-cpython-312/vllm/cumem_allocator.abi3.so -> vllm
copying build/lib.linux-x86_64-cpython-312/vllm/_C.abi3.so -> vllm
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/__init__.py to vllm/vllm_flash_attn/__init__.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/__init__.py -> vllm/vllm_flash_attn
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/flash_attn_interface.py to vllm/vllm_flash_attn/flash_attn_interface.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/flash_attn_interface.py -> vllm/vllm_flash_attn
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/__init__.py to vllm/vllm_flash_attn/layers/__init__.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/__init__.py -> vllm/vllm_flash_attn/layers
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/rotary.py to vllm/vllm_flash_attn/layers/rotary.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/layers/rotary.py -> vllm/vllm_flash_attn/layers
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/__init__.py to vllm/vllm_flash_attn/ops/triton/__init__.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/__init__.py -> vllm/vllm_flash_attn/ops/triton
Copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/rotary.py to vllm/vllm_flash_attn/ops/triton/rotary.py
copying build/lib.linux-x86_64-cpython-312/vllm/vllm_flash_attn/ops/triton/rotary.py -> vllm/vllm_flash_attn/ops/triton
Creating /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/vllm.egg-link (link to .)
Adding vllm 0.8.6.dev0+gba41cc9.d20250516 to easy-install.pth file
Installing vllm script to /data1/ai-llm/env/my-vllm-gpu/binInstalled /data1/ai-llm/vllm-gpu
Processing dependencies for vllm==0.8.6.dev0+gba41cc9.d20250516
Searching for numba==0.61.2
Best match: numba 0.61.2
Adding numba 0.61.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for setuptools==78.1.1
Best match: setuptools 78.1.1
Adding setuptools 78.1.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for six==1.17.0
Best match: six 1.17.0
Adding six 1.17.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for xformers==0.0.29.post2
Best match: xformers 0.0.29.post2
Adding xformers 0.0.29.post2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for llguidance==0.7.20
Best match: llguidance 0.7.20
Adding llguidance 0.7.20 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for xgrammar==0.1.18
Best match: xgrammar 0.1.18
Adding xgrammar 0.1.18 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for torchvision==0.21.0
Best match: torchvision 0.21.0
Adding torchvision 0.21.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for torchaudio==2.6.0
Best match: torchaudio 2.6.0
Adding torchaudio 2.6.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for torch==2.6.0
Best match: torch 2.6.0
Adding torch 2.6.0 to easy-install.pth file
Installing torchfrtrace script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing torchrun script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for ray==2.46.0
Best match: ray 2.46.0
Adding ray 2.46.0 to easy-install.pth file
Installing ray script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing serve script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing tune script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-semantic-conventions-ai==0.4.8
Best match: opentelemetry-semantic-conventions-ai 0.4.8
Adding opentelemetry-semantic-conventions-ai 0.4.8 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-exporter-otlp==1.26.0
Best match: opentelemetry-exporter-otlp 1.26.0
Adding opentelemetry-exporter-otlp 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-api==1.26.0
Best match: opentelemetry-api 1.26.0
Adding opentelemetry-api 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-sdk==1.26.0
Best match: opentelemetry-sdk 1.26.0
Adding opentelemetry-sdk 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for ninja==1.11.1.4
Best match: ninja 1.11.1.4
Adding ninja 1.11.1.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for scipy==1.15.3
Best match: scipy 1.15.3
Adding scipy 1.15.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for python-json-logger==3.3.0
Best match: python-json-logger 3.3.0
Adding python-json-logger 3.3.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for watchfiles==1.0.5
Best match: watchfiles 1.0.5
Adding watchfiles 1.0.5 to easy-install.pth file
Installing watchfiles script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for cloudpickle==3.1.1
Best match: cloudpickle 3.1.1
Adding cloudpickle 3.1.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for depyf==0.18.0
Best match: depyf 0.18.0
Adding depyf 0.18.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for compressed-tensors==0.9.3
Best match: compressed-tensors 0.9.3
Adding compressed-tensors 0.9.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for einops==0.8.1
Best match: einops 0.8.1
Adding einops 0.8.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for PyYAML==6.0.2
Best match: PyYAML 6.0.2
Adding PyYAML 6.0.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opencv-python-headless==4.11.0.86
Best match: opencv-python-headless 4.11.0.86
Adding opencv-python-headless 4.11.0.86 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for mistral-common==1.5.4
Best match: mistral-common 1.5.4
Adding mistral-common 1.5.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for importlib-metadata==8.0.0
Best match: importlib-metadata 8.0.0
Adding importlib-metadata 8.0.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages/setuptools/_vendor
Searching for gguf==0.16.3
Best match: gguf 0.16.3
Adding gguf 0.16.3 to easy-install.pth file
detected new path './setuptools/_vendor'
Installing gguf-convert-endian script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing gguf-dump script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing gguf-editor-gui script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing gguf-new-metadata script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing gguf-set-metadata script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for msgspec==0.19.0
Best match: msgspec 0.19.0
Adding msgspec 0.19.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pyzmq==26.4.0
Best match: pyzmq 26.4.0
Adding pyzmq 26.4.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for partial-json-parser==0.2.1.1.post5
Best match: partial-json-parser 0.2.1.1.post5
Adding partial-json-parser 0.2.1.1.post5 to easy-install.pth file
Installing json-playground script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for filelock==3.18.0
Best match: filelock 3.18.0
Adding filelock 3.18.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for typing-extensions==4.13.2
Best match: typing-extensions 4.13.2
Adding typing-extensions 4.13.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for lark==1.2.2
Best match: lark 1.2.2
Adding lark 1.2.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for outlines==0.1.11
Best match: outlines 0.1.11
Adding outlines 0.1.11 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for lm-format-enforcer==0.10.11
Best match: lm-format-enforcer 0.10.11
Adding lm-format-enforcer 0.10.11 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for tiktoken==0.9.0
Best match: tiktoken 0.9.0
Adding tiktoken 0.9.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for prometheus-fastapi-instrumentator==7.1.0
Best match: prometheus-fastapi-instrumentator 7.1.0
Adding prometheus-fastapi-instrumentator 7.1.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pillow==11.2.1
Best match: pillow 11.2.1
Adding pillow 11.2.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for prometheus-client==0.21.1
Best match: prometheus-client 0.21.1
Adding prometheus-client 0.21.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pydantic==2.11.4
Best match: pydantic 2.11.4
Adding pydantic 2.11.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for openai==1.78.1
Best match: openai 1.78.1
Adding openai 1.78.1 to easy-install.pth file
Installing openai script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for aiohttp==3.11.18
Best match: aiohttp 3.11.18
Adding aiohttp 3.11.18 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for fastapi==0.115.12
Best match: fastapi 0.115.12
Adding fastapi 0.115.12 to easy-install.pth file
Installing fastapi script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for protobuf==4.25.7
Best match: protobuf 4.25.7
Adding protobuf 4.25.7 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for tokenizers==0.21.1
Best match: tokenizers 0.21.1
Adding tokenizers 0.21.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for huggingface-hub==0.31.2
Best match: huggingface-hub 0.31.2
Adding huggingface-hub 0.31.2 to easy-install.pth file
Installing huggingface-cli script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for transformers==4.51.3
Best match: transformers 4.51.3
Adding transformers 4.51.3 to easy-install.pth file
Installing transformers-cli script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for py-cpuinfo==9.0.0
Best match: py-cpuinfo 9.0.0
Adding py-cpuinfo 9.0.0 to easy-install.pth file
Installing cpuinfo script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for blake3==1.0.4
Best match: blake3 1.0.4
Adding blake3 1.0.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for tqdm==4.67.1
Best match: tqdm 4.67.1
Adding tqdm 4.67.1 to easy-install.pth file
Installing tqdm script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for requests==2.32.3
Best match: requests 2.32.3
Adding requests 2.32.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for numpy==2.2.5
Best match: numpy 2.2.5
Adding numpy 2.2.5 to easy-install.pth file
Installing f2py script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing numpy-config script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for sentencepiece==0.2.0
Best match: sentencepiece 0.2.0
Adding sentencepiece 0.2.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for psutil==7.0.0
Best match: psutil 7.0.0
Adding psutil 7.0.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for cachetools==5.5.2
Best match: cachetools 5.5.2
Adding cachetools 5.5.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for llvmlite==0.44.0
Best match: llvmlite 0.44.0
Adding llvmlite 0.44.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for triton==3.2.0
Best match: triton 3.2.0
Adding triton 3.2.0 to easy-install.pth file
Installing proton script to /data1/ai-llm/env/my-vllm-gpu/bin
Installing proton-viewer script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for sympy==1.13.1
Best match: sympy 1.13.1
Adding sympy 1.13.1 to easy-install.pth file
Installing isympy script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-nvjitlink-cu12==12.4.127
Best match: nvidia-nvjitlink-cu12 12.4.127
Adding nvidia-nvjitlink-cu12 12.4.127 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-nvtx-cu12==12.4.127
Best match: nvidia-nvtx-cu12 12.4.127
Adding nvidia-nvtx-cu12 12.4.127 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-nccl-cu12==2.21.5
Best match: nvidia-nccl-cu12 2.21.5
Adding nvidia-nccl-cu12 2.21.5 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cusparselt-cu12==0.6.2
Best match: nvidia-cusparselt-cu12 0.6.2
Adding nvidia-cusparselt-cu12 0.6.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cusparse-cu12==12.3.1.170
Best match: nvidia-cusparse-cu12 12.3.1.170
Adding nvidia-cusparse-cu12 12.3.1.170 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cusolver-cu12==11.6.1.9
Best match: nvidia-cusolver-cu12 11.6.1.9
Adding nvidia-cusolver-cu12 11.6.1.9 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-curand-cu12==10.3.5.147
Best match: nvidia-curand-cu12 10.3.5.147
Adding nvidia-curand-cu12 10.3.5.147 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cufft-cu12==11.2.1.3
Best match: nvidia-cufft-cu12 11.2.1.3
Adding nvidia-cufft-cu12 11.2.1.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cublas-cu12==12.4.5.8
Best match: nvidia-cublas-cu12 12.4.5.8
Adding nvidia-cublas-cu12 12.4.5.8 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cudnn-cu12==9.1.0.70
Best match: nvidia-cudnn-cu12 9.1.0.70
Adding nvidia-cudnn-cu12 9.1.0.70 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cuda-cupti-cu12==12.4.127
Best match: nvidia-cuda-cupti-cu12 12.4.127
Adding nvidia-cuda-cupti-cu12 12.4.127 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cuda-runtime-cu12==12.4.127
Best match: nvidia-cuda-runtime-cu12 12.4.127
Adding nvidia-cuda-runtime-cu12 12.4.127 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nvidia-cuda-nvrtc-cu12==12.4.127
Best match: nvidia-cuda-nvrtc-cu12 12.4.127
Adding nvidia-cuda-nvrtc-cu12 12.4.127 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for fsspec==2025.3.2
Best match: fsspec 2025.3.2
Adding fsspec 2025.3.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for jinja2==3.1.6
Best match: jinja2 3.1.6
Adding jinja2 3.1.6 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for networkx==3.4.2
Best match: networkx 3.4.2
Adding networkx 3.4.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for cupy-cuda12x==13.4.1
Best match: cupy-cuda12x 13.4.1
Adding cupy-cuda12x 13.4.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for packaging==25.0
Best match: packaging 25.0
Adding packaging 25.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for msgpack==1.1.0
Best match: msgpack 1.1.0
Adding msgpack 1.1.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for jsonschema==4.23.0
Best match: jsonschema 4.23.0
Adding jsonschema 4.23.0 to easy-install.pth file
Installing jsonschema script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for click==8.1.8
Best match: click 8.1.8
Adding click 8.1.8 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-exporter-otlp-proto-http==1.26.0
Best match: opentelemetry-exporter-otlp-proto-http 1.26.0
Adding opentelemetry-exporter-otlp-proto-http 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-exporter-otlp-proto-grpc==1.26.0
Best match: opentelemetry-exporter-otlp-proto-grpc 1.26.0
Adding opentelemetry-exporter-otlp-proto-grpc 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for Deprecated==1.2.18
Best match: Deprecated 1.2.18
Adding Deprecated 1.2.18 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-semantic-conventions==0.47b0
Best match: opentelemetry-semantic-conventions 0.47b0
Adding opentelemetry-semantic-conventions 0.47b0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for anyio==4.9.0
Best match: anyio 4.9.0
Adding anyio 4.9.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for dill==0.4.0
Best match: dill 0.4.0
Adding dill 0.4.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for astor==0.8.1
Best match: astor 0.8.1
Adding astor 0.8.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for zipp==3.21.0
Best match: zipp 3.21.0
Adding zipp 3.21.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for outlines-core==0.1.26
Best match: outlines-core 0.1.26
Adding outlines-core 0.1.26 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for airportsdata==20250224
Best match: airportsdata 20250224
Adding airportsdata 20250224 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pycountry==24.6.1
Best match: pycountry 24.6.1
Adding pycountry 24.6.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for referencing==0.36.2
Best match: referencing 0.36.2
Adding referencing 0.36.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for diskcache==5.6.3
Best match: diskcache 5.6.3
Adding diskcache 5.6.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for nest-asyncio==1.6.0
Best match: nest-asyncio 1.6.0
Adding nest-asyncio 1.6.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for interegular==0.3.3
Best match: interegular 0.3.3
Adding interegular 0.3.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for regex==2024.11.6
Best match: regex 2024.11.6
Adding regex 2024.11.6 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for starlette==0.46.2
Best match: starlette 0.46.2
Adding starlette 0.46.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for typing-inspection==0.4.0
Best match: typing-inspection 0.4.0
Adding typing-inspection 0.4.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pydantic-core==2.33.2
Best match: pydantic-core 2.33.2
Adding pydantic-core 2.33.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for annotated-types==0.7.0
Best match: annotated-types 0.7.0
Adding annotated-types 0.7.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for sniffio==1.3.1
Best match: sniffio 1.3.1
Adding sniffio 1.3.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for jiter==0.9.0
Best match: jiter 0.9.0
Adding jiter 0.9.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for httpx==0.28.1
Best match: httpx 0.28.1
Adding httpx 0.28.1 to easy-install.pth file
Installing httpx script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for distro==1.9.0
Best match: distro 1.9.0
Adding distro 1.9.0 to easy-install.pth file
Installing distro script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for yarl==1.20.0
Best match: yarl 1.20.0
Adding yarl 1.20.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for propcache==0.3.1
Best match: propcache 0.3.1
Adding propcache 0.3.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for multidict==6.4.3
Best match: multidict 6.4.3
Adding multidict 6.4.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for frozenlist==1.6.0
Best match: frozenlist 1.6.0
Adding frozenlist 1.6.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for attrs==25.3.0
Best match: attrs 25.3.0
Adding attrs 25.3.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for aiosignal==1.3.2
Best match: aiosignal 1.3.2
Adding aiosignal 1.3.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for aiohappyeyeballs==2.6.1
Best match: aiohappyeyeballs 2.6.1
Adding aiohappyeyeballs 2.6.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for uvicorn==0.34.2
Best match: uvicorn 0.34.2
Adding uvicorn 0.34.2 to easy-install.pth file
Installing uvicorn script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for email-validator==2.2.0
Best match: email-validator 2.2.0
Adding email-validator 2.2.0 to easy-install.pth file
Installing email_validator script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for python-multipart==0.0.20
Best match: python-multipart 0.0.20
Adding python-multipart 0.0.20 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for fastapi-cli==0.0.7
Best match: fastapi-cli 0.0.7
Adding fastapi-cli 0.0.7 to easy-install.pth file
Installing fastapi script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for hf-xet==1.1.1
Best match: hf-xet 1.1.1
Adding hf-xet 1.1.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for safetensors==0.5.3
Best match: safetensors 0.5.3
Adding safetensors 0.5.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for certifi==2025.4.26
Best match: certifi 2025.4.26
Adding certifi 2025.4.26 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for urllib3==2.4.0
Best match: urllib3 2.4.0
Adding urllib3 2.4.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for idna==3.10
Best match: idna 3.10
Adding idna 3.10 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for charset-normalizer==3.4.2
Best match: charset-normalizer 3.4.2
Adding charset-normalizer 3.4.2 to easy-install.pth file
Installing normalizer script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for mpmath==1.3.0
Best match: mpmath 1.3.0
Adding mpmath 1.3.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for MarkupSafe==3.0.2
Best match: MarkupSafe 3.0.2
Adding MarkupSafe 3.0.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for fastrlock==0.8.3
Best match: fastrlock 0.8.3
Adding fastrlock 0.8.3 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for rpds-py==0.25.0
Best match: rpds-py 0.25.0
Adding rpds-py 0.25.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for jsonschema-specifications==2025.4.1
Best match: jsonschema-specifications 2025.4.1
Adding jsonschema-specifications 2025.4.1 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-proto==1.26.0
Best match: opentelemetry-proto 1.26.0
Adding opentelemetry-proto 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for opentelemetry-exporter-otlp-proto-common==1.26.0
Best match: opentelemetry-exporter-otlp-proto-common 1.26.0
Adding opentelemetry-exporter-otlp-proto-common 1.26.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for googleapis-common-protos==1.70.0
Best match: googleapis-common-protos 1.70.0
Adding googleapis-common-protos 1.70.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for grpcio==1.71.0
Best match: grpcio 1.71.0
Adding grpcio 1.71.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for wrapt==1.17.2
Best match: wrapt 1.17.2
Adding wrapt 1.17.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for httpcore==1.0.9
Best match: httpcore 1.0.9
Adding httpcore 1.0.9 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for websockets==15.0.1
Best match: websockets 15.0.1
Adding websockets 15.0.1 to easy-install.pth file
Installing websockets script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for uvloop==0.21.0
Best match: uvloop 0.21.0
Adding uvloop 0.21.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for python-dotenv==1.1.0
Best match: python-dotenv 1.1.0
Adding python-dotenv 1.1.0 to easy-install.pth file
Installing dotenv script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for httptools==0.6.4
Best match: httptools 0.6.4
Adding httptools 0.6.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for h11==0.16.0
Best match: h11 0.16.0
Adding h11 0.16.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for dnspython==2.7.0
Best match: dnspython 2.7.0
Adding dnspython 2.7.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for rich-toolkit==0.14.6
Best match: rich-toolkit 0.14.6
Adding rich-toolkit 0.14.6 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for typer==0.15.4
Best match: typer 0.15.4
Adding typer 0.15.4 to easy-install.pth file
Installing typer script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for rich==14.0.0
Best match: rich 14.0.0
Adding rich 14.0.0 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for shellingham==1.5.4
Best match: shellingham 1.5.4
Adding shellingham 1.5.4 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for pygments==2.19.1
Best match: pygments 2.19.1
Adding pygments 2.19.1 to easy-install.pth file
Installing pygmentize script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for markdown-it-py==3.0.0
Best match: markdown-it-py 3.0.0
Adding markdown-it-py 3.0.0 to easy-install.pth file
Installing markdown-it script to /data1/ai-llm/env/my-vllm-gpu/binUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Searching for mdurl==0.1.2
Best match: mdurl 0.1.2
Adding mdurl 0.1.2 to easy-install.pth fileUsing /data1/ai-llm/env/my-vllm-gpu/lib/python3.12/site-packages
Finished processing dependencies for vllm==0.8.6.dev0+gba41cc9.d20250516
