Skip to content

client python dependency issue with vllm-rayserve-gpu #79

Open
@nabuskey

Description

@nabuskey

Description

The client.py documentation need to add missing dependency for aiohttp. Just need to run pip install aiohttp

  • ✋ I have searched the open/closed issues and my issue is not listed.

⚠️ Note

Before you submit an issue, please perform the following for Terraform examples:

  1. Remove the local .terraform directory (! ONLY if state is stored remotely, which hopefully you are following that best practice!): rm -rf .terraform/
  2. Re-initialize the project root to pull down modules: terraform init
  3. Re-attempt your terraform plan or apply and check if the issue still persists

Reproduction Code [Required]

cd ai-on-eks/blueprints/inference/vllm-rayserve-gpu
python3 -m venv .venv
source .venv/bin/activate
pip install requests
python3 client.py

Expected behavior

Completes without errors

Actual behavior

(.venv) ➜  inference/vllm-rayserve-gpu git:(main) ✗ python3 client.py
Traceback (most recent call last):
  File "/Users/mccloman/repos/ai-on-eks/blueprints/inference/vllm-rayserve-gpu/client.py", line 1, in <module>
    import aiohttp

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions