Skip to content

bug: ray command not found following parallel pipeline tutorial #995

Description

@brunnels

Describe the bug

I'm following this tutorial: https://github.com/vllm-project/production-stack/blob/main/tutorials/15-basic-pipeline-parallel.md

kubectl -n ai logs vllm-stack-distilgpt2-raycluster-raycluster-head-lrxgm
Running vllm command in the background.
ERROR: init 250 result=11/bin/bash: line 1: ray: command not found

Regular non-parallel modelSpec's are working.

To Reproduce

I have kuberay-operator chart 1.2.0 deployed in the same namespace as vllm-stack chart 0.1.11. I'm using the same config file as the tutorial tutorials/assets/values-15-a-minimal-pipeline-parallel-example-raycluster.yaml.

I also tried the lastest kuberay-operator chart version 1.6.2 and got the same result.

Expected behavior

I should be able to verify the deployment per the tutorial

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions