Skip to content

Could you help deploy deepseek-v4-flash with vllm on L20 GPU #255

Description

@terrytian88

Does vllm support deploying deepseek-v4-flash on L20 (Ada 46G) GPU ? If yes,could you please send me a guide or docker image ? Appericate for you help. thanks a lot.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions