Skip to content

feature: add Uvicorn logging parameters to vllm_router #967

Description

@quachc

Describe the feature

We notice a lot of liveness-/readinessProbe logging in the router container, for the "model containers" we can use --disable-access-log-for-endpoints /health,/metrics,/ping to suppress this logging.

It would be really nice if we could suppress the logging of vllm_router in a similar matter.

Why do you need this feature?

Prevent excessive logging for vllm_router and preserve important logging (e.g. --log-stats)

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions