Skip to content

Request support for SGLang v0.5.14 in TraceLens inference analysis #783

Description

@chennyiiis

Hi @devalshahamd,

Thank you for maintaining the SGLang support in TraceLens. I noticed that the current SGLang Docker build helper and roofline patch directories appear to cover SGLang 0.5.9, 0.5.11, and 0.5.12, while SGLang has recently released v0.5.14.

Would it be possible to add support for SGLang v0.5.14?

Based on a quick look through the repository, it seems this might involve:

  • adding v0.5.14 handling in examples/custom_workflows/inference_analysis/build_docker_sglang.sh
  • adding or updating the corresponding roofline patch under examples/custom_workflows/inference_analysis/sglang_roofline_patches/
  • updating the documented SGLang image/version matrix
  • validating that profiling flags, graph-capture profiling, shape metadata, and roofline annotations continue to work with the latest SGLang layout

This would make it easier to use TraceLens with current SGLang deployments and reduce the need to stay on older SGLang images only for profiling support.

Thank you again for considering this request.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions