Skip to content

Pull requests: lightseekorg/smg

New pull request New
20 Open 1,598 Closed
20 Open 1,598 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(tool_parser): treat qwen_xml tool-call arg values literally (#1888) tests Test changes tool-parser Tool/function call parser changes
#1899 opened Jul 9, 2026 by key4ng Collaborator Loading…
2 of 4 tasks
1
5
test: multimodal tensor-transport + EPD disaggregation coverage ci CI/CD configuration changes grpc gRPC client and router changes model-gateway Model gateway crate changes tests Test changes
#1898 opened Jul 9, 2026 by slin1237 Collaborator Loading…
16
fix(router): route unlisted models to wildcard external workers under IGW (#1871) model-gateway Model gateway crate changes tests Test changes
#1896 opened Jul 9, 2026 by slin1237 Collaborator Loading…
2 of 4 tasks
10
fix(grpc): router-authoritative string stop sequences for SGLang skip_tokenizer_init workers grpc gRPC client and router changes model-gateway Model gateway crate changes priority:high High priority tokenizer Tokenizer related changes
#1877 opened Jul 4, 2026 by gongwei-130 Collaborator • Draft
@slin1237
9
fix(cache-aware): use backend global backlog for load-aware fallback model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes
#1863 opened Jul 1, 2026 by 2JooYeon Loading…
2 of 4 tasks
14
fix(http): enforce streaming timeouts outside reqwest anthropic Anthropic router changes documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes openai OpenAI router changes priority:high High priority python-bindings Python bindings changes tests Test changes
#1858 opened Jun 30, 2026 by jshanson7 Contributor Loading…
87
feat(multimodal): configurable tensor transport + vLLM SHM and video dependencies Dependency updates documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes python-bindings Python bindings changes tests Test changes
#1818 opened Jun 22, 2026 by slin1237 Collaborator Loading…
3 tasks done
34
feat(tool_parser,reasoning_parser): add Step-3.5 tool and reasoning parsers reasoning-parser Reasoning parser changes stale PR has been inactive for 14+ days tests Test changes tool-parser Tool/function call parser changes
#1817 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
7
feat(reasoning_parser): add Mistral/Magistral reasoning parser reasoning-parser Reasoning parser changes stale PR has been inactive for 14+ days
#1816 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
8
feat(tool_parser,reasoning_parser): add MiniMax-M3 tool and reasoning parsers reasoning-parser Reasoning parser changes stale PR has been inactive for 14+ days tests Test changes tool-parser Tool/function call parser changes
#1815 opened Jun 22, 2026 by slin1237 Collaborator Loading…
2 of 3 tasks
11
[blocked] chore(deps): bincode 1.3->3.0 (smg-mesh) — 3.0.0 is a tombstone compile_error release dependencies Dependency updates mesh Mesh crate changes
#1802 opened Jun 22, 2026 by slin1237 Collaborator • Draft
4
feat(grpc-servicer): add Prometheus /metrics sidecar dependencies Dependency updates enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability needs-rebase PR has merge conflicts that need to be resolved tests Test changes
#1782 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
32
fix(observability): include gRPC workers in GET /engine_metrics enhancement New feature or request grpc gRPC client and router changes metrics-consolidation Epic: Engine Metrics Consolidation & PD Observability model-gateway Model gateway crate changes tests Test changes
#1779 opened Jun 18, 2026 by slin1237 Collaborator Loading…
1
33
[gateway] WebSocket transport for the Responses API — up to 45% lower TTFT, 22–48% lower ITL p99 tail, 17–21% less gateway CPU dependencies Dependency updates documentation Improvements or additions to documentation grpc gRPC client and router changes model-gateway Model gateway crate changes stale PR has been inactive for 14+ days tests Test changes
#1770 opened Jun 18, 2026 by Venkat2811 Loading…
5 tasks done
79
feat(smg): worker-sync observability — drops, spec fallback, refused tombstones, drift mesh Mesh crate changes model-gateway Model gateway crate changes
#1716 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
26
feat(smg): cluster-wide rate limiting via epoch-windowed mesh counters mesh Mesh crate changes model-gateway Model gateway crate changes
#1715 opened Jun 13, 2026 by CatherineSue Member Loading…
2 of 4 tasks
33
feat(mesh): causally-stable tombstone GC driven by per-peer ack watermarks mesh Mesh crate changes tests Test changes
#1686 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
16
feat(mesh): dead-node key cleanup — replica attribution, membership removal, sweep mesh Mesh crate changes model-gateway Model gateway crate changes tests Test changes
#1674 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
43
feat(smg): deterministic worker ids — restart-stable mesh keys dependencies Dependency updates model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved python-bindings Python bindings changes
#1668 opened Jun 11, 2026 by CatherineSue Member Loading…
2 of 4 tasks
31
(feat) Adding tenant based rate limiting based on input tokens for HTTP router enhancement New feature or request grpc gRPC client and router changes model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved priority:high High priority
#1397 opened Apr 27, 2026 by shenoyvvarun Contributor Loading…
2 of 4 tasks
@slin1237
81
ProTip! Exclude everything labeled bug with -label:bug.