[Feature] support Chunked Pipeline Parallelism + PD Disaggregation + Atomesh#1552

Draft

Jasen2201 wants to merge 8 commits into

mainfrom

Commits on Jul 13, 2026

[Feature] Pipeline parallel (PP) phase-1: serial correctness (ring=1)
Jasen2201
committed
[Feature] Pipeline parallel (PP) phase-2: batch-queue pipeline + PP-aware KV allocation
Jasen2201
committed
[CPP][trace] per-stage profiler dir under pipeline parallelism
Jasen2201
committed
[Feature] PD + Pipeline Parallelism (Prefill-PP + Decode-TP) over mooncake push
Jasen2201
committed
[Fix] PD+PP: dedup write-done by stage; idempotent release (concurrency accuracy)
Jasen2201
committed
[Fix] PD+PP: eliminate 60s TTFT stall on producer stage-0
Jasen2201
committed
[Refactor] mooncake: dedup ZMQ send + tighten _release_targets locking
Jasen2201
committed
[Feature] PP: async isend for inter-stage hidden states
Jasen2201
committed