Skip to content

[megatron] Stream ChunkedDistributedLogprob.backward into a preallocated buffer (lower peak memory)#1806

Open
dyurk-lila wants to merge 3 commits into
NovaSky-AI:mainfrom
dyurk-lila:perf/streaming-chunked-logprob-backward
Open

[megatron] Stream ChunkedDistributedLogprob.backward into a preallocated buffer (lower peak memory)#1806
dyurk-lila wants to merge 3 commits into
NovaSky-AI:mainfrom
dyurk-lila:perf/streaming-chunked-logprob-backward

Commits

Commits on Jul 1, 2026