Skip to content

add minimax m3 attention ops on A3 - #668

Open
vstone-w wants to merge 9 commits into
sgl-project:mainfrom
ClownBin:minimax_m3_atten_ops_v3
Open

add minimax m3 attention ops on A3#668
vstone-w wants to merge 9 commits into
sgl-project:mainfrom
ClownBin:minimax_m3_atten_ops_v3

Conversation

@vstone-w

@vstone-w vstone-w commented Aug 7, 2026

Copy link
Copy Markdown

Add minimax M3 adaptation operators. The list of newly added operators is as follows:

OpName Type Description
npu_sparse_attention_score AscendC decode attention,borrowed from vllm
swiglu_oai_quant triton Fuse SwiGLU‑OAI and int8 quantization
flash_decode_bnsd_with_topk_idx triton indexer used in decode
flash_prefill_bnsd_with_topk_idx triton indexer used in prefill
flash_decode_bnsd_with_gqa_share_sparse triton attention used in decode
flash_prefill_bnsd_blockq_sparse_fia triton attention used in prefill

These operators are integrated into the SGLang framework and are used by MiniMax M3. The overall performance test results are as follows:
image

Accuracy results are as follow:
image

@vstone-w vstone-w changed the title add minimax m3 attention ops add minimax m3 attention ops on A3 Aug 7, 2026
@vstone-w
vstone-w force-pushed the minimax_m3_atten_ops_v3 branch from c50eab5 to e8db2da Compare August 7, 2026 08:38
@sglang-npu-bot

Copy link
Copy Markdown
Collaborator

/tag-and-rerun-ci

@vstone-w
vstone-w force-pushed the minimax_m3_atten_ops_v3 branch from 526ea36 to c6fc8a6 Compare August 10, 2026 11:03
sglang-npu-bot
sglang-npu-bot previously approved these changes Aug 10, 2026
@vstone-w
vstone-w force-pushed the minimax_m3_atten_ops_v3 branch from 17a28dd to c0c7004 Compare August 10, 2026 14:27
sglang-npu-bot
sglang-npu-bot previously approved these changes Aug 11, 2026
Comment thread python/sgl_kernel_npu/sgl_kernel_npu/activation/swiglu_oai_quant.py Outdated
Comment thread python/sgl_kernel_npu/sgl_kernel_npu/activation/swiglu_oai_quant.py Outdated
Comment thread python/sgl_kernel_npu/sgl_kernel_npu/activation/swiglu_oai_quant.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants