Sglang l3005 by A6444 · Pull Request #1033 · Ascend/sglang

A6444 · 2026-07-20T02:59:43Z

Motivation

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Format your code according to the Format code with pre-commit.
Add unit tests according to the Run and add unit tests.
Update documentation according to Write documentations.
Provide accuracy and speed benchmark results according to Test the accuracy and Benchmark the speed.
Follow the SGLang code style guidance.

Review and Merge Process

Ping Merge Oncalls to start the process. See the PR Merge Process.
Get approvals from CODEOWNERS and other reviewers.
Trigger CI tests with comments or contact authorized users to do so.
- Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

CI States

Latest PR Test (Base): ❌ Missing run-ci label -- add it to run CI tests.
Latest PR Test (Extra): ❌ Blocked -- run-ci is required first.

ascend-robot · 2026-07-20T02:59:54Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-21T03:36:35Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-23T11:46:48Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-24T03:18:19Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-24T03:38:49Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

shun8686 · 2026-07-24T06:39:52Z

The model used in the test case is Qwen3.6, and the test case file name is Qwen3_5.

Script name has been modified

shun8686 · 2026-07-24T07:14:30Z

The class variable kl_div_thres belongs to KLDivergenceMixin, so why isn't it inheriting from KLDivergenceMixin?

The product does not support KLDivergenceMixin at present,and the leader has confirmed it

shun8686 · 2026-07-24T07:27:15Z

+# Test configuration constants
+BASE_MODEL = LLAMA_2_7B_HF_WEIGHTS_PATH
+LORA_PATHS = [LLAMA_2_7B_LORA_TRIVIA_QA_WEIGHTS_PATH]
+LORA_BACKEND = "triton"


Use triton or ascend?

LORA_BACKEND = "ascend" is unstable to the Dense model(LLMA-2-7B),resulting in the incorrect loading of LoRA adapter of some prompt.Triton backend verfied to be stable.

shun8686 · 2026-07-24T07:29:17Z

+        engine.shutdown()
+        self.assertEqual(out1, out2)
+
+    def test_8_engine_async_encode_consistency(self):


test_6 to test_8，not test_7?

Test_7 has been deleted,This has been aligned with PL.

shun8686 · 2026-07-24T07:32:52Z

Missing necessary testcase comments

The necessary comments has been added

ascend-robot · 2026-07-24T08:01:14Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-25T09:16:56Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-25T09:20:13Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-27T02:23:43Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

shun8686 · 2026-07-27T03:14:27Z

+            repo_type="dataset",
+        )
+
+        os.environ["SGLANG_SKIP_REMOTE_CODE_REGISTRATION"] = "true"


Remove the env var.

ascend-robot · 2026-07-27T03:41:41Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-07-27T06:28:35Z

CLA Signature Guide

@A6444 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
1a2b656a GPU case transplantation	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
8b87e696 Merge branch 'testcases' into sg...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

A6444 added 2 commits July 20, 2026 10:45

GPU case transplantation

1a2b656

GPU case transplantation

df4828a

ascend-robot added the ascend-cla/no label Jul 20, 2026

github-actions Bot added the npu label Jul 20, 2026

GPU case transplantation

37c0b4f

GPU case transplantation

9b6e50b

github-actions Bot added the lora label Jul 23, 2026

GPU case transplantation

9341ac0

GPU case transplantation

da083be

shun8686 reviewed Jul 24, 2026

View reviewed changes

GPU case transplantation

ebca16f

GPU case transplantation

171b9c1

GPU case transplantation

a9431b8

GPU case transplantation

de2acd6

shun8686 reviewed Jul 27, 2026

View reviewed changes

GPU case transplantation

87f0c80

Merge branch 'testcases' into sglang_l3005

8b87e69

cherryblo merged commit e810417 into Ascend:testcases Jul 27, 2026
8 checks passed

Uh oh!

Conversation

A6444 commented Jul 20, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

CI States

Uh oh!

ascend-robot commented Jul 20, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 21, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 23, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 24, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 24, 2026

CLA Signature Guide

Uh oh!

Choose a reason for hiding this comment

Uh oh!

A6444 Jul 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

A6444 Jul 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

shun8686 Jul 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ascend-robot commented Jul 24, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 25, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 25, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 27, 2026

CLA Signature Guide

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ascend-robot commented Jul 27, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Jul 27, 2026

CLA Signature Guide

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

A6444 commented Jul 20, 2026 •

edited by github-actions Bot

Loading

A6444 Jul 24, 2026 •

edited

Loading

A6444 Jul 25, 2026 •

edited

Loading

shun8686 Jul 24, 2026 •

edited

Loading