Feat/qwen3.6#126
Conversation
Registry: new xlarge-tier Qwen3.6-27B-MTP-UD-Q4_K_XL entry with no-artifacts lens status and download_url=None (manual download). Inference: bump llama.cpp to 25558268 (MTP merge, PR #22673). Regenerate PC-202 expose-hidden-states.patch for the new upstream where server-context.cpp gained cstddef/cinttypes includes and renamed ctx→ctx_tgt / model→model_tgt. macOS launcher: gate --spec-type draft-mtp --spec-draft-n-max 2 behind ATLAS_ENABLE_MTP=1 in atlas-llama-macos.sh. MTP is default off — net throughput loss on Apple Metal (llama.cpp #23752). Lens: train cost_field.pt for 5120-dim Qwen3.6-27B residuals (200 epochs, contrastive ranking loss). Metric tensor is a placeholder — G(x) scoring uses XGBoost, not the legacy tensor. Doctor lens_weights check still requires metric_tensor.pt on disk. Tests: 97/97 pass (4 new Qwen3.6-specific assertions).
|
Thanks for the Qwen3.6-27B work! Before we can land the model in the registry so others can use it, we need the Hugging Face links for the artifacts — the entry is currently incomplete:
Good news: the lens/ASA publish pipeline is working now — the gemma-4-12b registry PR (#123) went through cleanly, so there were fixes that should make this smooth for you. The full end-to-end flow is documented here: https://github.com/itigges22/ATLAS/blob/main/docs/PUBLISHING.md — Once the artifacts are uploaded and the registry entry has the real URLs, I can add it to the registry / main dataset and validate it end-to-end. Appreciate it! |
- model_registry: add download_url and sha256 for Qwen3.6-27B-MTP-UD-Q4_K_XL - expose-hidden-states.patch: add server-task.cpp serialization hunk (hidden states were captured in C++ structs but never returned in JSON)
ASA control vector for Qwen3.6-27B-MTP-UD-Q4_K_XLUploaded to https://huggingface.co/yogthos/atlas-asa-qwen36-27b-mtp-ud-q4_k_xl
|
Lens artifacts for Qwen3.6-27B-MTP-UD-Q4_K_XLUploaded to https://huggingface.co/yogthos/atlas-lens-qwen36-27b-mtp-ud-q4_k_xl
|
|
These ASA and lens should work. |
# Conflicts: # atlas/cli/commands/model_registry.py # tests/cli/test_model.py # tests/cli/test_model_registry.py
metric_tensor.pt was committed as a 0-byte file. Lens scoring uses cost_field.pt, so it was dead weight that atlas lens publish would also sweep into the upload. Notes claimed no ASA vector was trained, but ast_edit_steering.gguf (layer 27) exists locally — corrected to say the lens C(x) and ASA vector are both trained-but-unpublished and the G(x) classifier half is still untrained.
Uploaded the ast_edit_steering.gguf (layer 27, 5120-dim) to huggingface.co/yogthos/atlas-asa-qwen3.6-27b-mtp-ud-q4_k_xl and pointed the registry entry at it: asa_status=supported, asa_hf_repo, and asa_artifact_files. Lens stays no-artifacts — the C(x) field is trained locally but unpublished and the G(x) classifier half isn't trained yet, so that ships in a follow-up via atlas lens publish.
|
Rebased on main (the gemma-4-12b registry entry from #123 conflicted with the Qwen3.6 entry — both kept, registry is 8 entries now) and pushed an update. Status against the asks:
Also dropped an empty 0-byte `metric_tensor.pt` that had been committed by accident. So this PR lands the model + ASA; the lens follows once G(x) is trained. |
|
Marking blocked pending rework — dev's artifact contract moved under this PR (it's also in conflict). What a mergeable version needs:
The registry entry itself (pinned URL + sha256 + honest |
Registry: new xlarge-tier Qwen3.6-27B-MTP-UD-Q4_K_XL entry with no-artifacts lens status and download_url=None (manual download).
Inference: bump llama.cpp to 25558268 (MTP merge, PR #22673). Regenerate PC-202 expose-hidden-states.patch for the new upstream where server-context.cpp gained cstddef/cinttypes includes and renamed ctx→ctx_tgt / model→model_tgt.
macOS launcher: gate --spec-type draft-mtp --spec-draft-n-max 2 behind ATLAS_ENABLE_MTP=1 in atlas-llama-macos.sh. MTP is default off — net throughput loss on Apple Metal (llama.cpp #23752).
Lens: train cost_field.pt for 5120-dim Qwen3.6-27B residuals (200 epochs, contrastive ranking loss). Metric tensor is a placeholder — G(x) scoring uses XGBoost, not the legacy tensor. Doctor lens_weights check still requires metric_tensor.pt on disk.