Skip to content

Remove the Gemma hard memory ceiling#310

Merged
8Dionysus merged 1 commit into
mainfrom
codex/llama-owner-memory-20260715
Jul 15, 2026
Merged

Remove the Gemma hard memory ceiling#310
8Dionysus merged 1 commit into
mainfrom
codex/llama-owner-memory-20260715

Conversation

@8Dionysus

Copy link
Copy Markdown
Owner

Summary

  • clear inherited hard memory caps for the selected Gemma 4 E2B llama.cpp lane with an explicit unlimited override
  • keep the 4 GiB soft reclaim reservation and owner-native 600-second idle sleep
  • align the existing runtime policy, tuning docs, model card, contract test, changelog, and repo-local KAG indexes

Why

The Gemma overlay previously replaced an inherited 12 GiB candidate ceiling with an 8 GiB ceiling. This important inference lane already has a measured owner-native release path: idle sleep unloads model and KV residency, while real requests wake it. A private hard ceiling can therefore force reclaim without providing the useful lifecycle action.

This PR changes source truth only. It does not sync the deploy mirror or recreate the running container.

Validation

  • python scripts/validate_stack.py
  • focused compose and service-policy tests
  • full intel-federation source render: mem_limit=0, mem_reservation=4g, native sleep command retained
  • pinned repo-local KAG index-family parity check
  • all validation launched through abyss-machine resource launch; largest peak was 221.3 MiB with zero swap

Known base debt: python scripts/ci_gate.py --mode source-fast stops on pre-existing required-snippet drift in mcp/services/aoa-kag-mcp/AGENTS.md; this PR does not touch that owner surface.

@8Dionysus
8Dionysus marked this pull request as ready for review July 15, 2026 19:14
@8Dionysus
8Dionysus merged commit fb7ed9a into main Jul 15, 2026
4 checks passed
@8Dionysus
8Dionysus deleted the codex/llama-owner-memory-20260715 branch July 15, 2026 19:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant