Search results

Qwen3.6 MoE malformed XML/JSON tool calls leak as content instead of parsed tool_calls

bugSomething isn't workingSomething isn't working

Status: Open.

#141 In scouzi1966/maclocal-api;

· scouzi1966 opened on Jun 24, 2026

BatchScheduler: garbage output at high --concurrent with short/early-finishing generations (exposed by --no-think)

Status: Open.

#140 In scouzi1966/maclocal-api;

· scouzi1966 opened on Jun 21, 2026

Enhancement: Record chat sessions to disk as OpenAI-shaped JSONL (--record)

Status: Open.

#138 In scouzi1966/maclocal-api;

· jesserobbins opened on Jun 18, 2026

Pre-existing assertion failures on Qwen3.5-35B-A3B-4bit (--concurrent + --enable-grammar-constraints): streaming tool-call coercion drift + same-seed non-determinism

Status: Open.

#127 In scouzi1966/maclocal-api;

· scouzi1966 opened on May 10, 2026

KV cache quantization (--kv-bits 4) crashes server with Gemma 4

bugSomething isn't workingSomething isn't working

Status: Open.

#96 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 7, 2026

Gemma 4 batch mode: staggered-arrival padding causes SDPA precision divergence

bugSomething isn't workingSomething isn't working

Status: Open.

#93 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 5, 2026

Concurrent x8 prefix cache + grammar returns empty responses

Status: Open.

#86 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 4, 2026

Feature request: add Gemma 4 audio input support

Status: Open.

#85 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 4, 2026

Your project is featured in Awesome MLX

Status: Open.

#65 In scouzi1966/maclocal-api;

· raullenchai opened on Mar 26, 2026

GET /v1/models should list cached models from MACAFM_MLX_MODEL_CACHE

Status: Open.

#64 In scouzi1966/maclocal-api;

· scouzi1966 opened on Mar 26, 2026

Nemotron-3-Super-120B: 7 tok/s vs 33 tok/s claimed — fused MoE kernel needed

Status: Open.

#52 In scouzi1966/maclocal-api;

· scouzi1966 opened on Mar 16, 2026

Support dense Qwen3.5 model architecture (qwen3_5)

Status: Open.

#31 In scouzi1966/maclocal-api;

· jsirish opened on Mar 2, 2026