mirror of
https://github.com/proffesor-for-testing/agentic-qe.git
synced 2026-09-19 08:45:47 +08:00
db2db9dab8
2026-06-29 oracle bench (8 fixtures, mutation>=60%) on the same Mac Ollama: qwen3-coder:30b and qwen3:30b-a3b score IDENTICALLY (both 6/8, 75% avg mutation kill, same fixtures pass/fail) — same 30B MoE class and RAM — but the code-tuned model is ~14x faster wall-clock (5.2s vs 71.1s/gen) because it does not spend ~70s "thinking" before answering. Records both measurements in value-score.ts (incl. stock qwen2.5-coder:1.5b = 1/8, confirming size still dominates coder-tuning at tiny scale). qwen3:8b stays off-default (3/8 across the same fixtures). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>