Skip to content

feat(qwen3.8): add Huihui abliterated FP8 dual profile - #1074

Open
kodcuserkan wants to merge 2 commits into
noonghunna:masterfrom
kodcuserkan:feat/qwen38-huihui-fp8
Open

feat(qwen3.8): add Huihui abliterated FP8 dual profile#1074
kodcuserkan wants to merge 2 commits into
noonghunna:masterfrom
kodcuserkan:feat/qwen38-huihui-fp8

Conversation

@kodcuserkan

@kodcuserkan kodcuserkan commented Aug 20, 2026

Copy link
Copy Markdown

Summary

Type of change

  • New compose variant (models/<model>/<engine>/compose/docker-compose.<name>.yml)
  • New patch / sidecar (models/<model>/<engine>/patches/)
  • New script or tool (scripts/, tools/)
  • New model (models/<new-model>/)
  • Doc-only / typo
  • Other (describe)

Verification

  • Full rig + validation report attached — single command captures everything:
    bash scripts/report.sh --full > my-rig.md
    Runs hardware + stack + boot log capture plus verify-full + verify-stress 7/7 + SOAK_MODE=continuous + canonical bench in one ~35-min pass. Paste contents as a PR comment. See docs/CLIFFS.md for why the soak-continuous step is load-bearing (catches Cliff 2b, which verify-stress doesn't).
  • Profile header complete (new/changed compose) — # Profile (at-a-glance): block with Status: set to one enum value (/⚠️/🧪/👁️/⏸️/🗑️) and a Caveats: line if ⚠️/👁️/⏸️/🗑️. Enforced by test-compose-status-drift; schema in CLAUDE.md.
  • BENCHMARKS row added — under the appropriate model section, mirroring existing column shape (incl. Rig column).
  • CHANGELOG entry added in models/<model>/CHANGELOG.md.

If you'd rather run the steps separately:

  • bash scripts/report.sh > my-rig.md (rig only, ~2 sec)
  • bash scripts/verify-full.sh — fast functional smoke
  • bash scripts/verify-stress.sh — 7/7 boundary checks incl. Cliff 2 needles
  • SOAK_MODE=continuous SOAK_SESSIONS=5 SOAK_TURNS=5 bash scripts/soak-test.sh — required for new single-card composes (catches Cliff 2b)
  • bash scripts/bench.sh — canonical TPS (3 warmups + 5 measured)

N/A justifications (if any boxes above are unchecked)

Cross-links

  • Closes #
  • Related upstream:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant