Skip to content

S8: Decision-grade benchmarks and Track 1 qualification (gate fail — no main merge) - #9

Merged
fraware merged 3 commits into
engineering/stabilization-moreaufrom
engineering/s8-benchmark-qualification-release
Jul 22, 2026
Merged

fraware merged 3 commits into
engineering/stabilization-moreaufrom
engineering/s8-benchmark-qualification-release

Conversation

@fraware

@fraware fraware commented Jul 22, 2026

Copy link
Copy Markdown
Owner

Summary

  • Decision-grade workload matrix (scripts/decision_grade_benchmark.py) with e2e/solver/setup/verification/IPC timing, p50/p95/p99/max, failures/fallbacks, and explicit NOT_RUN for unavailable Moreau/CUDA/live-sidecar arms.
  • Committed reports under benchmarks/reports/s8_qualification/; Track 1 completion report (15 sections), production qualification report, migration guide, CHANGELOG + PUBLIC_CLAIMS updates.
  • Release gate: FAIL — do not merge integration to main. Blockers: vendor CI real-solve attestation, heterogeneous batch parity on vendor host, verify-v1-lock cadence risk. See docs/stabilization/RELEASE_GATE_EVALUATION.md.

Context

  • S7 merge SHA: d7f1da4
  • All P0s 001–007 fixed in ledger

Test plan

  • pytest tests/stabilization/test_s8_decision_grade_report.py
  • python scripts/check_public_claim_phrases.py
  • conicshield.published_runs.cli verify host-realistic-20260525
  • Vendor CI evidence gate on licensed host (not attested here)
  • Do not merge engineering/stabilization-moreau → main until gate passes

fraware added 3 commits July 22, 2026 16:39
…rts.

Record measured public-path latency with explicit NOT_RUN for unavailable vendor/CUDA/sidecar arms; keep main merge blocked pending vendor attestation and v1-lock cadence.
@fraware
fraware merged commit 6e7f7d8 into engineering/stabilization-moreau Jul 22, 2026
2 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant