Skip to content

Commit 0428ecc

Browse files
reid-spencerclaude
andcommitted
Record the rc.24 certification: floors 2903/917/2864
Cold cache (116K -> 269M), all three platforms compiling, zero "No tests to run". The delta was +65 / +14 / +65 and reconciled exactly to a prediction written down before the run. Also records a failure mode this page did not have: a corpus suite went red mid-run because the CORPUS MOVED. Root2JsonCorpusTest failed on reactive-bbq, and re-running it alone read 190/190 clean -- riddl-models had committed twice during the certification, one of them converting that very model. Nothing in riddl changed. The check is one command against the sibling repo's log, and it is decisive. Deliberate failures are 190: 189 in commands and 1 in riddlc, the latter being riddl-examples' dokn failing on exactly 5 set-after-morph errors. Both are corpus cost from rules that shipped after rc.23, and both are confirmed by message rather than by count. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
1 parent 9e0ef97 commit 0428ecc

1 file changed

Lines changed: 44 additions & 5 deletions

File tree

.claude/skills/rc/SKILL.md

Lines changed: 44 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -154,9 +154,34 @@ certified nothing.
154154

155155
| Row | Minimum | Suites |
156156
|---|---|---|
157-
| JVM | **2838** | 7 |
158-
| JS | **903** | 5 |
159-
| Native | **2799** | 7 |
157+
| JVM | **2903** | 7 |
158+
| JS | **917** | 5 |
159+
| Native | **2864** | 7 |
160+
161+
**Raised at 2.0.0-rc.24 (2026-08-24) to 2903 / 917 / 2864**, cold cache
162+
(`/tmp/sbt-verify-rc24`, 116K -> 269M), all three platforms compiling, zero `No tests to
163+
run`. The delta was **+65 / +14 / +65**, predicted to the case: 14 shared cases in
164+
`passes/src/test/scala` (`SetAndConstructorRulesTest` 9, `EmptyValueTest` +5) that every
165+
row sees, plus 51 in `commands/src/test/scala` (`DumpProjectionTest` 7, `FindCommandTest`
166+
24, `FindEditingTest` 20) that JS correctly does not, `commands` having no JS row. Fifth
167+
consecutive RC whose delta reconciled exactly against a prediction written down first.
168+
169+
**A corpus suite went red mid-run because the CORPUS MOVED, and that is a distinct
170+
failure mode from every other one on this page.** `Root2JsonCorpusTest` failed on
171+
reactive-bbq with a duplicate-on-clause error the round trip had supposedly introduced;
172+
re-running it alone afterwards read **190/190 clean**. riddl-models had committed twice
173+
DURING the certification (`a115495d`, `c42f83c5` at 15:50-15:51), one of them converting
174+
reactive-bbq's ShiftRepository. Nothing in riddl changed.
175+
176+
The corpus suites read the LIVE `../riddl-models` checkout, so a long certification is
177+
not a snapshot: **the tree can differ between the leg that reads it and the leg that
178+
reads it next.** Two consequences worth keeping:
179+
180+
- **Before treating a corpus failure as a regression, check `git -C ../riddl-models log`
181+
for commits timestamped inside your run.** That is one command and it is decisive.
182+
- **Re-check on a FRESH cache** (the corpus is not in the cache key, so a warm store
183+
replays the old verdict — a stale FAILURE as readily as a stale pass), and record which
184+
corpus commit the result belongs to.
160185

161186
**Raised at 2.0.0-rc.23 (2026-08-24) to 2838 / 903 / 2799**, cold cache
162187
(`/tmp/sbt-verify-rc23`, 140K -> 265M), zero failures, zero `No tests to run`. The delta
@@ -254,8 +279,22 @@ and rc.15's own four items all landed in between). **A floor that lags is a
254279
weaker gate than one that tracks**, since a skipping bug hides in the slack;
255280
raise it every time, even when nothing else about the run is interesting.
256281

257-
**The deliberate-failure count is 189 as of 2026-08-24, and every one is corpus cost from the
258-
every-field constructor rule.** `RiddlModelsRoundTripTest` fails at "Step 1 (validate original)"
282+
**The deliberate-failure count is 190 as of 2.0.0-rc.24 (2026-08-24): 189 in `commands` and
283+
1 in `riddlc`, all corpus cost from the two rules that landed after rc.23.**
284+
285+
`RiddlModelsRoundTripTest` fails at "Step 1 (validate original)" for **189 of 190** models --
286+
riddl-models has 2,309 partial constructors and 115 set-after-morph sites. `RunRiddlcOnLocalTest`'s
287+
**`dokn`** fails with exit 7 on exactly **5** `may not follow the 'morph'` errors, which is
288+
riddl-EXAMPLES' share of the same bill. `utils`, `language`, `passes`, `testkit` and `riddlLib` are
289+
fully green on every platform, and `riddlLib` reads **190/190** on both validation parity and JSON
290+
identity.
291+
292+
**Confirm a red case by its message before accepting it** -- `does not supply N field` or
293+
`may not follow the 'morph'`. Anything else is a regression. Verify `dokn` by RUNNING it
294+
(`riddlc from .../dokn.conf validate`), because the suite reports only the exit code: an
295+
exit 7 for a different reason looks identical.
296+
297+
**Historical (superseded): it was 189 and `commands`-only.** `RiddlModelsRoundTripTest` fails at "Step 1 (validate original)"
259298
for 189 of 190 models because riddl-models has **2,309 partial constructors** that the rule now
260299
rejects. `language`, `passes` and `riddlLib` are fully green; only `commands` is red.
261300

0 commit comments

Comments
 (0)