eval: round 15 prep (board task, six-arm references, r15 fuzz rules, prereg draft) by ryansolid · Pull Request #71 · solidjs/reactivescript

ryansolid · 2026-11-14T12:42:23Z

This branch prepares round 15, the six-arm, two-task round meant for publication. Every task now has a reference that grades 0 in every arm.

What's in it

New held-out task tasks/board. A sprint board with:
- brief (approved), API, fixtures;
- tests: visible 26, hidden 45, overlap 26;
- harness/fuzz-board.mjs, the server model plus oracles. Allowances B1 and B2 are documented at the top of the file. It also checks each card's count against the server.
Board references, all graded 0 (hidden 45/45, overlap 26/26, 0/60 fuzz seeds):

arm lines

rx 547

react 681

contract 510

xstate 890

foldkit 1293

vanilla 752
desk9 references for react, xstate, foldkit and vanilla, all graded 0.
Rulings now in the harness:
- fuzz.mjs --r15 drops A2: at rest, a field must show the server's last answer.
- A4 now also covers the detail, labels, comments and two-views checks for writes that land after their page was left.
- grade.sh takes TASK= and FUZZ_ROUND=.
Solid repros:
- results/r15prep/repro/stale-heading-after-select.spec.tsx ([next] After a selection change, a heading reading a guess shows the previous selection's value while its memo has the new one solid#4856, fixed);
- stale-label-under-guess.spec.tsx ([2.0] Loading on(key): with a guess out, a new key shows the old async answer under the new key, and a declined guess waits on the new fetch solid#4859, open).
PREREG-15.md, a DRAFT, not frozen. It sets out the arms, builds (released only), grading, 144 runs, the H15a/b/c hypotheses and known caveats.

Not in it

No agent runs. The prereg must be reviewed and frozen first.

Generated by Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

A write that lands after its page was left is not judged on the next visit (Ryan 2026-11-14: late writes are out of scope). A4 was only applied to rows. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…XState references follow it Ryan 2026-11-14: with two accepted writes to one field, the server's last answer is the only correct value at rest. --r15 drops allowance A2; FUZZ_ROUND=--r15 sh harness/grade.sh. All six desk9 references grade 0 under it (20 seeds; React, Exact, XState, Foldkit and vanilla also 0/60 on seeds 21-80). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…erence, fuzz seed 45) Also replay.mjs: DW=<n> widens the detail text it prints. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…ence (grades 0) Brief frozen 2026-11-14 (Ryan). 26 visible, 45 hidden, 26 overlap tests; fuzz-board.mjs with oracles for duplicates, headings, counts, the work-in-progress limit, the detail, and settled state. TASK=board sh harness/grade.sh grades it. The fuzzer catches two planted bugs in the reference (limit off by one, an accepted toggle not kept). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…el under a pending guess Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…rite visit Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…15 prereg draft Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

cloudflare-workers-and-pages · 2026-11-14T12:43:03Z

🚀 Deploying Preview to Cloudflare 🚀

Preview Deployments by commit

Status	Commit	Updated (UTC)	See this deployment's details
Build: Failed ❌ View logs ↗	`d2bfd96`	2026-11-15T12:09:11.263Z	View logs ↗
Build: Failed ❌ View logs ↗	`20589f4`	2026-11-15T10:16:49.882Z	View logs ↗
Build: Failed ❌ View logs ↗	`8876be0`	2026-11-15T09:48:02.523Z	View logs ↗
Build: Failed ❌ View logs ↗	`4a2b41a`	2026-11-15T09:38:25.211Z	View logs ↗
Build: Failed ❌ View logs ↗	`4a192c5`	2026-11-15T09:37:17.457Z	View logs ↗
Build: Failed ❌ View logs ↗	`2bd5cd9`	2026-11-15T06:15:33.216Z	View logs ↗
Build: Failed ❌ View logs ↗	`c58dba7`	2026-11-15T06:12:44.183Z	View logs ↗
Build: Failed ❌ View logs ↗	`a78c746`	2026-11-15T05:56:47.277Z	View logs ↗
Build: In progress 🔵 View logs ↗	`38b2125`	2026-11-15T05:55:32.033Z	View logs ↗
Build: Failed ❌ View logs ↗	`b5ddae5`	2026-11-15T03:41:51.552Z	View logs ↗

View all previews: View all previews ↗

… answered add's placeholder while work is in the air Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…4861-#4864 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…, minimal trail) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…s/solid#4874, rx runtime catchRead, pending probe) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…); guide: one store over the server - Runtime: `catchRead` with no observer (a component fn called from a handler or action) is a snapshot (04 R-8): the committed value, or the alternative on a matching failure. A fresh error boundary there had no value while a refresh was out and threw NotReadyError (S-catch-snapshot). - Checker (ref/ and crate): ARGUMENT_COUNT (06 AC-1f) for a call of a declared action with the wrong number of arguments; `props` in `component C()` is UNBOUND (03 RG-4b). AST gains `noProps`. S-check-1 rejected variants, a check.rs unit test, guide/diagnostics.md sections. - pending? inside a held `loading on(sel)` region reads false: Solid's, under 05 DV-22 (plain-Solid repro saved). Guide and GUESS_WHILE_LOADING text say to test `pending? x` in the handler too (R-12). - guide/async.md: "One store over the server". Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…k shown column), fuzz B3 declined count hold, repro for solidjs/solid#4887 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…on, two Solid repros Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…and by key; record seed) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…(seed 28); repro for solidjs/solid#4897 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…re-ask the row's current answer; task-neutral examples Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

…/60 on next 3dd86e8f2 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

claude added 15 commits November 14, 2026 05:57

eval: React reference for desk9 (grades 0: 77/77, 38/38, 0/20)

1ed421e

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: desk9 XState reference (grades 0)

91ec6ae

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: desk9 vanilla reference (grades 0)

f072d16

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: desk9 Foldkit reference (grades 0)

8e67b41

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: plain Solid repro of a stale heading after select (rx desk9 ref…

274f306

…erence, fuzz seed 45) Also replay.mjs: DW=<n> widens the detail text it prints. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board .rx reference (grades 0) + plain-Solid repro of stale lab…

6ba2af8

…el under a pending guess Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: fuzz-board B1 also exempts the duplicate-card check in a late-w…

ea24896

…rite visit Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board vanilla reference (grades 0)

882172f

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board XState reference (grades 0)

2df041f

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board Foldkit reference (grades 0)

0cba38d

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board Exact (contract) reference (grades 0)

1074753

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board fuzz checks every card's count against the server; round …

7278c87

…15 prereg draft Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

claude added 14 commits November 14, 2026 17:00

eval: fuzz-board B3, legal holds (as desk9 A1/A5): held detail and an…

a169017

… answered add's placeholder while work is in the air Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: prereg records the Exact move-error limit (Ryan's call)

f9edf8f

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: guide-shaped .rx board (rx-guide) and repros for solidjs/solid#…

edde969

…4861-#4864 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: repro for the page hang from solid 9e02d02a8 (board guide shape…

2d3b0eb

…, minimal trail) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: idiomatic one-store .rx board (rx-store) and its repros (solidj…

fbf898d

…s/solid#4874, rx runtime catchRead, pending probe) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: store board fixes (placeholder list, pending? in handlers, reas…

b5ddae5

…k shown column), fuzz B3 declined count hold, repro for solidjs/solid#4887 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: board .rx placeholder back in the store, per-column store versi…

38b2125

…on, two Solid repros Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: rx-cols grade notes

9a7b294

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: rx-store grade notes

a78c746

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

ST-4a: a key applies at any depth, as Solid's (lists under a record l…

c58dba7

…and by key; record seed) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: repros for solidjs/solid#4888 and #4889

2bd5cd9

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: rx-cols re-asks the card's server column after a move's answer …

4a192c5

…(seed 28); repro for solidjs/solid#4897 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: seed 41 traced to solidjs/solid#4897 (declined variant)

4a2b41a

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

claude added 3 commits November 15, 2026 09:47

guide: one keyed store per fetch; moves guess each list they change; …

8876be0

…re-ask the row's current answer; task-neutral examples Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

prereg: shared-list holds excluded as by design (Ryan, 2026-11-15)

20589f4

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

eval: rx-cols re-asks every column whose answer has the moved card; 0…

d2bfd96

…/60 on next 3dd86e8f2 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

Navigation Menu

Repository navigation

eval: round 15 prep (board task, six-arm references, r15 fuzz rules, prereg draft) - #71

eval: round 15 prep (board task, six-arm references, r15 fuzz rules, prereg draft)#71
ryansolid wants to merge 32 commits into
mainfrom
claude/project-thread-xp2irv

ryansolid commented Nov 14, 2026

Uh oh!

cloudflare-workers-and-pages Bot commented Nov 14, 2026 •

edited

Loading

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

arm	lines
rx	547
react	681
contract	510
xstate	890
foldkit	1293
vanilla	752

Conversation

ryansolid commented Nov 14, 2026

What's in it

Not in it

Uh oh!

cloudflare-workers-and-pages Bot commented Nov 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚀 Deploying Preview to Cloudflare 🚀

Preview Deployments by commit

View all previews: View all previews ↗

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

cloudflare-workers-and-pages Bot commented Nov 14, 2026 •

edited

Loading