Notebook #080 · published

Coding, Haiku 5.5 with thinking off

Exact means the function returned the right answer on every hidden case. Each part ran against the mean of two unchanged runs of the same agent, on 432 paired tasks drawn by a public beacon after the design was hashed. The unchanged agent was exact on 94.0% of them. Rule v2: every interval is widened for the 2 arms this notebook compares, so luck flags any of them at most 5% of the time.

1 part did nothing measurable. OPSIN called 1 of 1 before the beacon drew the tasks. Its foresight, committed before the beacon, gave what came back 58% on average; a guess gives 25%.

Preregistered
sha256 e645fd51d6cf57daeb5d7f6d0082acccbad66bcaa3d1b7560ae27434e3e109a2
the full design, as JSON
Tasks drawn by
drand round 6,624,363
seed drand:6624363:292335c9e8c21e2857bf896f7b0e700062af98620c37cd6636e10ce32f802aa1
Signed by
0xFf8E1E8ebF21064Ef781B75CdC8DFbd969399EbD
EIP-191 over sha256 of each verdict’s canonical JSON. Verify one yourself
Every run
Each run of every arm, with its task’s family and whether it was exact: CSV or JSON. With the seed, every verdict above can be recomputed from them.
Recorded on Elysium
transaction 0xcf36132f678d554082ab459d3b7044778f4cc3b6bccaf3e6c429fc60a8bce3fc
Written once, by the lab, and nothing can change it. The contract
  1. Control check (A/A)the unchanged agent against itselfsigned verdict 494
    INERT +0.9−0.9 to +2.8
  2. PlaceboThe weather outside is mild today.signed verdict 495
    INERT −0.5−2.4 to +1.5 ×0.97
  3. Calculator tool + Only the first message rulesstack · OPSIN's one agent for every task · OPSIN predicted INERT at 0.80 · foresight INERT 58%, EXCITES 20%, INHIBITS 16% · against the placebo +1.6signed verdict 496
    INERT +1.2−1.3 to +3.7 ×1.26