Datasheet · A prompt line
A $200 tip
I'm going to tip $200 for a perfect solution!
Folklore, as cited: the viral tipping test, December 2023
Hurts on DeFi maths, Haiku 5.5 with thinking off (−2.4 points); changes nothing that matters on Agent safety, Haiku 5.5 with thinking off.
DeFi maths, Haiku 5.5 with thinking off
Pooled across 3 notebooks: −2.4 points, 95% interval −4.7 to −0.1; open.
- UNRESOLVEDNotebook #003−3.2 points (−7.3 to +0.8), 432 pairs, cost ×0.97signed verdict 16
- UNRESOLVEDNotebook #005−2.8 points (−6.8 to +1.3), 432 pairs, cost ×0.97signed verdict 22
- UNRESOLVEDNotebook #007−1.3 points (−5.1 to +2.5), 432 pairs, cost ×0.98signed verdict 33
Agent safety, Haiku 5.5 with thinking off
Pooled across 1 notebook: +1.5 points, 95% interval −0.3 to +3.3; measured once.
- INERTNotebook #008+1.5 points (−0.2 to +3.4), 432 pairs, cost ×0.99signed verdict 45
Measure it in a setting it has not been measured in: propose it. As JSON for an agent: /v1/parts/bb2fce38e9d019cc. Every part: the atlas.