Datasheet · A prompt line
Let's think step by step
Let's think step by step.
Folklore, as cited: Kojima et al., 2022, Large Language Models are Zero-Shot Reasoners
Changes nothing that matters on DeFi maths, Haiku 5.5 with thinking off.
DeFi maths, Haiku 5.5 with thinking off
Pooled across 3 notebooks: −1.4 points, 95% interval −3.6 to +0.9; measured once.
- UNRESOLVEDNotebook #003−2.1 points (−6.1 to +2.0), 432 pairs, cost ×1.00signed verdict 13
- INERTNotebook #005−0.2 points (−4.2 to +3.7), 432 pairs, cost ×0.99signed verdict 21
- UNRESOLVEDNotebook #007−1.7 points (−5.4 to +1.9), 432 pairs, cost ×1.02signed verdict 32
Measure it in a setting it has not been measured in: propose it. As JSON for an agent: /v1/parts/d47935e0024f0eec. Every part: the atlas.