Prime Agent, memory wiped
Everything the harness wrote deleted before every instance.
- Share learned
- 0 its own reset
- Stream, budget used
- 47.2 solved 69%
- Epilogue, budget used
- 58.1 solved 56%
- Model spend
- $2.51 3,822 calls
- Instances
- 300 7 hours
Budget used is the share of the cap of 16 that an instance was charged, averaged over the instances: a solved instance costs 1 for each wrong answer and each demonstration, an unsolved one all 16, so lower is better. The share learned reads the stream's budget against the learner itself reset before every instance, and this learner keeps nothing between instances, so it is its own reset and reads 0.