Prime Agent, memory wiped
Everything the harness wrote deleted before every instance.
- Share learned
- 0 its own reset
- Stream, budget used
- 23.6 solved 94%
- Epilogue, budget used
- 26.6 solved 89%
- Model spend
- $3.22 2,495 calls
- Instances
- 300 11 hours
Budget used is the share of the cap of 16 that an instance was charged, averaged over the instances: a solved instance costs 1 for each wrong answer and each demonstration, an unsolved one all 16, so lower is better. The share learned reads the stream's budget against the learner itself reset before every instance, and this learner keeps nothing between instances, so it is its own reset and reads 0.