Hermes Agent, memory wiped
Everything the harness wrote deleted before every instance.
- Share learned
- 0 its own reset
- Stream, budget used
- 43.8 solved 73%
- Model spend
- $15.86 34,182 calls
- Instances
- 200 20.8 hours
Budget used is the share of the cap of 16 that an instance was charged, averaged over the instances: a solved instance costs 1 for each wrong answer and each demonstration, an unsolved one all 16, so lower is better. The share learned reads the stream's budget against the learner itself reset before every instance, and this learner keeps nothing between instances, so it is its own reset and reads 0.