Demo-cache floor
The model alone, shown every demonstration it bought for the task again for free.
- Share learned
- +0.24 ±0.08
- Stream, budget used
- 27.4 solved 84%
- Epilogue, budget used
- 42.4 solved 74%
- Model spend
- $2.96 1,610 calls
- Instances
- 300 14.1 hours
Budget used is the share of the cap of 16 that an instance was charged, averaged over the instances: a solved instance costs 1 for each wrong answer and each demonstration, an unsolved one all 16, so lower is better. The share learned reads the stream's budget against the learner itself reset, the same system wiped before every instance of the same stream: the share of the budget left to learn that the learner saves, 0 for a learner that keeps nothing and 1 for perfect memory.
- Workstreams
- Fresh
- Stateless floor
- Demo-cache floor
- Program library
- Prime Agent
- Hermes Agent
- OpenClaw