When I was at Peloton a long time ago, someone proposed an April Fools’ joke where we could announce a dynamo add-on that would let you power your house from your bike.
The math isn’t as bad as you might think: 200Wh (about a 60 min, somewhat intense ride) seems to be about 20 minutes for a H/B100. Still 3x, but not bad at all!
I remember the idea being dismissed quickly because people would likely actually want it.
> High interaction volume (1k+ chat sessions per month)
I don't mean to be that typical HN commenter but you did lose me a bit there.
I know a lot of people are just getting started with agents but even for a lot of scrappy startups usage is a lot higher than that!
If I may suggest focusing on explaining how you can add value even when usage is super low to controlling costs even when usage can get super high?
I can validate you that it is a true problem that's solved by large companies but you have to hand-roll yourself @ startups (via airflow or queues, etc). But unfortunately one where I am not sure that a lot of stakeholders understand the benefits of (yet!). I think value has to be shown a bit more clearly here, sadly.
I love DSPy! But yes, its curse is that it’s native to LLMs and makes the python side awkward and weird. I’m willing to make this prediction: It’s clearly built from first principles and the ideas from it will outlast the framework itself.
The math isn’t as bad as you might think: 200Wh (about a 60 min, somewhat intense ride) seems to be about 20 minutes for a H/B100. Still 3x, but not bad at all!
I remember the idea being dismissed quickly because people would likely actually want it.