Tangent, but I’m really curious what country you’re from that uses the endonym for Göteborg but then also spells the capital of Denmark like Kopenhagen?
> You will encounter business decisions you think are terrible but you still have to sell to your team. You cannot vent your frustration to the people you lead.
I actually disagree with this point a lot, as an IC. My manager shares his honest opinions with us, and I respect him more for it. It seems like the rest of the team feels the same.
I’ve had managers try to sell <obviously bad thing> as something good for the team, and it sucks. It feels like being gaslit. I think honest, open communication is a much better way to run a team. We’re all adults and professionals too; we can handle the truth.
It seems like based on e.g. [1] the article originally made some stronger claims about “no difference in bugs” that have been corrected. I agree that now it seems fine, but those edits might be why it feels like some commenters read a different article than you.
Curious how you’re handling prompt caching, as I understand it most LLM providers essentially inject tool definitions in the system prompt, so changing tools dynamically breaks the cache. This has been a big annoyance for me in a separate project; I currently just implemented my own tool-ish system that defines schemas in user messages and instructs the LLM to return matching JSON, but it’s less reliable than using the native tool calling + structured outputs available in the API.
> That's it. No rate limiting. No account lockout.
To me, if he confirmed that there’s no rate limiting on the auth API, this implies a scripted approach checking at least tens (if not more) of accounts in rapid succession.
It isn't a perfect fit, since the article talks a lot about the scientific method which doesn't apply super well to philosophy+math, but I think there are some strong parallels here.
Looks cool! Does it support prompt caching? And do you have any data showing how your latency compares to going directly to the model providers? I’m thinking about trying it out but those are my two big reservations.