And yeah, token usage as a KPI is a trend I notice across orgs too. Mostly in the 'hypomania' stage where the company is blind to the ROI they're getting out of AI. In saner companies, at least short-term, the human arbitrage should get realised during cooldowns like this. But then again, we're just a few cycles away from better quantization and efficient inference engines. Meaning, relaxed token limits. Also, there's local models getting on par with cloud models. At a point, the quota friction will disappear. The measure will get normalised! That's a hard thing to imagine tbh.
Thanks for this lens. This means, we are indeed structurally entering a state of dissociation with surplus capital and AI-enabled 'bandwidth' being the catalysts. The only friction is compute.
Hey brad. Love your blog's layout. The neon sign headings are so catchy! And I'm going through some tough times in my life, and I can totally relate how cathartic the process of 'creation' is. Thanks for sharing!
You'd be surprised that there are folks on this planet who love em dashes. I'm one of them and I used to write a lot with em dashes, but stopped using it altogether in the past few years because of AI.
Dealing with some rough stuff in life so I'm involved in random stuff to distract myself. Moved my personal blog to Astro. I wanted to scratch and itch I had about self hosting my comments. So I built a lightweight node-based opensource comment system called discuss - https://github.com/karthikeyankc/discuss.
And yeah, token usage as a KPI is a trend I notice across orgs too. Mostly in the 'hypomania' stage where the company is blind to the ROI they're getting out of AI. In saner companies, at least short-term, the human arbitrage should get realised during cooldowns like this. But then again, we're just a few cycles away from better quantization and efficient inference engines. Meaning, relaxed token limits. Also, there's local models getting on par with cloud models. At a point, the quota friction will disappear. The measure will get normalised! That's a hard thing to imagine tbh.