Also check out his nanochat repo. I used the repo, claude and shadeform to train my own mini model for about $300. Would have been less but I screwed up and let the cloud gpu rental run for a few hours even though the training run errored out.
Of course the model was dumber than GPT2 but still it was a great learning experience.
It’s been a great way for me to better understand the cloud GPU industry, learn about data collection, normalization and use agentic coding to build a side project.
One thing I’m working on is distinguishing spot vs on demand prices and listing those separately. Also, including inference pricing for non-text AI models.
What features or data would you like to see me add next?
I'm starting to add inference providers to computeprices.com, but if you even just look at GPU/hr rentals, there are some reasonable options out there.
I personally have been enjoying shadeform to build the GPU setup I like.
Yes i was surprised too. I think it's mostly newer models pushing older ones down. I think there's also a lot of competitive pressure in this market. And the GPU shortage is not really a thing anymore.
SEEKING WORK | NYC / Remote Services: Web Development, Conversion Optimization, Data/Software/Process Consulting, Fractional Tech Leadership
Hi, I’m Gene, a consultant, developer and fractional CTO with 15+ years of experience delivering technology projects that help my customers grow. Main areas of focus: b2b & b2c web apps, ecommerce experiences, and conversion focused marketing sites.
I've helped McDonald's implement a new ERP system, GE develop an investor dashboard and Amazon build custom stores for their biggest sellers. But I especially enjoy helping scrappy startups and small businesses delight their users and convert them into long term clients.
Of course the model was dumber than GPT2 but still it was a great learning experience.