teale.com - distributed ai inference using networked devices
essentially folding@home but sharing underutilized ram (when you're asleep, someone else in the world is awake)
would really appreciate testers but also any companies thinking about distributed inference powered by their own company devices on a private network. my own company has 200+ 16gb ram machines that we're using for inference.
I built Teale.com and opensourced it. My domain contribution to society. It powers fully distributed inference on Mac, windows, Linux, android, iOS, hell even harmonyOS.
Opensource/weight models will get better and better and eventually we will have mythos level running on smartphone/eyeglass hardware.
It is stupidly tedious currently to match supply with demand though because physical hardware like a 16gb ram MacBook doesn't mean there's truly 16gb available let alone matching models and all of their settings (kvcache, context limit, temperature, etc) to demand.
Would appreciate any help cus we need ai inference by the people for the people.
We're an outsourced accounting firm specializing in property management (appfolio, buildium, rentvine) that's building an open source ai harness/orchestrator for property managers.
$7M ARR, cash flow positive, looking to re-envision marketing/growth ai native.
email taylor at the apmhelp domain or comment and i'll reach out. =)
this is awesome. i'm the founder/maintainer at teale.com (open source distributed inference app) and one of the biggest challenges has been an actually usable/reliable local model that can run on 8gb macbook air's, 6gb android smartphones, etc... will get some of our test machines serving needle
250+ employees on the lowest paid subscriptions of claude or openai is $5k/month. their usage of AI is chatbot most of the time which local models/inference can easily handle. so just being able to cancel those subscriptions with local hardware makes my break even on a single $10k mac studio 2 months and honestly the mac studio for their use is overkill.
Distributed ai inference pool for any Mac/iOS device where devices are paid for contributing unused ram. To help with the demand, also doing multiplayer AI. $0.05/million tokens - teale.com
Annecdotal here but I've been buying studios with as much ram as possible. I probably got in one of the last orders for the m3 ultra 512gb ram officially from apple late February right before they took that config down. I know this because the very next day I went back to order more and couldn't.
There's a ton of spam on ebay currently with configs of the 512gb ram variant going for sub $4k. Those are all scams/spam. You can tell instantly because the seller's account is/was created this month 2026.
The $20k+ listings aren't selling but what's interesting is technically, $20k for 512gb ram is still less than $40/gb ram on a single device. Compare that to a Nvidia spark with 128gb ram selling at $4k+ or if you're lucky, you snagged one for ~$3500. That's $31.25/gb
The retail on the 512gb was $9500 and after tax if you don't ship to a sales tax free state makes it only $20/gb ram.
I'm curious what price apple's newest studio variant will be priced at per gb ram but I recently bought a "refurb" from a reputable seller I've purchased many laptops from in the past at $13,750 which still put the 512gb at a $27/gb ram price point.
I'm bullish on local models especially due to gemma4. Good luck out there!
A bunch of ideas that have had domains but never enough engineers. Now there isn't enough time it seems except when I've hit my LLM subscription limits and they need to cool down.
Already launched biz-in-a-box.org and a life-in-a-box.org spinoff as frameworks to replace every entity's QuickBooks. I'm using them myself for every project my agents are spinning up.
Stealth project is related to classpass but for another category of need that won't go away even in the age of AI that really is only possible with critical mass of supply to meet existing demand. Super excited cus there's no better time to build with unlimited agents that scale without people problems.
Lastly, can't wait to run local LLMs so no longer limited by tokens/money.
996 - it's a global marketplace of talent and very few in America are willing to work 996. If you are, you either are the founder type or young and unshackled.
Fyxed deploys capital to landlords and their property managers for cash needs like repairs, turnovers, and improvements on rental properties.
We're at an inflection point where we have the deployment capital ($50M) to really take a big swing at this opportunity.
The perfect candidate has prior fintech (lending) experience, loves wrangling the complexities of reconciling/tracking money, and bonus points if you've built on top of Column.com's API.
would really appreciate testers but also any companies thinking about distributed inference powered by their own company devices on a private network. my own company has 200+ 16gb ram machines that we're using for inference.