Good question. Mycellm is the protocol layer: identity, routing, credits, reputation. Similar to how BitTorrent verifies pieces match their hash but doesn't judge whether the content is any good (that's left to trackers, communities, external tools).
Mycellm can verify that inference happened: signed receipts, reputation tracking (success rate, speed, contribution history), admission control that cuts off freeloaders. Each network sets its own policies on top; a private group might trust everything, a public network might add spot-checks or consensus routing.
Directions I'm exploring for public verification: fast-of-N routing, spot-checking with known outputs, consensus at temperature=0 where inference is deterministic. But the verification logic should be pluggable — different networks, different standards. That's a design area where I'd welcome input.
Curious about Runfra — when you say 'Uber for GPU', is that an orchestration/marketplace layer where independent GPU owners sell compute time? And what does 'batch-first creative workflows' look like — image gen pipelines, video, or broader?
This is exactly what I've been building — mycellm.ai. Seed GPU when idle, earn credits, spend on inference. BitTorrent economics for LLM compute. It's live now (my homelab serves the public chat). Would love to have you involved — github.com/mycellm/mycellm
Mycellm can verify that inference happened: signed receipts, reputation tracking (success rate, speed, contribution history), admission control that cuts off freeloaders. Each network sets its own policies on top; a private group might trust everything, a public network might add spot-checks or consensus routing.
Directions I'm exploring for public verification: fast-of-N routing, spot-checking with known outputs, consensus at temperature=0 where inference is deterministic. But the verification logic should be pluggable — different networks, different standards. That's a design area where I'd welcome input.
Curious about Runfra — when you say 'Uber for GPU', is that an orchestration/marketplace layer where independent GPU owners sell compute time? And what does 'batch-first creative workflows' look like — image gen pipelines, video, or broader?