I'm not even sure where to start, but I have to ask- are there any groups / projects that are trying to make and train an OSS model federated across members' machines?
>If you’re a programmer, you might think that the fiddliness of programming is a special feature of programming, but really it’s that everything is fiddly, but you only notice the fiddliness when you’re new, and in programming you do new things more often.
Wait, do programmers actually think that programming is fiddly? The fiddly part is always the concerns of the real-world domain; what's special to programming is the ability to use abstractions.