Reddit doesnt work because subreddits crosspolinate and float to the top so theyre rather prone to brigading and intermingling. We don't really get distinct subreddits anymore.
I think models will be a commodity sooner rather than later. This whole race doesnt matter. First mover advantage is real, but over enough time it wont matter.
Yes. Make sure you’re not using the Gemma sparse models since they don’t have a small model to use. Also I removed all the image models from the workspace.
I think for the same model wall time is probably a more intuitive metric; at the end of the day what you’re doing is renting GPU time slices.
Large outputs dominate compute time so are more expensive.
IMO input and output token counts are actually still a bad metric since they linearise non linear cost increases and I suspect we’ll see another change in the future where they bucket by context length. XL output contexts may be 20x more expensive instead of 10x.
I think if people had a use case for it they’d buy more of the damn things. Right now I’d never need a device separate from my spouse since I just don’t need one.
Make is useful and buyers will come. The never had issues selling multiple macs frankly.
Voting can be coordinated between the N cpus rather than an external arbiter (even making that redundant eventually required the CPUs to decide what to do if they disagree so may as well handle it internally).
Ruby is a language that optimizes for the local maxima at the cost of the global maxima.
Now every library, company or code base has its own pattern and you have to learn its pit falls. Better to learn once, cry once and just deal with it imo.
As they say, good enough is the enemy of perfection.