Double precision cell chips were reserved for military, I think (or maybe also blade processors). So doing any serious physics on them was dead in the water - same with macs tbh
I wonder if we could gamify and democratise it somehow, like fold-at-home and wikipedia...
I've been training a teeny specialised model to run in a browser on a phone to detect harmonium notes played in a song (harmonium turns out is a pita, another story for another day), getting good labelled data is _all_ of the hard work.
That being said, maybe for cheap inference, using a big model to train something ultra-suited for the task at hand might be how we could handle local inference; thinking language specific models.
I’ve been wondering about potential regression in coding models.
The initial models were corrected by programmers which gave a very high quality feedback signal. Whereas with vibe coding on the rise, you’ll lose that signal.
I vibed up a chrome extension that sets a timer, hides shorts, redirects home to subscriptions, and hides comments and recommendations.
It’s all toggleable so I don’t disable the extension when I do want some neuronal junk food. But just the micro friction being added back in is such a huge help to becoming more aware when using it.
I think that metal isn’t double precision; so that limits some serious physics simming; but if you’re doing that I guess you just rent a gpu somewhere.
I would definitely be into this if adding an egpu was first class supported.