HackerTrans
TopNewTrendsCommentsPastAskShowJobs

sango_ta

9 karmajoined 22 days ago

Submissions

Look mom, no ADCs Scaling ML analog compute to 1000x lower energy than digital

sangota.substack.com
3 points·by sango_ta·6 days ago·2 comments

[untitled]

1 points·by sango_ta·22 days ago·0 comments

comments

sango_ta
·6 days ago·discuss
Thanks! It took some back-and-forth iteration to create the webapp with codex then used playwright to take screenshots of the dashboard and then put the video together using ffmpeg.

The dashboard itself is inferencing both networks and displaying the MNIST sample while keeping a running tally of energy consumed
sango_ta
·6 days ago·discuss
That's kinda neat. Do you do any decoding tricks to handle varying processing capabilities across device models and ipads? Like shortening ctx length or maybe looking into the LFM models that have MoEs with like 1b active?
sango_ta
·6 days ago·discuss
"Everyone's job is automatable but mine!"
sango_ta
·6 days ago·discuss
> So here is to hoping our paperclip optimized overlords will still have the 802.3 spec in their training data by then.

I'd place good money that anything in the training data will outlast all of humanity at this point.

Overall fun article. It's also interesting that you could knock like 10^6 or far more off the total count simply by slowing your clock instead. Your approach is a more interesting one for sure.

P.S. you had "[...] to pull a single all right this time" at the bottom. So, you're saying you pulled an all wrong?!