HackerTrans
TopNewTrendsCommentsPastAskShowJobs

beAroundHere

no profile record

Submissions

How Taalas “prints” LLM onto a chip?

anuragk.com
429 points·by beAroundHere·قبل 5 أشهر·256 comments

Only Samsung loves me back

anuragk.com
2 points·by beAroundHere·قبل 5 أشهر·0 comments

comments

beAroundHere
·قبل 5 أشهر·discuss
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.

Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
beAroundHere
·قبل 5 أشهر·discuss
Hey, Can you please point out explain the inaccuracies in the article?

I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
beAroundHere
·قبل 5 أشهر·discuss
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.

[1] https://www.anuragk.com/linkblog
beAroundHere
·قبل 5 أشهر·discuss
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.

I didn't explore the actual manufacturing process.
beAroundHere
·قبل 5 أشهر·discuss
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.

Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
beAroundHere
·قبل 5 أشهر·discuss
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.

I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
beAroundHere
·قبل 6 أشهر·discuss
https://www.anuragk.com/linkblog/

My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
beAroundHere
·السنة الماضية·discuss
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.

Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.