HackerTrans
TopNewTrendsCommentsPastAskShowJobs

beAroundHere

no profile record

Submissions

How Taalas “prints” LLM onto a chip?

anuragk.com
429 points·by beAroundHere·5 months ago·256 comments

Only Samsung loves me back

anuragk.com
2 points·by beAroundHere·5 months ago·0 comments

comments

beAroundHere
·5 months ago·discuss
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.

Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
beAroundHere
·5 months ago·discuss
Hey, Can you please point out explain the inaccuracies in the article?

I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
beAroundHere
·5 months ago·discuss
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.

[1] https://www.anuragk.com/linkblog
beAroundHere
·5 months ago·discuss
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.

I didn't explore the actual manufacturing process.
beAroundHere
·5 months ago·discuss
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.

Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
beAroundHere
·5 months ago·discuss
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.

I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
beAroundHere
·6 months ago·discuss
https://www.anuragk.com/linkblog/

My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
beAroundHere
·last year·discuss
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.

Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.