HackerTrans
TopNewTrendsCommentsPastAskShowJobs

beAroundHere

no profile record

Submissions

How Taalas “prints” LLM onto a chip?

anuragk.com
429 points·by beAroundHere·5 ay önce·256 comments

Only Samsung loves me back

anuragk.com
2 points·by beAroundHere·5 ay önce·0 comments

comments

beAroundHere
·5 ay önce·discuss
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.

Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
beAroundHere
·5 ay önce·discuss
Hey, Can you please point out explain the inaccuracies in the article?

I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
beAroundHere
·5 ay önce·discuss
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.

[1] https://www.anuragk.com/linkblog
beAroundHere
·5 ay önce·discuss
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.

I didn't explore the actual manufacturing process.
beAroundHere
·5 ay önce·discuss
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.

Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
beAroundHere
·5 ay önce·discuss
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.

I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
beAroundHere
·6 ay önce·discuss
https://www.anuragk.com/linkblog/

My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
beAroundHere
·geçen yıl·discuss
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.

Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.