HackerTrans
热门最新趋势评论往期问答秀出招聘

beAroundHere

no profile record

提交

How Taalas “prints” LLM onto a chip?

anuragk.com
429 分·作者 beAroundHere·5个月前·256 评论

Only Samsung loves me back

anuragk.com
2 分·作者 beAroundHere·5个月前·0 评论

评论

beAroundHere
·5个月前·讨论
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.

Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
beAroundHere
·5个月前·讨论
Hey, Can you please point out explain the inaccuracies in the article?

I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
beAroundHere
·5个月前·讨论
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.

[1] https://www.anuragk.com/linkblog
beAroundHere
·5个月前·讨论
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.

I didn't explore the actual manufacturing process.
beAroundHere
·5个月前·讨论
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.

Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
beAroundHere
·5个月前·讨论
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.

I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
beAroundHere
·6个月前·讨论
https://www.anuragk.com/linkblog/

My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
beAroundHere
·去年·讨论
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.

Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.