HackerTrans
トップ新着トレンドコメント過去質問紹介求人

beAroundHere

no profile record

投稿

How Taalas “prints” LLM onto a chip?

anuragk.com
429 ポイント·投稿者 beAroundHere·5 か月前·256 コメント

Only Samsung loves me back

anuragk.com
2 ポイント·投稿者 beAroundHere·5 か月前·0 コメント

China unveils a powerful deep-sea cable cutter that could reset the world order

scmp.com
3 ポイント·投稿者 beAroundHere·昨年·3 コメント

コメント

beAroundHere
·5 か月前·議論
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.

Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
beAroundHere
·5 か月前·議論
Hey, Can you please point out explain the inaccuracies in the article?

I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
beAroundHere
·5 か月前·議論
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.

[1] https://www.anuragk.com/linkblog
beAroundHere
·5 か月前·議論
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.

I didn't explore the actual manufacturing process.
beAroundHere
·5 か月前·議論
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.

Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
beAroundHere
·5 か月前·議論
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.

I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
beAroundHere
·6 か月前·議論
https://www.anuragk.com/linkblog/

My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
beAroundHere
·昨年·議論
I think you're quoting the Sci Fi author - Ken Liu from his article in some major news outlet.

I related with that analogy too, infact that whole piece is worth reading. I can't seem to find it's link though!
beAroundHere
·昨年·議論
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.

Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.