HackerTrans
TopNewTrendsCommentsPastAskShowJobs

weirdcat

no profile record

Submissions

[Nvidia] NemoClaw – Enterprise AI Agents, Redefined

nemoclaw.bot
4 points·by weirdcat·4 bulan yang lalu·0 comments

AI of the Storm

medium.com
1 points·by weirdcat·tahun lalu·0 comments

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com
1,454 points·by weirdcat·2 tahun yang lalu·735 comments

Differential Transformer

arxiv.org
562 points·by weirdcat·2 tahun yang lalu·177 comments

Training Language Models to Self-Correct via Reinforcement Learning

arxiv.org
230 points·by weirdcat·2 tahun yang lalu·92 comments

Linear, symmetric, self-selecting 14-bit molecular memristors (2023)

researchgate.net
109 points·by weirdcat·2 tahun yang lalu·55 comments

comments

weirdcat
·bulan lalu·discuss
How are you running that GGUF, and how many tokens/sec are you getting without MTP? My M1 Max gives me 65 t/s for non-MTP unsloth/gemma-4-26B-A4B-it-qat-GGUF (UD-Q4_K_XL), but with MTP that actually goes down to 56 t/s (at 63% accepted drafts).