HackerTrans
トップ新着トレンドコメント過去質問紹介求人

mezark

no profile record

投稿

[untitled]

1 ポイント·投稿者 mezark·14 日前·0 コメント

What happens when you run a CUDA kernel?

fergusfinn.com
294 ポイント·投稿者 mezark·15 日前·32 コメント

A running list of reasons to move to open source

whyopensource.ai
6 ポイント·投稿者 mezark·22 日前·0 コメント

Moe inference optimizations: 15% lower expert load by request reordering

blog.doubleword.ai
3 ポイント·投稿者 mezark·2 か月前·0 コメント

[untitled]

1 ポイント·投稿者 mezark·2 か月前·0 コメント

Tensor Network Attention

mainlymatmul.com
2 ポイント·投稿者 mezark·2 か月前·0 コメント

Redundant Information in LLM Weights

fergusfinn.com
5 ポイント·投稿者 mezark·2 か月前·0 コメント

Tans: Precomputing RANS

fergusfinn.com
3 ポイント·投稿者 mezark·2 か月前·0 コメント

Also-RANS: Asymmetric Numeral Systems for Entropy Coding

fergusfinn.com
25 ポイント·投稿者 mezark·2 か月前·0 コメント

70x faster cold(ish) starts for SGLang

fergusfinn.com
4 ポイント·投稿者 mezark·3 か月前·0 コメント

QueueSpec – drafting speculation tokens while a request queues

blog.doubleword.ai
1 ポイント·投稿者 mezark·6 か月前·0 コメント

ZeroDP: Just-in-Time Weight Offloading over NVLink for Data Parallelism

mainlymatmul.com
1 ポイント·投稿者 mezark·6 か月前·0 コメント

Parallel Primitives for Multi-Agent Workflows

fergusfinn.com
1 ポイント·投稿者 mezark·6 か月前·0 コメント

New fastest AI Model Gateway – 450x less overhead than LiteLLM

github.com
2 ポイント·投稿者 mezark·9 か月前·0 コメント

Should GPUs Make Free Trade Agreements?

doubleword.ai
3 ポイント·投稿者 mezark·10 か月前·1 コメント

コメント

mezark
·12 日前·議論
really like the framing of this post :)
mezark
·先月·議論
I love this blog
mezark
·先月·議論
(As someone who cares a lot about philosophy of consciousness / & cogsci)

The whole point of consciousness being a 'hard problem' is that we just cannot make claims like 'X is not conscious'
mezark
·先月·議論
we think so - but haven't tested it ourselves
mezark
·先月·議論
Hi! Co-founder of Doubleword here - we've hugely increased the number of models that we offer (partly thanks to work that we've done on hotswapping https://blog.doubleword.ai/fast-sglang-starts.

We're kind of known for our low prices - our prices (our main usage is for our high throughput API - the async tier) is significantly below average openrouter prices - but cached prices is coming soon which will lower them even more :)
mezark
·先月·議論
We at doubleword are bullish for AMD for low-interactivity inference - it does just take a bigger lift on the software side...
mezark
·2 か月前·議論
If you're talking about UK sovereign LLM inference you need to mention Doubleword... very serious inference optimization lab in london with public endpoints for OS models
mezark
·10 か月前·議論
We look at how comparative advantage from economics applies to LLM inference - some GPUs are relatively better at FLOPs, others at memory bandwidth. What happens if you let each do what it’s best at?