HackerTrans
热门最新趋势评论往期问答秀出招聘

vrm

no profile record

提交

ATLAS: Autoformalized Textbook Library At Scale

github.com
32 分·作者 vrm·2个月前·4 评论

Stop comparing price per million tokens: the hidden LLM API costs

tensorzero.com
3 分·作者 vrm·3个月前·2 评论

Ask HN: What do you recommend for test observability?

3 分·作者 vrm·10个月前·0 评论

Improving Cursor Tab with RL

cursor.com
6 分·作者 vrm·10个月前·0 评论

评论

vrm
·上个月·讨论
TBH it's intended only for internal use (we don't even publish it as a crate at this point) so I don't particularly mind it being low-key. But I appreciate it!
vrm
·上个月·讨论
If you don't need a ton of throughput I think `absurd` (and our Rust derivative `durable`) are very nice options that keep the client side extremely simple. It's also lightweight enough that a coding agent can keep the entire thing in its head easily and just run queries to look up state as needed.
vrm
·2个月前·讨论
Since DBOS doesn't support Rust, we implemented a very minimal Rust version of this at https://github.com/tensorzero/durable. It has been quite stable and extensible but of course you need to be very careful with the SQL implementations. Hope this is interesting to readers here.
vrm
·2个月前·讨论
It’s really not a concept you can express in idiomatic Python very easily. This comes from the actual generated assembly involving copies from global GPU memory into registers (slow, bandwidth saturates quickly) and back in between the cosines. If you can avoid the intermediate roundtrip that cuts the cost approximately in half.
vrm
·2个月前·讨论
One question I have here: I think this type of thing would be trivial to do in Rust with constructors, private fields, and newtypes. What am I getting on top of it?