HackerTrans
TopNewTrendsCommentsPastAskShowJobs

vrm

no profile record

Submissions

ATLAS: Autoformalized Textbook Library At Scale

github.com
32 points·by vrm·الشهر الماضي·4 comments

Stop comparing price per million tokens: the hidden LLM API costs

tensorzero.com
3 points·by vrm·قبل 3 أشهر·2 comments

Ask HN: What do you recommend for test observability?

3 points·by vrm·قبل 10 أشهر·0 comments

Improving Cursor Tab with RL

cursor.com
6 points·by vrm·قبل 10 أشهر·0 comments

comments

vrm
·الشهر الماضي·discuss
TBH it's intended only for internal use (we don't even publish it as a crate at this point) so I don't particularly mind it being low-key. But I appreciate it!
vrm
·الشهر الماضي·discuss
If you don't need a ton of throughput I think `absurd` (and our Rust derivative `durable`) are very nice options that keep the client side extremely simple. It's also lightweight enough that a coding agent can keep the entire thing in its head easily and just run queries to look up state as needed.
vrm
·الشهر الماضي·discuss
Since DBOS doesn't support Rust, we implemented a very minimal Rust version of this at https://github.com/tensorzero/durable. It has been quite stable and extensible but of course you need to be very careful with the SQL implementations. Hope this is interesting to readers here.
vrm
·قبل شهرين·discuss
It’s really not a concept you can express in idiomatic Python very easily. This comes from the actual generated assembly involving copies from global GPU memory into registers (slow, bandwidth saturates quickly) and back in between the cosines. If you can avoid the intermediate roundtrip that cuts the cost approximately in half.
vrm
·قبل شهرين·discuss
One question I have here: I think this type of thing would be trivial to do in Rust with constructors, private fields, and newtypes. What am I getting on top of it?