HackerTrans
TopNewTrendsCommentsPastAskShowJobs

vrm

no profile record

Submissions

ATLAS: Autoformalized Textbook Library At Scale

github.com
32 points·by vrm·в прошлом месяце·4 comments

Stop comparing price per million tokens: the hidden LLM API costs

tensorzero.com
3 points·by vrm·3 месяца назад·2 comments

Ask HN: What do you recommend for test observability?

3 points·by vrm·10 месяцев назад·0 comments

Improving Cursor Tab with RL

cursor.com
6 points·by vrm·10 месяцев назад·0 comments

comments

vrm
·в прошлом месяце·discuss
TBH it's intended only for internal use (we don't even publish it as a crate at this point) so I don't particularly mind it being low-key. But I appreciate it!
vrm
·в прошлом месяце·discuss
If you don't need a ton of throughput I think `absurd` (and our Rust derivative `durable`) are very nice options that keep the client side extremely simple. It's also lightweight enough that a coding agent can keep the entire thing in its head easily and just run queries to look up state as needed.
vrm
·в прошлом месяце·discuss
Since DBOS doesn't support Rust, we implemented a very minimal Rust version of this at https://github.com/tensorzero/durable. It has been quite stable and extensible but of course you need to be very careful with the SQL implementations. Hope this is interesting to readers here.
vrm
·2 месяца назад·discuss
It’s really not a concept you can express in idiomatic Python very easily. This comes from the actual generated assembly involving copies from global GPU memory into registers (slow, bandwidth saturates quickly) and back in between the cosines. If you can avoid the intermediate roundtrip that cuts the cost approximately in half.
vrm
·2 месяца назад·discuss
One question I have here: I think this type of thing would be trivial to do in Rust with constructors, private fields, and newtypes. What am I getting on top of it?