HackerTrans
TopNewTrendsCommentsPastAskShowJobs

steeve

2,229 karmajoined 14 tahun yang lalu
http://twitter.com/steeve http://github.com/steeve

[ my public key: https://keybase.io/steeve; my proof: https://keybase.io/steeve/sigs/Jh6dVy9uklGwmVZTz6QflyRhA9l7BRA6VoZeuBK5SLo ]

Submissions

ZML/LLMD alpha – cross platform LLM server

zml.ai
16 points·by steeve·3 hari yang lalu·3 comments

Zml-smi: universal monitoring tool for GPUs, TPUs and NPUs

zml.ai
77 points·by steeve·3 bulan yang lalu·11 comments

ZML/v2: Frontier performance through composability

zml.ai
5 points·by steeve·4 bulan yang lalu·0 comments

comments

steeve
·bulan lalu·discuss
sidenote: it is possible to use Vulkan to map GPU memory to CPU space and even map it back to CUDA: https://x.com/steeve/status/2055042304344231978?s=20
steeve
·3 bulan yang lalu·discuss
consider it done
steeve
·3 bulan yang lalu·discuss
Weird, because we tried it. It doesn’t show anything?

We use the amdsmi to get metrics. I’ll investigate.
steeve
·3 bulan yang lalu·discuss
sadly, sandboxing is something that can't be upstreamed. this way, sandboxing is kept in zml instead of patching mesa.

as for nvtop, great program, but we missed a few features (such as sandboxing)
steeve
·4 bulan yang lalu·discuss
hi, i'm the founder of https://github.com/zml/zml, very happy with Zig
steeve
·4 bulan yang lalu·discuss
Misleading title. It's about using their AI service, not the editor.
steeve
·5 bulan yang lalu·discuss
we (ZML) have been back to following Zig master since std.Io was introduced. It's not that bad tbh. Also most changes really feel like actual improvements to the language on a day to day basis.
steeve
·5 bulan yang lalu·discuss
ZML
steeve
·6 bulan yang lalu·discuss
tldr: they replaced using protobuf as the type system across language boundaries for FFI with true FFI
steeve
·6 bulan yang lalu·discuss
i can't help but think of the scammy communication around this on X. and the actual need to be deceitful about it.

oh how low the mighty have fallen
steeve
·6 bulan yang lalu·discuss
very very cool !
steeve
·6 bulan yang lalu·discuss
This looks incredible, congratulations!
steeve
·6 bulan yang lalu·discuss
the upside is absolutely worth it
steeve
·6 bulan yang lalu·discuss
because he was been sending me updates about it for the last two weeks

because we've been discussing architecture, optimisations and benchmarks

because it's not a 13h old project
steeve
·6 bulan yang lalu·discuss
he’s been working on it for 2 weeks, as he said somewhere else
steeve
·6 bulan yang lalu·discuss
sure, i hereby disclose that he left in September

i already said in another reply that i knew him personally
steeve
·6 bulan yang lalu·discuss
the way he came barging through the door doesn’t invite sympathy
steeve
·6 bulan yang lalu·discuss
well, bazel is by far the most reliable one so I'm not sure why you're complaining
steeve
·6 bulan yang lalu·discuss
and it would be terrible for hermeticity and reproducibility, nix tries very hard and gets mediocre results

perhaps, just perhaps, why people go through the trouble not because they are idiots but for actual engineering reasons
steeve
·6 bulan yang lalu·discuss
[flagged]