AymanB

67 karmajoined 2 года назад

comments

3 дня назадdiscuss

I believe you could use some sort of GPU-direct (or BAM-like approach, see https://dl.acm.org/doi/10.1145/3575693.3575748) to stream weights on-demand from the GPU.

AymanB

3 месяца назадdiscuss

Thanks for the blog, I really enjoyed it. Good work. This just makes me appreciate and love compilers even more, they are a fascinating piece of software.