I have been experimenting with WebAssembly/Wasi over the last couple of years and decided it would be time to have another look and see what the state of things is. I it would be interesting to try and embed python in a wasm component for its nice sandbox properties.
There's a super cool project https://github.com/RustPython/RustPython which is a python interpreter in rust which can compile to wasip2 so I hooked that up and it seems to work well.
Its easy to build wasi components in rust now with the wasip2 target, excited to see where things head over the next few years.
This makes me think about kolmogorov complexity. The program here looks like gibberish but produces the desired output, would there be even shorter programs that don't look like they make sense but produce the same output? How would you search for these programs?
Has anyone figured out a way to fine tune this with 24gb of vram? I have tried with deepspeed etc but no luck. Seems to be just out of reach for fine tuning requiring 26gb.
There's a super cool project https://github.com/RustPython/RustPython which is a python interpreter in rust which can compile to wasip2 so I hooked that up and it seems to work well.
Its easy to build wasi components in rust now with the wasip2 target, excited to see where things head over the next few years.