buzzier·il y a 3 ans·discussRWKV-v4 Web Demo (169m/430m params) https://josephrocca.github.io/rwkv-v4-web/demo/
buzzier·il y a 3 ans·discussFor Windows:1. Binary build https://github.com/jaykrell/llama.cpp/releases/tag/12. Quantized model (7B/13B/30B) https://mega.nz/folder/UjAUES6Z#bGhKkyiZX3eRrn9HcxVVfA3. main.exe -m ggml-model-q4_0.bin -t 8 -n 128