buzzier·3 年前·議論For Windows:1. Binary build https://github.com/jaykrell/llama.cpp/releases/tag/12. Quantized model (7B/13B/30B) https://mega.nz/folder/UjAUES6Z#bGhKkyiZX3eRrn9HcxVVfA3. main.exe -m ggml-model-q4_0.bin -t 8 -n 128