HackerTrans
TopNewTrendsCommentsPastAskShowJobs

akawry

no profile record

Submissions

GitHub deletes popular llama.cpp fork without explanation

github.com
4 points·by akawry·vor 12 Monaten·2 comments

comments

akawry
·vor 11 Monaten·discuss
Take a look at ik_llama.cpp: https://github.com/ikawrakow/ik_llama.cpp

CPU performance is much better than mainline llama, as well as having more quantization types available
akawry
·vor 12 Monaten·discuss
ik_llama.cpp is a popular fork of mainline llama.cpp started last year containing many new SOTA quants and improved CPU performance.

On 07/20, GitHub deleted both the repo as well as the account without explanation. More discussion at https://huggingface.co/ikawrakow/Qwen3-30B-A3B/discussions/2