Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models(github.com)
github.com
Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models
https://github.com/av/harbor/releases/tag/v0.4.4
2 comments
Super interesting. I am also working a lot on CLI's these days
One notable added feature is ability to manage all my LLMs with a single CLI.
# list all models harbor ls # pairs well with jq harbor ls --json # Ollama harbor pull qwen3.5:35b # llama.cpp harbor pull unsloth/Qwen3.5-35B-A3B-GGUF:Q8_0 # vllm (HuggingFace Hub cache) harbor pull Qwen/Qwen3.5-35B-A3B
# Remove any of the models by the same id # used to pull it harbor rm <id>
Hopefully it'll be useful for someone too.