qamononep·hace 2 años·discussIt would be great if you included a section on running with Docker on Linux. The only one that worked out of the box was Ollama, and it had an example. https://github.com/ollama/ollama/blob/main/docs/docker.mdhas a docker image but no examples to run it https://github.com/ggerganov/llama.cpp/blob/master/docs/dock...has a docker image but no examples to run it https://github.com/LostRuins/koboldcpp?tab=readme-ov-file#do...docker image was broken for me on 7800xt running rhel9 https://github.com/Atinoda/text-generation-webui-docker