trissi·vor 2 Jahren·discussI use deepseek-coder-7b-instruct-v1.5 & DeepSeek-Coder-V2-Lite-Instruct when I want speed & codestral-22B-v0.1 when I want smartness.All of those are FIM capable, but especially deepseek-v2-lite is very picky with its prompt template so make sure you use it correctly...Depending on your hardware codestral-22B might be fast enough for everything, but for me it's a bit to slow...If you can run it deepseek v2 non-light is amazing, but it requires loads of VRAM
All of those are FIM capable, but especially deepseek-v2-lite is very picky with its prompt template so make sure you use it correctly...
Depending on your hardware codestral-22B might be fast enough for everything, but for me it's a bit to slow...
If you can run it deepseek v2 non-light is amazing, but it requires loads of VRAM