bddppq·il y a 3 ans·discusslepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine
bddppq·il y a 3 ans·discussAre there some examples(prompts) that Falcon 180B is performing better than Llama 70B?
bddppq·il y a 3 ans·discussThanks for pointing out. We have now updated the prompt template to follow the format.