bddppq·há 3 anos·discusslepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine
bddppq·há 3 anos·discussAre there some examples(prompts) that Falcon 180B is performing better than Llama 70B?
bddppq·há 3 anos·discussThanks for pointing out. We have now updated the prompt template to follow the format.