bddppq·3 tahun yang lalu·discusslepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine
bddppq·3 tahun yang lalu·discussAre there some examples(prompts) that Falcon 180B is performing better than Llama 70B?
bddppq·3 tahun yang lalu·discussThanks for pointing out. We have now updated the prompt template to follow the format.