Strong roleplaying LLM with decent general abilitiesboson.ai2 points·by gracegreg·il y a 2 ans·0 comments
gracegreg·il y a 2 ans·discussQwen2-72B claims better than LLama3-70B, I just found there is an another LLama3 model has comparable performace:| | Qwen2-72B | Higgs-Llama-3-70B | Llama3-70B-Instruct || ---------- | --------- | ----------------- | ------------------- || MMLU | 82.3 | 80.8 | 80.2 || MMLU-Pro | 64.4 | 63.2 | 56.2 || Arena-Hard | 48.1 | 49.6 | 41.1 || GPQA | 42.4 | 42.1 | 41.9 |- https://huggingface.co/bosonai/Higgs-Llama-3-70B
| | Qwen2-72B | Higgs-Llama-3-70B | Llama3-70B-Instruct |
| ---------- | --------- | ----------------- | ------------------- |
| MMLU | 82.3 | 80.8 | 80.2 |
| MMLU-Pro | 64.4 | 63.2 | 56.2 |
| Arena-Hard | 48.1 | 49.6 | 41.1 |
| GPQA | 42.4 | 42.1 | 41.9 |
- https://huggingface.co/bosonai/Higgs-Llama-3-70B