3000 tokens/sec LLM playground(playground.kog.ai)
playground.kog.ai
3000 tokens/sec LLM playground
https://playground.kog.ai/
3 comments
What am I missing? It can't even list countries in NATO correctly, chatjimmy.ai can do that and output 17000 tokens/sec on cheaper silicon.
I don't think you're missing anything, the speed is the impressive thing but the model is limited. Perhaps Chatjimmy is more impressive in this respect. Most people haven't tried either
Related discussion of their writeup: https://news.ycombinator.com/item?id=48321076