DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200(blogs.nvidia.com)
blogs.nvidia.com
DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200
https://blogs.nvidia.com/blog/deepseek-r1-nim-microservice/
2 comments
[deleted]
https://blogs.nvidia.com/blog/deepseek-r1-nim-microservice/
this is cerebras' 70B number, 1600 tokens / sec, not sure about the costs.