MoonshotAI unveils Kimi's large-scale LLM serving architecture(arxiv.org)
arxiv.org
MoonshotAI unveils Kimi's large-scale LLM serving architecture
https://arxiv.org/abs/2407.00079
2 コメント
[deleted]
I have been wondering the reason why online generative AI can serving so many requests. This really gives me an explanation.