Sequoia: Speculative decoding boosting LLM inference by 8-10x(infini-ai-lab.github.io)
infini-ai-lab.github.io
Sequoia: Speculative decoding boosting LLM inference by 8-10x
https://infini-ai-lab.github.io/Sequoia-Page/
0 comments
—
https://infini-ai-lab.github.io/Sequoia-Page/
—