DeepSpeed-FastGen: High-Throughput Text Generation for LLMs(github.com)
github.com
DeepSpeed-FastGen: High-Throughput Text Generation for LLMs
https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-fastgen
0 comments
—
https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-fastgen
—