DeepSpeed-FastGen: High-Throughput Text Generation for LLMs(twitter.com)
twitter.com
DeepSpeed-FastGen: High-Throughput Text Generation for LLMs
https://twitter.com/MSFTDeepSpeed/status/1720589472654582198
0 comments
—
https://twitter.com/MSFTDeepSpeed/status/1720589472654582198
—