DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models(github.com)
github.com
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models
https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat
2 comments
[deleted]
An order of magnitude speedup for GPT-like models? Not sure why this story isn't bigger news..