DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models(github.com)

3 pointsby ashvardanianhace 3 años1 comments

https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat

2 comments

[deleted]hace 3 años

_gtlyhace 3 años

An order of magnitude speedup for GPT-like models? Not sure why this story isn't bigger news..