Ask HN: An Offline ChatGPT Alternative?3 points·by DBformore·3 ปีที่แล้ว·2 comments2 commentsPost comment[–]pizza·3 ปีที่แล้วreplyYou can see here the most downloaded models from the Hugging Face transformers hub: https://huggingface.co/spaces/huggingface/transformers-statsIf I'm not mistaken these will be some of the best sota language models to try:- Flan-T5- OPT- Distilbert- GPT-JLook into PEFT to fit finetuning on a consumer-grade device. You'll have to roll your own RLHF though.. :)[–]fl0ps·3 ปีที่แล้วreplyBeen asked here before, but this was interesting:https://old.reddit.com/r/programming/comments/szqq5m/gptj_is...
If I'm not mistaken these will be some of the best sota language models to try:
- Flan-T5
- OPT
- Distilbert
- GPT-J
Look into PEFT to fit finetuning on a consumer-grade device. You'll have to roll your own RLHF though.. :)