HackerTrans
TopNewTrendsCommentsPastAskShowJobs

aqader

no profile record

Submissions

[untitled]

1 points·by aqader·قبل 3 سنوات·0 comments

Show HN: Fine-tune generative models in 1 line of code

blueprint.baseten.co
16 points·by aqader·قبل 3 سنوات·0 comments

Show HN: I fine-tuned Flan-T5. Can it cook?

abuqader.substack.com
55 points·by aqader·قبل 4 سنوات·43 comments

Show HN: Generate recipes with a fine-tuned language model

lechef.fyi
7 points·by aqader·قبل 4 سنوات·0 comments

comments

aqader
·قبل 3 سنوات·discuss
this is really cool, can’t wait to try it out for some ML pipeline development. kudos myles and akshay!
aqader
·قبل 3 سنوات·discuss
Yes, we did! The dataset has since been cleaned even more so we're due to update the model.
aqader
·قبل 3 سنوات·discuss
There are a couple open source implementations. I'll list a couple below:

7B: - https://huggingface.co/tloen/alpaca-lora-7b - https://huggingface.co/ozcur/alpaca-native-4bit 13B: - https://huggingface.co/samwit/alpaca13B-lora - https://huggingface.co/Dogge/alpaca-13b 30B: - https://huggingface.co/baseten/alpaca-30b - https://huggingface.co/Pi3141/alpaca-30B-ggml
aqader
·قبل 3 سنوات·discuss
Depends on the model size. A model like GPT3 that has hundreds of billions of paramaters, you can do few-shot learning with. You'll still pay for the tokens processed and it'll at least linearly increase response times the larger your input is.

Fine-tuning can get you similar results on smaller / faster models. The downside is you have to craft the dataset in the right way. There are trade-offs to both approaches but fwiw, I don't think Alpaca-7b can do few-shot learning.
aqader
·قبل 3 سنوات·discuss
Almost. If your dataset contains questions and answers about your own projects documentation, then yes. The UX around how to prompt a fine-tuned model depends on the format of the dataset it's trained on.

One way you can do this is pass your documentation to a larger model (like a GPT3.5 / OSS equivalent) and have it generate the questions/answers. You can then use that dataset to fine-tune something like Llama to get conversation / relevant answers.
aqader
·قبل 3 سنوات·discuss
Yeah, this is running in 8bit mode. The 30b 8bit version we released seems to do a lot better but it requires significantly more compute.

https://huggingface.co/baseten/alpaca-30b
aqader
·قبل 3 سنوات·discuss
For this demo, we're using the 8bit version here: https://huggingface.co/tloen/alpaca-lora-7b

We also fine-tuned and OSS'd a 30b version here that you can checkout (on the cleaned 52k Alpaca dataset) https://huggingface.co/baseten/alpaca-30b