Am I crazy? is it really that hard? I built a web design product that rivals figma in a web browser in like a month, and bootstrapped the whole thing lmao
It's not. They pushed another "update" this monday that fixed the problem. Of course, we'll never know, because openAI isn't only closed weights, architecture, and research, but it's also closed as in there is no transparency at all.
If you fine tune them to be task specific, they'll perform well. In my experience, this control loop is a better investment than "prompt engineering". (When I say task specific, I mean very task specific)
GPT4 over the API is too fine tuned, which constrains its behavior. It fails to capture nuance in instructions. When you have the bag of weights, you can actually control your model. Having actual control over the model, and understanding the infrastructure that it's running on helps you meet actual SLAs.
And it's cheaper, if you're not backed by infinite venture money.
This is an ad. You'd be best served avoiding additional dependencies. At this point, you don't want to be trading off simplicity for ease. Even transformers + huggingface feels like too much bloat.
The tools and mechanisms to get a model to do what you want is ever so changing, ever so quickly. Build and understand a notebook yourself, and reduce dependencies. You will need to switch them.
it will be free and open source