This discussion is so dumb - finetuning a base model costs ~$1 with LORA/QLORA and can yield same performance as gpt-4, but at 1/100 of the cost per token.
lol Emad was always seemed like an obvious fraud to me. Not quite SBF level but same vibe. Whenever someone goes overboard on the nerd look it’s always a red flag.
Whoever is dumb enough to invest in a company that hasn’t even bothered to come up with their own company name, but just copied the name of the current most hyped competitor in their category, deserves to lose their money.
Depends on your definition of winning - special-purpose tuning is vastly more cost effective since it allows you to train a smaller model that can perform specific tasks as good as a bigger one.
A good analogy is building a webapp - would you prefer to hire a developer with 30+ years experience in various CS domains as well as a PhD or a specialized webdev with 5 years experience at a tenth of the rate?
If I had a penny each time a human has confidently concluded something that is entirely incorrect… I’ve inadvertently done it countless times myself, and so has every person I know of.
What you are talking about I would call guessing :)
Fact of the matter is that sota LLMs are highly accurate predictors for many topics, certainly above any living human in terms of total AUC of correct predictions on fact based questions. Some humans are better on certain topics, but noone can match total AUC since LLMs has such breadth.
What do you mean? China is the major communist economy in the world and they have plenty of “markets“, but the CPC are the ones who pick the winners through legislation and/or subsidies.
As I stated above what I disagree is a system where legislation is used for other purposes than 1) protecting citizens from harm 2) combating anti-competitive practices by incumbent businesses.
The legislation in question clearly falls outside these two categories.