It would not be illegal based on fair use (though you have to be careful there also), but if you try to regurgiate large portions of the book then it would be. And we do know that models regurgiate training material verbatim (Copilot)
If I regurgiate something I read in copyrighted book without proper license that also would be theft, no distinction there.
I'm not distributing my brain, at least same (but probably more restrictive) should apply to models - training is okay, but using and distributing should be limited by copyright
With, but it's still bonkers that it works so well
>Also is there a practical motivation for creating them?
You could get in-between model sizes (like 20b instead of 13b or 34b). Before better quantization it was useful for inference (if you are unlucky with vram size), but now I see this being useful only for training because you can't train on quants
Wait until you hear about frankenmodels. You rip parts of one model (often attention heads) and transplant them in another and somehow that produces coherent results! Witchcraft
You could go even lower with smaller quantization if necessary. I personally wouldn't use anything smaller than 7B and Mistral already pushing it in coherence. Overall it depends on your use case, not everyone needs smart models, or large context that sometimes takes half of required memory.
Codellama is also surprisingly good even for non-coding tasks
IIRC temperature is proportional to velocity squared so increase in simulation speed will result in squared increase in temperature. But even if we account for that we are not dealing with ideal gas in real world, there bound to be collisions that break molecules apart or even start nuclear fusion at certain speeds
Sure! It's just a classification of events that each person has.
Testible prediction? Socially close people will have similar classifications as opposed to randomly chosen ones (I will leave defining metric space over possible classifications as an exercise to the reader)
Why would we care about anyone not in the richest countries. It's not like they need security by default to not become another botnet and DDoS Europe or US businesses.
I would like to see you justify paying sso.tax to business owner in countries where sysadmin is payed less than those services ask in a month
If you buy from reseller they have no way to correlate payment details to search queries. With subscription, however, service provider have your payment details and knows everything about your queries so it can build a profile on you.
You could sell tokens that get used up after each search or expire after certain amount of time since first use. Browser extension could store tokens and provide them to website as needed in random order. Tokens could be resold so no tracking by payment processor
They do actually restrict issuer in most cases. Linus can't just strip Linux of other developers parts because they are tightly interconnected. He could relicense 30 year old version of Linux, but it would be useless
Patents also preserve knowledge in publicly accessible and well documented form.
Without patents the only option to recoup investment in R&D would be to make innovations a trade secrets. This will lead to frequent reinvention of the wheel and lost knowledge.
The system is broken, but abolishing it is even worse