Speaking of AI generated pages, I wonder how OpenAI filter these low quality web pages out of their training set as they continue to training.
Also, I wonder how they decide what code is worth training on. Because a lot of code is written in poor style/has technical debt, it might be the case that these LLMs in the long run lead to an increase in the technical debt in our society. Plus, eventually, and this might already be happening, the LLM are going to end up training on their own outputs, so that could lead to self immolation by the model. I am not certain RLHF completely resolves this issue.
My dad moved to the US in 99 (he grew up in a town of about 50k people at the time). He said he was shocked people would stop for him when crossing the street, and he was amazed he could by a 1/2 gallon of ice cream for a couple bucks. Previously, he might have had ice cream once a year. He was also impressed and made happy by the abundance of meat and milk.
Funnily he was quite disappointed at the fruit situation coming from a tropical country, but that was more about freshness than quantity.
I think the idea of "fully diluted market cap" is essentially bs. It is answering the question what if the supply went up but the demand went up to the same degree as to keep the price stable, what would the market cap be then?
One of the problems is price point. They are charging $10/month. While increasing the price will certainly decrease the number of users, a much higher price point could select for "power users" that will churn less and pay substantially more. In the long run that could lead to greater revenue.
Of course this depends on how the supply demand curve looks like for their specific business.
This is also about job security. Technical people often have a record of what they have done. Think commits and PRs. Managers don't have this. Their job doesn't produce anything tangible, this is not to say that it is useless. There are good managers and bad managers, with the majority falling in the latter category.
Being seen in meeting rooms filled with people, talking to them, and pointing to things on a powerpoint presentation can give other more senior managers (who determine their position and compensation) the aura that they are hard at work and making things happen.
This reminds me of a podcast Ben Orenstein was on where he talks about something similar. Made a big difference in how I build/think about side projects.
The point that the author makes is very valuable, it is important to not throw out hands in the air. If you are not moving forward, you are falling back.
Though one (perhaps nit-picky) point I'd like to make is that these dictators are not dumb. They are incredibly intelligent. They themselves are probably not hackers, but they understand people and power. They are going do what they can to get what they want. We can't ignore the factor they play in creating these problems, and we need to take it just as seriously as we would a technical security exploit.
Also, I wonder how they decide what code is worth training on. Because a lot of code is written in poor style/has technical debt, it might be the case that these LLMs in the long run lead to an increase in the technical debt in our society. Plus, eventually, and this might already be happening, the LLM are going to end up training on their own outputs, so that could lead to self immolation by the model. I am not certain RLHF completely resolves this issue.