The non-determinism is part of the allure of these systems -- they operate like slot machines in a casino. The dopamine hit of getting an output that appears intelligent and the variable rewards keeps us coming back. We down-weight and ignore the bad outputs. I'm not saying these systems aren't useful to a degree, but one should understand the statistical implications on how we are collectively perceiving their usefulness.
The other thing to note is that journalism in the US has gotten really lazy. A lot of the articles you will see in the MSM are based on leaked info and press-releases from PR firms, etc. It's easier to for journalists to regurgitate stories hand-fed to them than doing truly hard and costly investigative work.
Agree with this. Human language is also not very information-dense; there is a lot of redundancy and uninformative repetition of words.
I also wonder about the compounding effects of luck and survivorship bias when using these systems. If you model a series of interactions with these systems probabilistically, as a series of failure/success modes, then you are bound to get a sub-population of users (of LLM/LLRMs) that will undoubtedly have “fantastic” results. This sub-population will then espouse and promote the merits of the system. There is clearly something positive these models do, but how much of the “success” is just luck.
Excellent blog post. Summed up what I've been thinking for the past few years. I find myself endlessly consuming content (videos, podcasts, etc.) that I would deem "educational". It feels good, like you're learning something new, improving yourself. But at the end-of-the day you aren't. Your brain is just sitting there passively - not really doing any hard work. Instead of your brain generating ideas and solving problems, that process has been palmed off to the internet.