There must be a relationship here between Shannon's estimation that english is 1 bit of entropy per character and is highly redundant and 'easy' to predict.
A highly advanced AI could compress the text and predict the next sequences easily.
This seems like a direct connection like electricity and magnetism.
And maybe that's why English needs to be about 1 bit because we're not very intelligent.
In the 2000s I was addicted to Elisp and contributed a ton of OSS code including JDE, EDEE, and tons of other tools.
But... I had just a MASSIVE amount of code that was literally just for me.
Emacs basically became my OS.
Emacs allowed you to just eval code on the fly and the IDE would just adapt. No reload required. So if you wanted to do stupid stuff like make control+enter open the current URL at the cursor, you just write a three line script. Then you add it to your elisp on load.
... but mine got WAY out of hand. It was just mountains of code.
What makes me really angry about Facebook and other companies that aggressively track (almost to the point where it's weaponized) is that it hurts companies that just want to track to improve their products.
I NEED the tracking data to improve my product.
If users aren't clicking on a button I need to know why. I need to see what % of users never come back and why so I can improve the product and make my customers happy.
Without this data I'm flying blind and my product will literally die.
I'm not interested in private information like your shopping habits so I can sell you ads.
Now the problem is most users are so cynical they want everything turned off.
I wish there was a way to have some sort of 'profile' to specify what I'm tracking.
I want to be the white hat but I'm in a room with some BIG black hats so it's obvious that users are going to be cynical and pessimistic.