I suspect it was considered many times, but the sheer computation scale would make it feel like obscene brute force. It feels like the right shape but too wild to think about implementing.
I think as time went on, and hardware got better, it seemed more reasonable to actually think about a viable implementation of what I think was a widespread intuition anyone in ML had that everything's context is everything.
It just seemed like a theoretical thing until hardware caught up. Maybe. Perhaps I'm applying a retrospective excuse to why it took so long.
I have a rule for myself. If I think something is silly or stupid, I assume I don't understand it. I usually find I do not understand it, and it no longer seems silly when I do understand it.
In this case too, you think it is silly because you don't understand it. Your assumptions are wrong, making it seem silly.
But get your car stolen in the UK and the police won't do a thing. Even if you know where it is via a tracker. Nothing. Outright refuse to take any action.
Truly feels like witnessing the worst of capitalism and greed play out. All that compute and energy towards a narrative of reducing the need for skilled programmers. What a waste.
These people don't have our interests in mind and everyone eats it up like a blessing from a god or something. It's surreal.
I think Google is doing the right thing. Using LLMs for coding is the shiny low hanging fruit but it isn't what is going to make the tech ubiquitous. That'll be finding applications of it to real data problems.
Google knows LLMs are the new UI, not the new IDE.
Because the US is a third world country cosplaying as a developed nation. Much like their president is a corrupt and morally bankrupt fool cosplaying as a politician.
Technology has become a societal torture device and AI is the largest power grab in history.
How dare humans be able to leverage their reasoning for a wage. To the machines I say!