I’m all-in on agents but this is a “you’re holding it wrong” situation.
If you want to give your agents a DB for their own work as a scratchpad or something that’s great. They can not only go to town, but also analyze their own work and iterate on it.
If you are talking about a production base, agents should not be hitting it directly under any circumstances. There needs to be an API layer with defined usage patterns, rate limits, etc.
This is basically the same as saying “databases weren’t designed for interns to run live inline migrations in prod”. Yeah of course they aren’t.
At this point we should make a GitHub repo with a huge list of unsolved “dry lab” problems and spin up a harness to try and solve them all every new release.
I agree that it seems most likely that things are going to rapidly improve as they have been.
But the reality is that global unemployment levels are as of yet unaffected.
This is clearly the hardest bar to meet, but it’s also the most important.
If AI fully automates 5% of global jobs (or pick your number), I think it would be fair to say that this specific definition of AGI is achieved.
As a SWE, I feel immensely augmented by AI. But you can’t yet fully deploy an AI to do a job end to end without any human involvement.
I use like ~1b input tokens per week on codex or something like that, and while it does an insane amount of work, you have to have a skilled hand guide it.
This might not be the case for long, but it’s not here yet (in that narrow definition at least).
I’m not on either side of the argument, but one popular definition is missing which is “can automate most knowledge work”.
Not that this is my definition or anything, just pointing out that this is the one people actually care about, even if the acronym doesn’t say anything about economics or social change.
Strange, I had the same thought about doing this exact exercise this weekend.
I think the overall percentage is the wrong approach here.
It’s easy to say a lot of things that are factually true or predictions that are inevitably true.
However the more salient point with Gary Marcus is the one unforgivable thing he was wrong about and continues to double down on which is that deep learning is hitting a wall.
Starting in early 2022 and going through today, there is still so much low hanging fruit with deep learning.
Today’s LLM progress is mostly being made in RL. But world models are also still so early and they’re deep learning all the way down.
It would be nice if he would just admit he was wrong.
I think local inference is great for many things - but this stance seems to conflate that you can’t have privacy with server side inference, and you can’t have nefariousness with client side inference. A device that does 100% client side inference can still phone home unless it’s disconnected from internet. Most people will want internet-connected agents right? And server side inference can be private if engineered correctly (strong zero retention guarantees, maybe even homomorphic encryption)