Do you think we have got to the top of the rapid AI breakthroughs?
2024-2025, we saw lots of massive releases with tangible quality changes. To me experience, that hockey stick is no longer there for releases since the beginning of this year. Is AI hitting a bottleneck now?
3 comments
Fable / Mythos are (were?) a step change in capability. The scaling laws clearly have not gone sigmoidal yet. I recently wrote about my experience with Fable and how it represented a very substantial increase the complexity of tasks possible here, if you're interested: https://tossrock.substack.com/p/36-hours-with-fable
A lot of what you describe has been enhancements and scaling. Folks have been working on AI for 70 years. Do you count putting it into the hands of you and I a breakthrough? Otherwise self-attention would certainly count but that is nearly a decade old.