It’s been this bad for a little while, iirc have seen a few of these pop up over the last few years. And that’s just for the few someone’s caught/documented
Surely you appreciate our lack of free will, and how I have no choice but to leave this comment in the void as a sticker for the both of us to have as a token nod to such an existence.
If 80% is “done by the AI”, who is responsible for the certain failure on behalf of the AI? Given inference often is, >0%, wrong — in a word… hmm.
How many 9s until you’re comfortable? Even then, knowing 1000 tasks could likely have at least 1 foundational issue… how do you audit? “Pretty please do the needful” and have another “please ensure they do the needful”. Do you review the 1000 inputs/outputs processed? Don’t get me wrong, am familiar with the “send it” ethos all too well, but at-scale it seems like quite the pickle.
Genuinely curious how most people consider these angles… was tasked with building a model once to perform what literally could’ve otherwise been a SQL query… when I brought this up, it was met with “well we need to do it with AI” I don’t think a humans gonna want to find that needle in a haystack when 100,000 significant documents are originated… but I don’t have to worry about that one anymore thank goodness.
This connects some many sparse dots on the map for me. Finishing it right now, thank you for commenting w the link. What a perspective, and well-written parable to communicate it.
It is a mindset thing insofar as my opinion is that there are more interesting things to practice with, sure. Grindy endeavors aren’t bad, just grindy. Given how much of the practical application side of that practice is handled by libs/pkgs @ runtime for a lot of product dev I’ve been involved with, it can seem a bit much. It isn’t so black and white of course, but this is just an off the cuff musing. I miss whiteboarding sessions, and I feel like the lc grind does a disservice to both sides of the hiring table in a lot of cases. Sure, “what’s a better alternative at scale” comes to mind, but I’ll digress lol