I am sympathetic to that however this is also a company that consistently promises the moon. Their CEO recently put out a blog post about AGI in a few “thousand days”. They clearly do have a hype issue and it’s fine to point that out.
Damn honestly why is this downvoted at all. Very anecdotal but I tried out the new o1-preview available to me, and it did not produce anything noticeably better for my domain. To claim this is “reasoning” to me seems infuriating
As others pointed out he seems to be talking more about about automation which... sure that's a fine discussion to have, but what bugged me more than anything is the overselling of Waymo/FSD. I understand a lot of this is also on a spectrum but it seems a bit irresponsible of Karpathy not to mention crashes Waymo has faced or other problems FSD systems have faced. It's not just an issue of scaling up, sensors, etc. There is more engineering work that needs to be put in clearly. It's fine to bring it up in his example of reactions to economical forces, but let's be completely honest about the whole thing.
It's not a god given right, but I worked really hard to get to where I am in life my visa is tied to my profession and I have a feeling it's going a way soon. Which means my visa might go away soon. I've gone from contemplate suicide to how to carry on. What you might think is awesomeness is dread for others. Just to point out there are 2 sides to this coin.
I actually don’t know what I should do. How I should prepare, what the future holds for me or us. I worked really hard to get where I am and it feels like it’s going to all crumble soon, and people who are more positive about things tell me either UBI will somehow fix things, and humans will persuade what they want or that we will all be in pain together so I won’t be alone. That doesn’t help. It’s given me actual nightmares.
I don't think the above comment disagrees that much with you. As far as paintings and poems go those are also pulling off of patterns that humans naturally have given off too right? An LLM is a bit more than a stochastic parrot sure, but it's also a large part of how it functions. The real surprise, or maybe not a surprise, is how formulaic everything is.
I can only see brutality personally. I’m not prepared. Once I lose my way of making a living I think it’s done basically. Time will tell, but it’s never been kind before, why now?
That's fair and I hope that is the case. That might even be fun, and I mean I actually have a lot of fun with gpt-4 now. My bigger complaint there then is that you need more money to be competitive in this industry now? Until LLMs become smaller more efficient? Like back in university the best student was a Russian immigrant who learned back in Moscow on pen and paper, no compiler to mostly handhold.
Every time I see these articles I get more and more worried about my employability to be frank... with no backup plan and way too much time poured into learning software engineering. It's not looking good gang.
I think it's even more interesting that the required amount of energy to do that high computational work isn't that high. Evolution has been working on it for a long time, and some things are really inefficient but overall it does an OK job at making squishy machines.