In-prompt instructions are cringe anyway, the chat app should let you customize system prompt/instructions per chat. The API already lets you do this so it can't be a safety reason that they don't.
I agree that they are intelligent, just don't know about the "definition" part. A typical Ivy Leaguer isn't a dumbass. What's wrong with calling one intelligent?
Try visiting a Walmart and interacting with literally anyone. That's the average. Let's not allow our egos to gatekeep who we consider intelligent, fellow HNians.
To me this indicates that Microsoft has some sort of traffic analysis performed on endpoints, then linked to GDID. I'd guess this is part of Defender's real time protection or MAPS.
Fun fact, Microsoft Defender MAPS was previously named SpyNet.
The GDID identifier seems software in nature though. They could be more aggressive and tie it to the baseboard's serial number the way some games do. Then the hardware is tracked throughout its entire lifecycle, not just per instance of Windows install.
Examples like yours and the author's don't convince me. It seems like a lot of what people are "missing" from the AI process is the social aspect which is largely a side effect in these examples. For instance, finding out that someone's relative had cancer after asking for help with a recipe.
Getting an internet recipe from AI doesn't stop you from reaching out to your friend and finding out if they are going through anything, if anything it frees you up to do exactly that.
Same with this t-shirt slogan example. What you miss is the group activity and the spontaneity. But you can still do this without it being a side effect of a business objective. You can still talk to your friends, and with AI making everything faster you can talk to them even more now.
You have a good point about the human rate of mathematical discovery, but Ayer was an idiot and later Witt contradicted early Witt. For the "already implicit" claim to be true, mathematics would have to be a closed system. But it has already been proven that it is not. You can use math to escape math, hence the need for Zermelo-Frankel and a bunch of other axiomatic pins. The truth is that we don't really understand the full vastness of what would objectively be "math" and that it is possible that our perceived math is terribly wrong and a subset of a greater math. Whether that greater math has the same seemingly closed system properties is not something that can be known.
This "car-tinkering app" is used as a glorified GameShark for deleting factory emissions controls, I don't feel sorry for anyone who uses this to roll coal or whatever. Instead of investigating everyone on the list of users of this app, should the government instead ban diesel engines knowing their emissions controls software will be defeated? Should environmental regulations be relaxed? What is really the solution here?