FromTheFirstIn

3 दिन पहलेdiscuss

The only way to mitigate the damage an LLM can do because of prompt injection is to limit what that LLM can do in the first place. That’s what they mean by limiting its usefulness. If an LLM has access to an api and I want it to abuse that API in some way, I can attack its prompt and eventually get it to use the api the way I want

FromTheFirstIn

7 दिन पहलेdiscuss

I don’t think asking if someone lives in SF is ad hominem, but go off

FromTheFirstIn

9 दिन पहलेdiscuss

I think they have the same app, but they don’t use it like this. It seems like you’re confident this happens a lot- do you live in San Francisco?

FromTheFirstIn

9 दिन पहलेdiscuss

You’re the poster- do you live in the bay?

FromTheFirstIn

9 दिन पहलेdiscuss

This is strictly a San Francisco tech problem. This isn’t happening to most people

FromTheFirstIn

10 दिन पहलेdiscuss

It’s a bit like saying copy and paste must be intelligent because its output is indistinguishable from intelligent output. Reproduction of intelligence has never been equivalent to intelligence- that’s why we look down on copying, plagiarism or derivative work.

FromTheFirstIn

11 दिन पहलेdiscuss

Would you say those humans understand what they’re talking about?

FromTheFirstIn

11 दिन पहलेdiscuss

[dead]

FromTheFirstIn

12 दिन पहलेdiscuss

Yes, I think we simply disagree. I think you know what LLMs are based on our other thread and if you think something important happens when you get a large enough context vector I don’t think there’s much I can say to change your mind. It seems unlikely to me!

FromTheFirstIn

12 दिन पहलेdiscuss

Way better- thank you!

FromTheFirstIn

12 दिन पहलेdiscuss

We’re in all the same threads lately!

FromTheFirstIn

12 दिन पहलेdiscuss

I think if your definition of consciousness can fit these things then you’re more open minded than I care to be. Consciousness isn’t really guessing the next thing to say- it’s hard to say what it is, obviously, but blindly feeling forwards with each new conversation doesn’t seem like consciousness or learning to me.

FromTheFirstIn

12 दिन पहलेdiscuss

The styling on the website makes me feel like my phone is a cylinder

FromTheFirstIn

12 दिन पहलेdiscuss

While being slow to pass judgment or disregard an approach is a valuable trait in a senior Eng, I think 3 years is plenty of time to wait for proof of concept to pan out. It’s not panning out, it doesn’t seem on the verge of panning out, and soon the real cost is going to be passed on and the subsidies will end. LLMs see ripe to be the new IDEs, but not the new Engineers

FromTheFirstIn

12 दिन पहलेdiscuss

To acquire new knowledge and build your understanding. They don’t understand so they can’t learn

FromTheFirstIn

14 दिन पहलेdiscuss

You’re right, I’m very suspicious of HN when it comes to AI apologetics, but I shoulda trusted the parent commenter more.

FromTheFirstIn

14 दिन पहलेdiscuss

Yeah, it not a linear cap (x% entropy doesn’t mean x% wrong) but it does seem like a hard cap. To be honest, the more I’ve understood scaling laws the more I think that the elephant in the LLM room is the entropy of the language. It explains why coding languages are so much more tractable (they’ve got WAY less entropy) and it explains why we haven’t seen a step function in capabilities for LLMs since GPT-4 outside of making specific toolings for particular contexts. I think E is coming to dominate and there isn’t a workaround for it.

FromTheFirstIn

14 दिन पहलेdiscuss

This is a great read! I never realized the scale of the effort to find that BSD vulnerability- helps put things in perspective

FromTheFirstIn

14 दिन पहलेdiscuss

Isn’t the limit exactly what you’re describing? There’s always uncertainty, and your asymptote can approach its limit but it does have a limit. That’s the limit to the intelligence. And this is just for cross entropy loss- even if you could get loss to 0, I’m still not convinced at all that an enormous semantic map and its convoluted geometries amounts to intelligence.

FromTheFirstIn

14 दिन पहलेdiscuss

Agents are always combining the same underlying weights to their inputs, relying on the same maps of semi-semantic space and the relationships between those that it was leaning towards at training time. The fact that it’s successful in making lots of people have an Eliza effect doesn’t make it understand something. It’s simulating understanding based on an enormous corpus of text, much of which is people working through things or sharing an understanding of something. Unless you believe that all intellectual activity is about finding the space between words you shouldn’t believe LLMs have any chance at understanding anything.

comments