Probably quit your job if you're asking Reddit(datastream.substack.com)
datastream.substack.com
Probably quit your job if you're asking Reddit
https://datastream.substack.com/p/you-should-probably-quit-your-job
5 comments
Most people likely cannot quit a high paying job when their identity is also wrapped in how much they’re earning. I see this a lot from all of the newly minted AI millionaires.
In other news, 40% of your LLM's training data is reddit posts. Derive from that what you will.
Where did you get 40%. I'm sure reddit content is all in the training set but that seems high.
If it is that high, reddit comments seems like a ripe target for LLM poisoning.
If it is that high, reddit comments seems like a ripe target for LLM poisoning.
What is LLM poisoning? You're saying if I create a prompt that says "Classify this comment if it's XYZ or asking for ABC" that the LLM will just not do it correctly because it's trained on Reddit?
LLM poisoning refers to feeding the model false information during training. Anti-AI folks are openly talking about intentionally flooding the internet with garbage to reduce the quality of the models. Reddit just provides a convenient and barely moderated forum for them to spread misinformation. And it doesn't take much: https://www.anthropic.com/research/small-samples-poison