> Documents from the training data that have exact text matches with the model response. Powered by infini-gram
so, if I understand correctly, it searches the training data for matches in the LLM output. This is not traceability in my opinion. This is an attempt at guessing.
Checking individual sources I got texts completely unrelated with the question/answer, but that happen to share an N-gram [1] (I saw sequences up to 6 words) with the LLM answer.
I think they're being dishonest in their presentation of what Olmo can and can't do.
> But anyway, even if it were all true, the only reason we are talking about diffusers, and the only reason we are paying attention to this author's work Fairly Trained, is because of someone training on data that was not expressly licensed.
Thanks for putting this into words. I'm of the same opinion and this is the best articulation I have so far.
This is very different from my experience. Whenever someone I was in a conversation with brought up GEB, it was always a great pleasure of mine. I'd get the chance to discuss the main ideas of the book, and the way I assimilated them. I tend to not even engage in conversations with people who do it mostly to show off the extent of their knowledge. I believe this second point is the important one. GEB is completely orthogonal to the problem you describe.
I'm trying to read and reread this over and over again to make sense of this but to me it sounds like in the comments people speak as if Greg brockman resigned while in the article he is not amongst the three names who resigned. What am I missing here?
That's true. You just need to exploit your fellow humans! Make them work for you but never pay them for the full value they bring. Always pay them the least they will still accept. So you get a piece of their pie. Your position of power will allow you to do so, and people will see your position of power as "natural" and will see no problem in the exploitation.
Above the response it says
> Documents from the training data that have exact text matches with the model response. Powered by infini-gram
so, if I understand correctly, it searches the training data for matches in the LLM output. This is not traceability in my opinion. This is an attempt at guessing.
Checking individual sources I got texts completely unrelated with the question/answer, but that happen to share an N-gram [1] (I saw sequences up to 6 words) with the LLM answer.
I think they're being dishonest in their presentation of what Olmo can and can't do.
[1] https://en.wikipedia.org/wiki/N-gram