> Documents from the training data that have exact text matches with the model response. Powered by infini-gram
so, if I understand correctly, it searches the training data for matches in the LLM output. This is not traceability in my opinion. This is an attempt at guessing.
Checking individual sources I got texts completely unrelated with the question/answer, but that happen to share an N-gram [1] (I saw sequences up to 6 words) with the LLM answer.
I think they're being dishonest in their presentation of what Olmo can and can't do.
> But anyway, even if it were all true, the only reason we are talking about diffusers, and the only reason we are paying attention to this author's work Fairly Trained, is because of someone training on data that was not expressly licensed.
Thanks for putting this into words. I'm of the same opinion and this is the best articulation I have so far.
This is very different from my experience. Whenever someone I was in a conversation with brought up GEB, it was always a great pleasure of mine. I'd get the chance to discuss the main ideas of the book, and the way I assimilated them. I tend to not even engage in conversations with people who do it mostly to show off the extent of their knowledge. I believe this second point is the important one. GEB is completely orthogonal to the problem you describe.
I'm trying to read and reread this over and over again to make sense of this but to me it sounds like in the comments people speak as if Greg brockman resigned while in the article he is not amongst the three names who resigned. What am I missing here?
Above the response it says
> Documents from the training data that have exact text matches with the model response. Powered by infini-gram
so, if I understand correctly, it searches the training data for matches in the LLM output. This is not traceability in my opinion. This is an attempt at guessing.
Checking individual sources I got texts completely unrelated with the question/answer, but that happen to share an N-gram [1] (I saw sequences up to 6 words) with the LLM answer.
I think they're being dishonest in their presentation of what Olmo can and can't do.
[1] https://en.wikipedia.org/wiki/N-gram