HackerTrans
トップ新着トレンドコメント過去質問紹介求人

hausrat

no profile record

コメント

hausrat
·3 か月前·議論
This has very little to do with someone making the LLM too human but rather a core limitation of the transformer architecture itself. Fundamentally, the model has no notion of what is normal and what is exceptional, its only window into reality is its training data and your added prompt. From the perspective of the model your prompt and its token vector is super small compared to the semantic vectors it has generated over the course of training on billions of data points. How should it decide whether your prompt is actually interesting novel exploration of an unknown concept or just complete bogus? It can't and that is why it will fall back on output that is most likely (and therefore most likely average) with respect to its training data.
hausrat
·昨年·議論
The very notion of discreteness depends on subjective definitions of "objects". We take concepts of objects for granted because they make interacting with the world tractable, but it's really hard to define them outside of minds.
hausrat
·昨年·議論
[flagged]