Arrows of Time for Large Language Models(arxiv.org)6 points·by tianlong·2 yıl önce·3 commentsarxiv.orgArrows of Time for Large Language Modelshttps://arxiv.org/abs/2401.175054 commentsPost comment[–]nyoncore·2 yıl öncereplyIsn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one?[–]frotaur·2 yıl öncereplyIn the paper it is mentioned that the LLMs predicting the previous token are indeed pre-trained in this way, so it is not true that the difference is obvious.[+][deleted]·2 yıl önce[–]tianlong·2 yıl öncereplyThere is a link with entropy creation?