HackerLangs
トップ新着トレンドコメント過去質問紹介求人

SknCode

no profile record

コメント

SknCode
·4 か月前·議論
How?
SknCode
·9 か月前·議論
I am not sure if I understand things correctly.

I came to believe the LLMs work with token embeddings. Is then the REFRAG only "something" in front of the LLM, and the decoder is the RL policy which expands only some token chunk embeddings into token embeddings feedable to LLM? Or the REFRAG needs you to 'tune' the LLM to be able to work with both token embeddings and token chunk embeddings?