Why do LLMs attend to the first token?(arxiv.org)
arxiv.org
Why do LLMs attend to the first token?
https://arxiv.org/abs/2504.02732
1 comments
Curious if the authors had a chance to look at the Softpick paper?
https://arxiv.org/abs/2504.20966
https://arxiv.org/abs/2504.02732