Unlock Massive Context Windows: Positional embeddings are just training wheels(xcancel.com)

1 pointsby bigwheels6 ay önce2 comments

https://xcancel.com/hardmaru/status/2010565943269999091

2 comments

sjkoelle6 ay önce

Would this generate the same completion for 'the cat sat on the' as 'on the cat sat the'?

bigwheels6 ay önce