Long-Context Retrieval Models with Monarch Mixer(hazyresearch.stanford.edu)
hazyresearch.stanford.edu
Long-Context Retrieval Models with Monarch Mixer
https://hazyresearch.stanford.edu/blog/2024-01-11-m2-bert-retrieval
1 comments
This is exciting. Seems like searching for scientific papers would be a good long context task.