The CLaRa-7B models unify RAG and provide built-in semantic doc compression(huggingface.co)
huggingface.co
The CLaRa-7B models unify RAG and provide built-in semantic doc compression
https://huggingface.co/apple/CLaRa-7B-Base
1 comments
CLaRa (Continuous Latent Reasoning) is an approach Retrieval-Augmented Generation (RAG) that shortens context, reduces double-encoding, and improves quality of responses by compressing documents into a small set of "continuous memory tokens" that preserve the key information in the documents, and optimizes and performs retrieval and generation out of that shared latent space.