Great write-up. Thank you! I’m contemplating a similar RAG architecture for my engineering firm, but we’re dealing with roughly 20x the data volume (estimating around 9TB of project files, specs, and PDFs).
I've been reading about Google's new STATIC framework (sparse matrix constrained decoding) and am really curious about the shift toward generative retrieval for massive speedups well beyond this approach.
For those who have scaled RAG into the multi-terabyte range: is it actually worth exploring generative retrieval approaches like STATIC to bypass standard dense vector search, or is a traditional sharded vector DB (Milvus, Pinecone, etc.) still the most practical path at this scale?
I would guess the ingestion pain is still the same.
Asking this question leads me to suspect you have no true curiosity or willingness to learn a new perspective as it's literally a Google away. And then you will reply in another direction that justifies your narrow world view that is of course justified 100% by your experience. This is not effective discourse and I see you doing it all over.
It’s a well-documented economic concept. You can find plenty on it if you're actually curious about the perspective. And understanding it thoroughly is a strong prerequisite to seriously engaging with other people with intent to learn. It's work you need do yourself.
I appreciate the acknowledgement ofthe 'No True Scotsman' trap. It is easy to define a side by its ideals (e.g., 'The Left is for the poor'), but the reality is that both sides muck it up the moment they take control.
Neither side actually supports the poor because both are funded by and literally are the wealthy masters. The evidence is in the trends/facts that for almost 50 years the wealth gap has only widened, regardless of who is in charge. At some point, we have to accept that the 'which side is right' argument is false.
This is part of the false dichotomy you are not understanding. It's not actually a valid choice if there are no options. And that is what this is actually about, understanding how we have no good options, and what to do about it. I recommend start digging in and we all question or own understanding and acceptance of the system. Is it actually working with even a simple majority in the best position we can be?
Currently employing 130 wage slaves and unduly profiting from their margins, and not satisfied with the overall system at all.
The battle between the modern 'Left' and 'Right' is pure theater. It’s a false choice designed to keep us arguing over who holds the leash while we remain wage slaves. It would be interesting if some of those individuals could have been more convincing 150 years ago
I would guess the ingestion pain is still the same.
This new world is astounding.