An almost-complete list of LLMOps tools for developers(github.com)
github.com
An almost-complete list of LLMOps tools for developers
https://github.com/tensorchord/Awesome-LLMOps
6 comments
Very good point, plus that if you introduce approximate search instead of exact search, you can only loose quality and in some cases the loss is so significant that it becomes worse than plain simple techniques.
Yeah, I think in many cases you just need a vector search lib, instead of a DB.
And in some other cases, you may want postgres vector extension e.g. https://github.com/tensorchord/pgvecto.rs instead of a specialized vector db.
And in some other cases, you may want postgres vector extension e.g. https://github.com/tensorchord/pgvecto.rs instead of a specialized vector db.
I want to build a LLM that can look through my own documents, what tools do I need here?
[deleted]
This cambrian explosion is crazy.
Optimize for retrieval metrics first, then speed. Recall and coverage. If those suck, it’s because your embeddings are trash and it won’t matter how fast you serve them.