I use full length vectors (512 dimensions) and have seen very fast lookups with pgvector (HNSW index) and sqlite-vec on 20k vectors. I think any decent vector database should be able to handle 44k entries… which one are you using now?
Thanks! Yeah embedding is simple enough and my needs were small enough that I didn’t want to pay. Both llama-server and ollama are great options, and if container size isn’t an issue you get a greater variety running what you want with sentence transformers.
Aren’t most inventions anti-labor by this rationale? We employ fewer farmers than we used to, but this is good for society because people who would be farmers are now working on other things.