HackerTrans
TopNewTrendsCommentsPastAskShowJobs

chuckcode

no profile record

comments

chuckcode
·hace 2 años·discuss
Would like to see the latency and cost of parsing entire 10M context before throwing out the RAG stack which is relatively cheap and fast.
chuckcode
·hace 3 años·discuss
Thanks for the very helpful and detailed reply!
chuckcode
·hace 3 años·discuss
Thanks for details! Few follow up questions:

- I've seen neural nets using int8 for matrix multiplication to reduce memory size [1]. Do you think something similar could be useful in the ANN space?

- Do you know of any studies using Faiss looking at speed/cost tradeoffs of RAM vs flash vs Disk for storage?

- Are there recommended ways to update Faiss index with streaming data, e.g. updating the vectors continuously?

Seems like more and more use cases for Faiss as neural nets become more and more core to workflows. Would like to try and figure out the configurations that are optimized to minimize carbon usage in addition to latency and recall metrics.

[1] https://arxiv.org/abs/2208.07339

(edit for formatting)
chuckcode
·hace 11 años·discuss
Sam has already helped you indirectly by investing in reddit which has all sorts of community sourced help. Check out PeaceH guide to getting discipline[1]

http://www.reddit.com/r/getdisciplined/comments/2dd7yh/advic...
chuckcode
·hace 11 años·discuss
Could you comment on why start ups with remote teams anecdotally do poorly but many open source projects with very remote teams succeed? Do you see any tools on the horizon to help people coordinate remotely at a new level?