HackerTrans
トップ新着トレンドコメント過去質問紹介求人

chuckcode

no profile record

コメント

chuckcode
·2 年前·議論
Would like to see the latency and cost of parsing entire 10M context before throwing out the RAG stack which is relatively cheap and fast.
chuckcode
·3 年前·議論
Thanks for the very helpful and detailed reply!
chuckcode
·3 年前·議論
Thanks for details! Few follow up questions:

- I've seen neural nets using int8 for matrix multiplication to reduce memory size [1]. Do you think something similar could be useful in the ANN space?

- Do you know of any studies using Faiss looking at speed/cost tradeoffs of RAM vs flash vs Disk for storage?

- Are there recommended ways to update Faiss index with streaming data, e.g. updating the vectors continuously?

Seems like more and more use cases for Faiss as neural nets become more and more core to workflows. Would like to try and figure out the configurations that are optimized to minimize carbon usage in addition to latency and recall metrics.

[1] https://arxiv.org/abs/2208.07339

(edit for formatting)
chuckcode
·11 年前·議論
Sam has already helped you indirectly by investing in reddit which has all sorts of community sourced help. Check out PeaceH guide to getting discipline[1]

http://www.reddit.com/r/getdisciplined/comments/2dd7yh/advic...
chuckcode
·11 年前·議論
Could you comment on why start ups with remote teams anecdotally do poorly but many open source projects with very remote teams succeed? Do you see any tools on the horizon to help people coordinate remotely at a new level?