olaird25·bulan lalu·discussInteresting. But if you are upgrading your embedding model, wouldn't you want to re-embed to get its benefits on old entries?
olaird25·2 bulan yang lalu·discussHave you tried just using a faster tokenization library?Github's BPE crate (https://crates.io/crates/bpe) advertises >10x speedup relative to HF, as do others.
olaird25·10 bulan yang lalu·discussThis seems exactly right. Its pretty common to watch your agent making the same mcp tool call again and again as it works through a list. These kinds of cases are solved by letting the agent just call any of its mcp tools in a script.