olaird25·mês passado·discussInteresting. But if you are upgrading your embedding model, wouldn't you want to re-embed to get its benefits on old entries?
olaird25·há 2 meses·discussHave you tried just using a faster tokenization library?Github's BPE crate (https://crates.io/crates/bpe) advertises >10x speedup relative to HF, as do others.
olaird25·há 10 meses·discussThis seems exactly right. Its pretty common to watch your agent making the same mcp tool call again and again as it works through a list. These kinds of cases are solved by letting the agent just call any of its mcp tools in a script.