olaird25·le mois dernier·discussInteresting. But if you are upgrading your embedding model, wouldn't you want to re-embed to get its benefits on old entries?
olaird25·il y a 2 mois·discussHave you tried just using a faster tokenization library?Github's BPE crate (https://crates.io/crates/bpe) advertises >10x speedup relative to HF, as do others.
olaird25·il y a 10 mois·discussThis seems exactly right. Its pretty common to watch your agent making the same mcp tool call again and again as it works through a list. These kinds of cases are solved by letting the agent just call any of its mcp tools in a script.