Worth comparing architectures: Axe is stateless CLI (pipe in, get output), crabtalk.ai is daemon + commands (persistent process manages state, commands are standalone binaries on PATH).
Both bet on small binaries (crabtalk is 8MB) and Unix philosophy, but the daemon gives you hot-swap, process isolation, and persistent state across invocations.
makes sense, it really depends on the use cases, I'm building my version of claw openwalrus for the local LLMs first goal, I think myself will use local models for daily tasks that heavily depend on tool callings, but for coding or doing research, I'll keep using remote models
and this topic actually inspires me that I can introduce a builtin gas meter for tokens
Mine called openwalrus is local-llm first written in rust:
builtin metasearch engine, graph based memory system, editing configs with commands (never need to edit the config files manually)...
we indeed need to focus on sort of real "use cases" first, since I just realized when I'm talking with others about it, the conversions are always meaningless, ends with no response, or sth like cool