HackerTrans
トップ新着トレンドコメント過去質問紹介求人

davidvgilmore

no profile record

投稿

Show HN: Rayline routes Claude Code subagents to on-device and cheaper models

rayline.ai
11 ポイント·投稿者 davidvgilmore·先月·9 コメント

Show HN: Dbt-skillz compiles your dbt project into a Claude Code skill

github.com
4 ポイント·投稿者 davidvgilmore·4 か月前·0 コメント

コメント

davidvgilmore
·先月·議論
For those that have capable enough hardware, it's effectively free to run subtasks on-device. (just the marginal cost of additional electricity).

With Google's most recent 12b param Gemma model, even Mac users with just 16gb of unified memory can offload some tasks on-device.
davidvgilmore
·先月·議論
Many of them are produced by Chinese labs. Some, like Neomotron, are U.S. made. And we support inference providers in both the U.S. and overseas.

If geography is important, we can restrict which geos inference takes place in. And if you don't want to use Chinese-trained models, you can use others like Mistral, Neomotron, Google's, or OpenAI's.
davidvgilmore
·先月·議論
Four ways: (1) We are built specifically for Claude Code model routing. (2) We route at a subagent/subtask level. (3) We support on-device routing. (4) We have a built-in ML router trained specifically to route Claude Code subagent tasks. Its use is optional.
davidvgilmore
·先月·議論
Yes - in short, open models like Deepseek, Mimo, Kimi, and GLM tend to complete tasks with less tokens and cost less per token than both Sonnet and Haiku. So those models are more cost efficient, and we often think of that as them having higher "capability-per-dollar" than Sonnet or Haiku.

Much of Claude Code's internal model routing ends up delegating tasks to Sonnet or Haiku, so by intercepting those calls and using open models instead, we often see better performance at a better price.