HackerTrans
TopNewTrendsCommentsPastAskShowJobs

davidvgilmore

no profile record

Submissions

Show HN: Rayline routes Claude Code subagents to on-device and cheaper models

rayline.ai
11 points·by davidvgilmore·เดือนที่แล้ว·9 comments

Show HN: Dbt-skillz compiles your dbt project into a Claude Code skill

github.com
4 points·by davidvgilmore·4 เดือนที่ผ่านมา·0 comments

comments

davidvgilmore
·เดือนที่แล้ว·discuss
For those that have capable enough hardware, it's effectively free to run subtasks on-device. (just the marginal cost of additional electricity).

With Google's most recent 12b param Gemma model, even Mac users with just 16gb of unified memory can offload some tasks on-device.
davidvgilmore
·เดือนที่แล้ว·discuss
Many of them are produced by Chinese labs. Some, like Neomotron, are U.S. made. And we support inference providers in both the U.S. and overseas.

If geography is important, we can restrict which geos inference takes place in. And if you don't want to use Chinese-trained models, you can use others like Mistral, Neomotron, Google's, or OpenAI's.
davidvgilmore
·เดือนที่แล้ว·discuss
Four ways: (1) We are built specifically for Claude Code model routing. (2) We route at a subagent/subtask level. (3) We support on-device routing. (4) We have a built-in ML router trained specifically to route Claude Code subagent tasks. Its use is optional.
davidvgilmore
·เดือนที่แล้ว·discuss
Yes - in short, open models like Deepseek, Mimo, Kimi, and GLM tend to complete tasks with less tokens and cost less per token than both Sonnet and Haiku. So those models are more cost efficient, and we often think of that as them having higher "capability-per-dollar" than Sonnet or Haiku.

Much of Claude Code's internal model routing ends up delegating tasks to Sonnet or Haiku, so by intercepting those calls and using open models instead, we often see better performance at a better price.