HackerTrans
トップ新着トレンドコメント過去質問紹介求人

samdhar

no profile record

投稿

[untitled]

1 ポイント·投稿者 samdhar·23 日前·0 コメント

コメント

samdhar
·2 か月前·議論
[flagged]
samdhar
·2 か月前·議論
[flagged]
samdhar
·2 か月前·議論
[flagged]
samdhar
·2 か月前·議論
[flagged]
samdhar
·2 か月前·議論
[flagged]
samdhar
·2 か月前·議論
Cached input at $0.003625/M, output at $0.435/M. Aggressive pricing.

For anyone doing the "should I self-host on rented GPUs?" math: at this rate you'd need to push roughly 1B output tokens/day to break even against an 8xH100 fleet on Vast/Lambda (assuming 3-5k tokens/sec aggregate throughput). The vast majority of "I should run my own LLM" use cases don't come close to that volume.

Every API price drop kills another tranche of "self-host the open model" use cases. The implied bet: even if regular pricing ($1.74/M output) is also subsidized, exponential demand growth eventually makes the unit economics work. We'll see.