HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Blemiono

no profile record

comments

Blemiono
·قبل 6 أشهر·discuss
Come on... He survived before and now he supports a democracy killer
Blemiono
·قبل 6 أشهر·discuss
[flagged]
Blemiono
·قبل 6 أشهر·discuss
[dead]
Blemiono
·قبل 6 أشهر·discuss
[dead]
Blemiono
·قبل 6 أشهر·discuss
A RTX 6000 pro costs 9k. You can run good models with 96gb of memory.

It can easily serve 10 people or more depending on the overall usage pattern (coding vs everything else).

So now imagine Hardware getting better every year, models getting better too and everything overall gets more efficient.

M1 vs M4 apple increased performance by 100% in 4 years

And there are inferencing optimized chips like groq.

Don't forget kv cache and overall optimizations.

I think your math is off.

And ai is already better than interns. An intern costs you at least 1k per month probably 2k.

For me the math works just fine.
Blemiono
·قبل 6 أشهر·discuss
[dead]