How many users can a $50K AI workstation serve? Benchmark data(old.reddit.com)
old.reddit.com
How many users can a $50K AI workstation serve? Benchmark data
https://old.reddit.com/r/LocalLLaMA/comments/1qorbdk/dual_rtx_pro_6000_workstation_with_115tb_ram/
2 comments
yes, private AI is not financially viable right now vs. APIs. The main reason to invest in such hardware is privacy and security.
Also hard to justify the $50k capex compared to just hitting the Anthropic API. You'd need massive volume to break even on that hardware especially with electricity costs. Seems like overoptimization unless you have strict data privacy needs.