Don't Buy These GPU's for Local AI Inference(aiflux.substack.com)

4 pointsby ericdotlee10 miesięcy temu1 comments

aiflux.substack.com

Don't Buy These GPU's for Local AI Inference

https://aiflux.substack.com/p/dont-buy-these-gpus-for-local-ai

1 comments

ericdotlee10 miesięcy temu

With the recent release of Qwen-3 Omni I've decided to put together my first local machine. As much as I just want to pick up a beelink and flash it with Omarchy I think I want a bit more horsepower.

However, the internet seems littered with "clever" loca ai monstrosities that gang together 4-6 ancient nVidia GPU's (priced today to seem like overpriced e-waste) to get lackluster performance from piles of nVidia m60's and P100's? In 2025 this kind of seems like a waste or just bad advice to use hardware this old?

Curious if this find seems like a good source of info regarding staying away from Intel and AMD GPU's for local inference? Might do some training but right now more interested in light RAG and maybe some local coding.

Hoping to build something before the holiday season to keep my office warm with GPU's :).

Thanks!