dexterac·قبل سنتين·discussHow many customers/consumers will care about services are be built with CUDA?If they need a ChatBot that uses a model with same accuracy and performance as on non-CUDA hardware, would they still want CUDA based hardware?
dexterac·قبل سنتين·discuss"Everyone" at top is also developing their own chips for inference and providing APIs for customers to not worry about using CUDA.It looks like the price to performance of inference tasks gives providers a big incentive to move away from Nvidia.
If they need a ChatBot that uses a model with same accuracy and performance as on non-CUDA hardware, would they still want CUDA based hardware?