Okay so regardless of the model, platforms provide attestation from end to end that nothing is being logged from either input or output, including at the firmware and OS level to the extent that the customers have proof of the data never being saved. AFAIK, both GPUs and TPUs support this.
From a third-world perspective, it feels like American politics being injected into the developer domain because of some previous biases that Americans had. Which is sad for a community that claims to be global.
Or maybe he was searching for "structure", the way Grothendieck was - in pure math, in systems biology, in complex networks (e.g. civilizations, culture, occult) and in individual behaviors
I wonder how many of these hype-chasing AI founders are going to take the path of self-enrichment while capitulating their startups when they get exhausted of searching for a moat.
Ah so like NIM is a set of microservices on top of various models, and this is another set of microservices using NIM microservices to do large scale OCR?
and that too integrated with prometheus, 160GB VRAM requirement and so on?
Looks like this is targeted for enterprises or maybe governments etc trying to digitalize at scale.