So Who Is Building That 100k GPU Cluster for XAI?(nextplatform.com)

So Who Is Building That 100k GPU Cluster for XAI?

https://www.nextplatform.com/2024/07/30/so-who-is-building-that-100000-gpu-cluster-for-xai/

10 comments

I just drove by the site for fun the other day. Probably 500 cars parked out front of workers. They’ve installed what appear to be a 6-8 large gas generators on the north end parking lot to provide more power until they get larger links set up to the new TVA combined cycle gas plant, 1.2 GW facility across the street. That’s about all, onsite.

More impressive than that though is the 1000+ acres of empty land going south that is prepped for future industry. As a Memphian, I hope Elon sees the potential to build huge scale stuff here in the future. There’s a huge steel mill, a river terminal for direct access to oversized shipping, a wastewater plant next door, a large Valero oil refinery up the street, and a Canadian National intermodal facility down the road.

Literally everything one would need to build millions of robots or trucks or rocket engines or whatever.

https://maps.app.goo.gl/NuHUpg6CcndxyKHK9?g_st=com.google.ma...

lagniappe2 anni fa

Dell

Specifically, the XE9680 racks ( 8xH100 ). 100k H100 GPU, 300k B200 GPU, liquid cooled doors in the racks, 750 racks, and some other minor details.

plegresl2 anni fa

Dell is half the racks, the other half are SuperMicro:

https://x.com/elonmusk/status/1803429159005241780

[deleted]2 anni fa

echelon2 anni fa

Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest. He was given all the money he needs to catch up and then some.

It doesn't look like there are any moats to speak of.

Havoc2 anni fa

>Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest.

With a 100k GPUs? I think not.

Nvidia shipped 150k+ to both meta and MS each JUST in 2023:

https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...

Certainly puts him in the running though

rbanffy2 anni fa

They also have the Dojo wafer-scale chips. A different process from the Cerebras one - this is more like a wafer sized interposer with large chipsets. Still pretty cool.

[deleted]2 anni fa

uncharted92 anni fa

Cool article from the perspective of setting up a data center, but the big question remains - Why?

If the goal is to create a bigger, faster, smarter version of OpenAI's GPT, then I'm not sure if this sounds even logical. The current crop of LLM models is just a Q&A hallucination filled chatbot which are way past their peak hype cycle. There is still no business model or killer product-market fit. I don't know what the investors are expecting, but they are more than willing to throw more than 6B dollars. So idk. °_°