So Who Is Building That 100k GPU Cluster for XAI?(nextplatform.com)
nextplatform.com
So Who Is Building That 100k GPU Cluster for XAI?
https://www.nextplatform.com/2024/07/30/so-who-is-building-that-100000-gpu-cluster-for-xai/
10 comments
Dell
Specifically, the XE9680 racks ( 8xH100 ). 100k H100 GPU, 300k B200 GPU, liquid cooled doors in the racks, 750 racks, and some other minor details.
Specifically, the XE9680 racks ( 8xH100 ). 100k H100 GPU, 300k B200 GPU, liquid cooled doors in the racks, 750 racks, and some other minor details.
Dell is half the racks, the other half are SuperMicro:
https://x.com/elonmusk/status/1803429159005241780
https://x.com/elonmusk/status/1803429159005241780
[deleted]
Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest. He was given all the money he needs to catch up and then some.
It doesn't look like there are any moats to speak of.
It doesn't look like there are any moats to speak of.
>Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest.
With a 100k GPUs? I think not.
Nvidia shipped 150k+ to both meta and MS each JUST in 2023:
https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...
Certainly puts him in the running though
With a 100k GPUs? I think not.
Nvidia shipped 150k+ to both meta and MS each JUST in 2023:
https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...
Certainly puts him in the running though
They also have the Dojo wafer-scale chips. A different process from the Cerebras one - this is more like a wafer sized interposer with large chipsets. Still pretty cool.
[deleted]
[deleted]
Cool article from the perspective of setting up a data center, but the big question remains - Why?
If the goal is to create a bigger, faster, smarter version of OpenAI's GPT, then I'm not sure if this sounds even logical. The current crop of LLM models is just a Q&A hallucination filled chatbot which are way past their peak hype cycle. There is still no business model or killer product-market fit. I don't know what the investors are expecting, but they are more than willing to throw more than 6B dollars. So idk. °_°
If the goal is to create a bigger, faster, smarter version of OpenAI's GPT, then I'm not sure if this sounds even logical. The current crop of LLM models is just a Q&A hallucination filled chatbot which are way past their peak hype cycle. There is still no business model or killer product-market fit. I don't know what the investors are expecting, but they are more than willing to throw more than 6B dollars. So idk. °_°
More impressive than that though is the 1000+ acres of empty land going south that is prepped for future industry. As a Memphian, I hope Elon sees the potential to build huge scale stuff here in the future. There’s a huge steel mill, a river terminal for direct access to oversized shipping, a wastewater plant next door, a large Valero oil refinery up the street, and a Canadian National intermodal facility down the road.
Literally everything one would need to build millions of robots or trucks or rocket engines or whatever.
https://maps.app.goo.gl/NuHUpg6CcndxyKHK9?g_st=com.google.ma...