Tesla CEO and Twitter/X owner Elon Musk announced Monday that his AI startup, xAI, had officially begun training its Memphis supercomputer, what he describes as “the most powerful AI training cluster in the world.”
Nice work by @xAI team, @X team, @Nvidia & supporting companies getting Memphis Supercluster training started at ~4:20am local time.
— Elon Musk (@elonmusk) July 22, 2024
With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world!
Elon Musk’s AI startup xAI has commenced training on its Memphis supercomputer, described as the world’s most powerful AI training cluster. Musk aims to develop the most powerful AI, Grok 3, by December 2024. The supercomputer, housed in a former Electrolux facility in Memphis, uses 100,000 Nvidia H100 GPUs. This marks the largest capital investment by a new company in Memphis’ history, though it will generate only a few hundred local jobs.