Elon Musk’s company xAI is ramping up the power of its supercomputer in Memphis to at least 1 million GPUs. It is already considered the largest in the world, but the expansion will increase its GPU count by 10 times.
Elon Musk’s company xAI is ramping up the power of its supercomputer in Memphis to at least 1 million GPUs. It is already considered the largest in the world, but the expansion will increase its GPU count by 10 times.
In this way, xAI is trying to accelerate the development of AI and stay ahead of such competitors as OpenAI and Google, reports Business Insider. GPUs are used to train and run the Grok chatbot, which is an attempt to replicate OpenAI’s ChatGPT and Google’s Gemini.
«In Memphis, we are pioneering development in the heart of America. We’re not just leading the way, we’re accelerating progress at an unprecedented rate, ensuring network stability using megapacket technology», — said Brent Mayo, xAI Engineer.
Nvidia, which supplies its chips for Colossus, along with Dell and Supermicro Computer also plan to set up operations in Memphis, the Greater Memphis Chamber said.
xAI built its Colossus supercomputer at a rapid pace. The facility and supercomputer were built by xAI and Nvidia in just 122 days.
According to Elon Musk, it took just 19 days from the installation of the equipment to the start of Colossus training, which is «the fastest anyone has ever done.»
Jensen Huang, Nvidia’s CEO, praised the speed of xAI’s deployment, calling it a «superhuman» task. He said a project like Colossus typically takes «three years to plan» and another year to launch.
The Wall Street Journal previously reported that xAI is valued at $50 billion, doubling its valuation since the spring. Investors in xAI’s latest funding round include Sequoia Capital and Andreessen Horowitz. Earlier this year, xAI raised $6 billion in Series B investment from A16z and Sequoia Capital at a $24 billion valuation. The new round means the AI company has raised a total of $11 billion this year.
Recall that in the summer of this year, Tesla CEO Elon Musk admitted that he was «very concerned» that the company could not get access to Nvidia’s top-level graphics processors due to the rapid growth in demand for microprocessors in the technology sector.
Earlier, Musk ordered the redirection of thousands of Nvidia artificial intelligence chips from Tesla to Company X. This move could delay the receipt of the $500 million processors needed by Tesla for several months.
