Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

Microsoft explains how thousands of Nvidia GPUs built ChatGPT

ChatGPT rose to viral fame over the past six months, but it didn’t come out of nowhere. According to a blog post published by Microsoft on Monday, OpenAI, the company behind ChatGPT, reached out to Microsoft to build AI infrastructure on thousands of Nvidia GPUs more than five years ago.

OpenAI and Microsoft’s partnership has caught a lot of limelight recently, especially after Microsoft made a $10 billion investment in the research group that’s behind tools like ChatGPT and DALL-E 2. However, the partnership started long ago, according to Microsoft. Since then, Bloomberg reports that Microsoft has spent “several hundred million dollars” in developing the infrastructure to support ChatGPT and projects like Bing Chat.

Hopper H100 graphics card.

Much of that money went to Nvidia, which is now in the forefront of computing hardware required to train AI models. Instead of gaming GPUs like you’d find on a list of the best graphics cards, Microsoft went after Nvidia’s enterprise-grade GPUs like the A100 and H100.

It’s not just as simple as getting graphics cards together and training a language model, though. As Nidhi Chappell, Microsoft head of product for Azure, explains: “This is not something that you just buy a whole bunch of GPUs, hook them together, and they’ll start working together. There is a lot of system-level optimization to get the best performance, and that comes with a lot of experience over many generations.”

With the infrastructure in place, Microsoft is now opening up its hardware to others. The company announced on Monday in a separate blog post that it would offer Nvidia H100 systems “on-demand in sizes ranging from eight to thousands of Nvidia H100 GPUs,” delivered through Microsoft’s Azure network.

The popularity of ChatGPT has skyrocketed Nvidia, which has invested in AI through hardware and software for several years. AMD, Nvidia’s main competitor in gaming graphics cards, has been attempting to make headway into the space with accelerators like the Instinct MI300.

According to Greg Brockman, president and co-founder of OpenAI, training ChatGPT wouldn’t have been possible without the horsepower provided by Microsoft: “Co-designing supercomputers with Azure has been crucial for scaling our demanding AI training needs, making our research and alignment work on systems like ChatGPT possible.”

Nvidia is expected to reveal more about future AI products during the GPU Technology Conference (GTC). with the keynote presentation kicks things off on March 21. Microsoft is expanding its AI road map later this week, with a presentation focused around the future of AI in the workplace scheduled for March 16.

Editors' Recommendations

DuckDuckGo is taking on ChatGPT without busting your privacy
The DuckAssist tool in the DuckDuckGo web browser showing a search result with an AI-generated answer summary at the top.

Privacy-focused web browser DuckDuckGo is adding artificial intelligence (AI) smarts to its search results with a new summarizer feature. It’s just the latest browser to integrate AI into its offerings, and suggests you can have both privacy and AI in the age of ChatGPT.

Dubbed DuckAssist, the tool takes your search query and generates an answer summary from Wikipedia, placing this synopsis at the top of your search results. In keeping with DuckDuckGo’s emphasis on privacy, DuckAssist works anonymously using AI natural language technology.

Read more
Microsoft is slowly lifting Bing Chat’s restrictive turn limits
Microsoft Edge browser showing Bing Chat on an iPhone.

Microsoft has upped the chat turn limit on its Bing Chat service yet again, now allowing 120 daily turns (10 per session), according to Yusuf Mehdi, consumer chief marketing officer at Microsoft. The increase comes on the heels of some unhinged responses Bing Chat generated due to high turn limits its in public debut. This the second time in the past week or so that Microsoft has raised turn limits on Bing Chat.

The brand has been making frequent tweaks to Bing Chat. Most recently, it increased the daily turn limit from 60 turns a day to 100 turns in a major update that rolled out on February 24. When Bing Chat was still in its public preview earlier in February, it supported 50 daily turns, which was quickly bumped up to 60 daily turns due to user interest.

Read more
Google missed big chance with ChatGPT-like tech, report claims
Google Logo

Google missed a golden opportunity to lead the way with its own ChatGPT-like chatbot technology tool two years ago, but an overly cautious attitude from those at the top prevented the company from releasing it, according to a Wall Street Journal report on Tuesday.

The two Google researchers who created the powerful conversational AI technology reportedly told colleagues at the time that their creation could revolutionize how people searched on the internet and worked with computers.

Read more