NVIDIA Teams With Microsoft to Build Massive Cloud AI Computer

NVIDIA | November 17, 2022 | Read time : 03:00 min

NVIDIA Teams With Microsoft to Build Massive Cloud AI Computer
NVIDIA today announced a multi-year collaboration with Microsoft to build one of the most powerful AI supercomputers in the world, powered by Microsoft Azure’s advanced supercomputing infrastructure combined with NVIDIA GPUs, networking and full stack of AI software to help enterprises train, deploy and scale AI, including large, state-of-the-art models.

Azure’s cloud-based AI supercomputer includes powerful and scalable ND- and NC-series virtual machines optimized for AI distributed training and inference. It is the first public cloud to incorporate NVIDIA’s advanced AI stack, adding tens of thousands of NVIDIA A100 and H100 GPUs, NVIDIA Quantum-2 400Gb/s InfiniBand networking and the NVIDIA AI Enterprise software suite to its platform.

As part of the collaboration, NVIDIA will utilize Azure’s scalable virtual machine instances to research and further accelerate advances in generative AI, a rapidly emerging area of AI in which foundational models like Megatron Turing NLG 530B are the basis for unsupervised, self-learning algorithms to create new text, code, digital images, video or audio.

The companies will also collaborate to optimize Microsoft’s DeepSpeed deep learning optimization software. NVIDIA’s full stack of AI workflows and software development kits, optimized for Azure, will be made available to Azure enterprise customers.

“AI technology advances as well as industry adoption are accelerating. The breakthrough of foundation models has triggered a tidal wave of research, fostered new startups and enabled new enterprise applications. “Our collaboration with Microsoft will provide researchers and companies with state-of-the-art AI infrastructure and software to capitalize on the transformative power of AI.”

Manuvir Das, vice president of enterprise computing at NVIDIA

“AI is fueling the next wave of automation across enterprises and industrial computing, enabling organizations to do more with less as they navigate economic uncertainties,” said Scott Guthrie, executive vice president of the Cloud + AI Group at Microsoft. “Our collaboration with NVIDIA unlocks the world’s most scalable supercomputer platform, which delivers state-of-the-art AI capabilities for every enterprise on Microsoft Azure.”

Scalable Peak Performance With NVIDIA Compute and Quantum-2 InfiniBand on Azure
Microsoft Azure’s AI-optimized virtual machine instances are architected with NVIDIA’s most advanced data center GPUs and are the first public cloud instances to incorporate NVIDIA Quantum-2 400Gb/s InfiniBand networking. Customers can deploy thousands of GPUs in a single cluster to train even the most massive large language models, build the most complex recommender systems at scale, and enable generative AI at scale.

The current Azure instances feature NVIDIA Quantum 200Gb/s InfiniBand networking with NVIDIA A100 GPUs. Future ones will be integrated with NVIDIA Quantum-2 400Gb/s InfiniBand networking and NVIDIA H100 GPUs. Combined with Azure’s advanced compute cloud infrastructure, networking and storage, these AI-optimized offerings will provide scalable peak performance for AI training and deep learning inference workloads of any size.

Accelerating AI Development and Deployment
Additionally, the platform will support a broad range of AI applications and services, including Microsoft DeepSpeed and the NVIDIA AI Enterprise software suite.

Microsoft DeepSpeed will leverage the NVIDIA H100 Transformer Engine to accelerate transformer-based models used for large language models, generative AI and writing computer code, among other applications. This technology applies 8-bit floating point precision capabilities to DeepSpeed to dramatically accelerate AI calculations for transformers — at twice the throughput of 16-bit operations.

NVIDIA AI Enterprise — the globally adopted software of the NVIDIA AI platform — is certified and supported on Microsoft Azure instances with NVIDIA A100 GPUs. Support for Azure instances with NVIDIA H100 GPUs will be added in a future software release.

NVIDIA AI Enterprise, which includes the NVIDIA Riva for speech AI and NVIDIA Morpheus cybersecurity application frameworks, streamlines each step of the AI workflow, from data processing and AI model training to simulation and large-scale deployment.

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Discover the magic of advanced AI with 'The Magical AI: Unveiling the Mystery of ChatGPT.' Through a mix of narration, animation, and expert interviews, this video explores the fascinating world of ChatGPT, a powerful AI language model developed by OpenAI. Learn how it works, how it's changing the way we interact with technology, and the ethical and societal implications of AI like ChatGPT. Perfect for tech enthusiasts, curious consumers, and anyone interested in the cutting-edge technology that is shaping our world.


Discover the magic of advanced AI with 'The Magical AI: Unveiling the Mystery of ChatGPT.' Through a mix of narration, animation, and expert interviews, this video explores the fascinating world of ChatGPT, a powerful AI language model developed by OpenAI. Learn how it works, how it's changing the way we interact with technology, and the ethical and societal implications of AI like ChatGPT. Perfect for tech enthusiasts, curious consumers, and anyone interested in the cutting-edge technology that is shaping our world.

Related News


Copado Brings Generative AI to Its DevOps Platform to Improve Software Development for Enterprise SaaS

Prnewswire | May 05, 2023

Copado, a leader in low-code DevOps, today announced the launch of Copado AI, a program aimed to make enterprise SaaS development faster, easier and more accessible by reducing complexity and improving productivity for both technical and non-technical users. By bridging the gap between business need and end-code, Copado's AI program enables organizations to realize the full potential of their DevOps tools and maximize their enterprise SaaS investment. The first product in the Copado AI program is the Copado AI Companion which launched today on the DevOps Exchange. The first feature available is User Story Enrichment, a generative AI co-pilot that grooms requirements to ensure user stories are complete for development and testing. User story enrichment empowers business analysts, administrators, and developers to refine every aspect of a user story, from the title and acceptance criteria to the most intricate details, eliminating the time spent on finding the right words or phrasing and reducing human errors. "Copado started because we wanted to make release days easier for everyone so they could go home and be with their families," said Federico Larsen, Founder and Chief Technology Officer of Copado. "Embracing generative AI in our platform is not just an evolution of our original vision, it's high octane jet fuel, allowing us to make gains we couldn't have imagined even five years ago." As demands on IT increase, AI and automation will be the only way to increase speed while improving quality. Today, automation saves Copado customers 25 million development hours annually, reduces app failure rates by 78%, and has enabled them to release 10x more features. Copado AI promises to boost those figures even higher. The Copado AI program leverages OpenAI and proprietary frameworks to explore generative AI pilots across the entire development lifecycle, including pipeline automation, suggestive AI, test automation and exploratory testing. Copado's sole focus on low-code DevOps for enterprise SaaS makes Copado AI the only co-pilot program to address both source format and metadata pipelines. The Copado team will be hosting demos of the DevOps platform in booth 5 at Salesforce World Tour New York today as an Innovator Sponsor. About Copado Copado is the leading DevOps and testing solution for low-code SaaS platforms that run the world's largest digital transformations. Backed by Insight Partners, Salesforce Ventures and SoftBank Vision Fund, Copado accelerates enterprise SaaS deployments by automating the end-to-end software delivery process to maximize customers' return on their cloud investment. More than 1,200 companies rely on Copado to drive digital transformation with speed, quality and value including Boston Scientific, Coca-Cola, Fair Trade, Linde, MassMutual, Schneider Electric and Shell. Copado processes over 50 million DevOps transactions per month and is rated with a 100% score on the Salesforce AppExchange. More information can be found at:

Read More


SearchUnify Announces Industry-first Robust LLM Integration to Elevate Customer Support Outcomes

Prnewswire | April 06, 2023

SearchUnify, a leading unified cognitive platform, today announced an industry-first comprehensive and secure integration with OpenAI™ and Hugging Face™, to enrich support and self-service experiences across the customer lifecycle. With this integration of the platform and its suite of products with Large Language Models (LLMs), SearchUnify is geared to render predictive, contextual, data-driven and agile experiences. This integration will help enterprises leverage the LLM capabilities, including conversational AI, headline and abstract generation, machine translation, sentiment analysis, and language modeling. Businesses will be able to help their customers and employees make the most of generative AI capabilities, while guardrailing and distilling inferences to combat decision bias. "Language models have long been a part of SearchUnify's DNA. With recent strides in generative AI, the influence of AI and LLMs on our lives is only going to grow stronger. SearchUnify adds a layer of security and accessibility to the mix. This approach will not only foster trust but also empower businesses to deliver experiences that are relevant, secure, and state-of-the-art," said Vishal Sharma, CTO, SearchUnify. In a bid to help the customer service leaders ride this technology wave, SearchUnify is gearing up for its upcoming virtual event, SU Innovate, scheduled for April 27, 2023. About SearchUnify SearchUnify is a unified cognitive platform by Grazitti Interactive that revolutionizes information findability, fuels intelligent enterprise search, and makes for a robust platform for AI-based apps like Intelligent Chatbot, Agent Helper, KCS Enabler, Escalation Predictor, and Community Helper. Its AI powers relevant and personalized search results for customers, partners, and employees across industries.

Read More


Appy Pie Design Announces AI Photo Enhancer

Prnewswire | March 27, 2023

Appy Pie Design, the online graphic design software has launched AI Photo Enhancer - an AI-powered platform that enhances the quality of images, making them visually striking and appealing. Appy Pie Design's AI Photo Enhancer allows users to elevate the quality of their photos with ease. This feature is particularly useful for photographers, designers, or anyone seeking to enhance their photos. Utilizing advanced AI algorithms, the tool analyzes the image and instantly adjusts essential factors like brightness, contrast, saturation, and more, resulting in a superior and top-notch output. "We're thrilled to introduce the AI Photo Enhancer feature to our users. Our team has worked hard to develop such an AI-powered solution that streamlines the process of enhancing photos while delivering professional-grade results," said Abhinav Girdhar, Founder and CEO of Appy Pie. "At Appy Pie Design, we're committed to delivering innovative software solutions that help our customers succeed. With the AI Photo Enhancer, we believe we've created a tool that will help photographers and designers take their work to the next level" he added further. The AI Photo Enhancer feature includes an array of tools in order to help users fine-tune their photos. They can also choose from a variety of filters and effects to give their photos a unique look and feel. About Appy Pie Appy Pie, a Trademark of Appy Pie LLP, is a no-code development platform that helps transform business ideas into reality without technical knowledge. It is an all-inclusive suite of the best no-code tools like an app builder, website builder, workflow automation platform, graphic design software, chatbot builder, help desk software, and live chat software. Appy Pie's App Maker has been recognized as one of the highest-rated app builders globally (G2) for its unique features, ease of use, and affordability, and is considered one of the most comprehensive no-code application development software for businesses of all sizes (Capterra).

Read More