NVIDIA Teams With Microsoft to Build Massive Cloud AI Computer

NVIDIA | November 17, 2022 | Read time : 03:00 min

NVIDIA Teams With Microsoft to Build Massive Cloud AI Computer
NVIDIA today announced a multi-year collaboration with Microsoft to build one of the most powerful AI supercomputers in the world, powered by Microsoft Azure’s advanced supercomputing infrastructure combined with NVIDIA GPUs, networking and full stack of AI software to help enterprises train, deploy and scale AI, including large, state-of-the-art models.

Azure’s cloud-based AI supercomputer includes powerful and scalable ND- and NC-series virtual machines optimized for AI distributed training and inference. It is the first public cloud to incorporate NVIDIA’s advanced AI stack, adding tens of thousands of NVIDIA A100 and H100 GPUs, NVIDIA Quantum-2 400Gb/s InfiniBand networking and the NVIDIA AI Enterprise software suite to its platform.

As part of the collaboration, NVIDIA will utilize Azure’s scalable virtual machine instances to research and further accelerate advances in generative AI, a rapidly emerging area of AI in which foundational models like Megatron Turing NLG 530B are the basis for unsupervised, self-learning algorithms to create new text, code, digital images, video or audio.

The companies will also collaborate to optimize Microsoft’s DeepSpeed deep learning optimization software. NVIDIA’s full stack of AI workflows and software development kits, optimized for Azure, will be made available to Azure enterprise customers.

“AI technology advances as well as industry adoption are accelerating. The breakthrough of foundation models has triggered a tidal wave of research, fostered new startups and enabled new enterprise applications. “Our collaboration with Microsoft will provide researchers and companies with state-of-the-art AI infrastructure and software to capitalize on the transformative power of AI.”

Manuvir Das, vice president of enterprise computing at NVIDIA

“AI is fueling the next wave of automation across enterprises and industrial computing, enabling organizations to do more with less as they navigate economic uncertainties,” said Scott Guthrie, executive vice president of the Cloud + AI Group at Microsoft. “Our collaboration with NVIDIA unlocks the world’s most scalable supercomputer platform, which delivers state-of-the-art AI capabilities for every enterprise on Microsoft Azure.”

Scalable Peak Performance With NVIDIA Compute and Quantum-2 InfiniBand on Azure
Microsoft Azure’s AI-optimized virtual machine instances are architected with NVIDIA’s most advanced data center GPUs and are the first public cloud instances to incorporate NVIDIA Quantum-2 400Gb/s InfiniBand networking. Customers can deploy thousands of GPUs in a single cluster to train even the most massive large language models, build the most complex recommender systems at scale, and enable generative AI at scale.

The current Azure instances feature NVIDIA Quantum 200Gb/s InfiniBand networking with NVIDIA A100 GPUs. Future ones will be integrated with NVIDIA Quantum-2 400Gb/s InfiniBand networking and NVIDIA H100 GPUs. Combined with Azure’s advanced compute cloud infrastructure, networking and storage, these AI-optimized offerings will provide scalable peak performance for AI training and deep learning inference workloads of any size.

Accelerating AI Development and Deployment
Additionally, the platform will support a broad range of AI applications and services, including Microsoft DeepSpeed and the NVIDIA AI Enterprise software suite.

Microsoft DeepSpeed will leverage the NVIDIA H100 Transformer Engine to accelerate transformer-based models used for large language models, generative AI and writing computer code, among other applications. This technology applies 8-bit floating point precision capabilities to DeepSpeed to dramatically accelerate AI calculations for transformers — at twice the throughput of 16-bit operations.

NVIDIA AI Enterprise — the globally adopted software of the NVIDIA AI platform — is certified and supported on Microsoft Azure instances with NVIDIA A100 GPUs. Support for Azure instances with NVIDIA H100 GPUs will be added in a future software release.

NVIDIA AI Enterprise, which includes the NVIDIA Riva for speech AI and NVIDIA Morpheus cybersecurity application frameworks, streamlines each step of the AI workflow, from data processing and AI model training to simulation and large-scale deployment.

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Welcome back to our white paper series about how to use AI and data throughout the new business and underwriting processes. In the first white paper we discussed the importance of product design and the benefits of using AI.


Welcome back to our white paper series about how to use AI and data throughout the new business and underwriting processes. In the first white paper we discussed the importance of product design and the benefits of using AI.

Related News


Cognigy Launches Generative AI-powered Conversational AI Solutions

Cognigy | January 18, 2023

On January 17, 2023, Cognigy, a leading Conversational AI automation provider, announced that its Cognigy.AI platform would be improved with Generative AI, or Large Language Models (LLMs) such as OpenAI's GPT-3, to supplement Conversational AI deployments. The adoption of Generative AI will contribute to further transforming enterprise customer service and contact centers through the creation of improved conversational experiences and increasing efficiency. The prevalence of Generative AI solutions has escalated in recent months. ChatGPT, which was developed by OpenAI atop GPT-3 and made available for public testing on November 30, 2022, surpassed one million users within a week of its release. “According to MarketsandMarkets, the global conversational AI market size is expected to grow at a CAGR of 21.8% during the forecast period, 2021-2026.” As an AI business at the forefront of developing contact center solutions, Cognigy is already advancing the practical deployment of Generative AI. Conversational AI solutions driven by generative AI now enable bot authors to construct superior bots in a fraction of the time. Cognigy focuses on using Generative AI to assist bot developers and improve conversations. Cognigy has identified three major areas wherein Generative AI has a significant impact when combined with Conversational AI: Improving the user experience with advanced AI-powered discussions tailored to the individual's circumstances and preferences. Improving agent performance by exploiting language model capabilities in natural language understanding and generation. Increasing efficiency and cost savings by streamlining the creation and deployment of enterprise-level conversational bots. With a range of products including Conversational IVR, Smart Self-Support, and Agent + Assist, the Cognigy.AI platform offers next-generation customer service. Cognigy.AI enables organizations to create personalized service experiences at scale, 24/7, both on voice and chat. About Cognigy Founded in 2016, Cognigy is an enterprise software provider for Conversational AI automation that enables enterprise contact centers to exceed customer expectations, enhance agent satisfaction, and swiftly adapt to market changes. Since its inception, it has continued to be one of Europe's fastest-growing technology firms. Its platform, Cognigy.AI, automates customer and employee communications. Available in both on-premises and SaaS contexts, Cognigy.AI enables organizations to have natural language interactions with their users on any channel and in any language, including webchat, SMS, phone, and mobile apps. Over 500 organizations globally rely on Cognigy and its extensive network of partners to offer customer and staff service that all appreciate. Its global clientele consists of Bosch, Toyota, Mercedes-Benz, BioNTech, Fidelity Life, and Lufthansa Group, among others.

Read More


Market Logic Software to Develop New Generative AI Solutions for Consumer Insights Products

Market Logic Software | January 20, 2023

On January 19, 2023, Market Logic Software, a global insights management solutions provider, announced the development of a new range of Artificial Intelligence for Consumer Insights (AICI) products aimed at enterprise market research and consumer insights teams. The first product in the portfolio, scheduled for release in Q2 2023, will help break through the use of an AICI assistant that can be embedded within standard applications to support interactive decision-making for consumer businesses 24/7 and will benefit from the OpenAI Large Language Model (LLM). This new product complements Market Logic's expertise in managing market and consumer information within enterprise organizations by introducing generative AI capabilities. Rather than a list of search results, this technology will provide corporate users with complete, natural language answers to market and consumer intelligence quiries. Market Logic's announcement builds on its long history of innovation in the insights industry. Companies like Nike, L'Oréal, Mercedes-Benz, Phillips, and Unilever are among the users of the award-winning insights engagement platform. It helps to unify all internal and external knowledge assets, undertake new research, and connect with business stakeholders through a single hub. Market Logic has already enrolled several Fortune 500 companies in its AICI assistant product limited beta program. The product will be released globally later this year, according to the company. About Market Logic Founded in 2006, Market Logic Software is a leading insights management solutions provider. It empowers insights and analytics teams to turn data and information into actionable consumer and market knowledge. Its award-winning insights engagement platform assists the world's leading brands in generating and capitalizing on insights. Market Logic works for clients all over the world across various sectors, including CPG, healthcare, retail, automotive, finance, and telecom. It allows firms to access 600+ research agencies and 1000+ industry sources to develop memorable, actionable insights in a fraction of the time and cost.

Read More


QMetry Launches True Codeless Test Automation for Agile Teams

QMetry | November 09, 2022

QMetry, a leading AI enabled continuous testing platform company has announced the launch of its all new codeless test automation platform - QMetry Automation Studio (QAS). It is true codeless test automation for agile development teams that offers faster, customizable, extensible, and simple test automation. “We built this in record time to address the gap for a true codeless test automation that enables testers, developers, and business analysts to deliver test automation with no coding skills required. We expect that QAS will help increase ROI (return on investment) by 30 %, and reduce test maintenance costs by up to 50 % for digital enterprises.” QMetry CEO, Makarand Teje QMetry Automation Studio offers cross-platform support across web, mobile, and web services / APIs. It offers efficient test execution across many device clouds. It has seamless integrations with CI/CD tools like Jenkins, GitLab, and Bamboo. It has built-in test data management enabled through data parameterization. QAS offers real time reporting, and AI enabled features like self-healing, smart wait, and auto correction. It will be integrate with QMetry Test Management to provide better project control, collaboration, and intelligent reporting. For a limited time, 5 user license for the first year is offered free and is available to download here. Beyond 5 users, the annual license per user is priced at USD 1200, with no strings attached. About QMetry QMetry is the #1 AI-enabled digital quality platform delivering continuous testing and empowering enterprises to build, manage, and deploy quality software faster with confidence. We are trusted by 1200+ global customers, including 25+ Fortune 500 companies across major industry verticals like Hitech, BFSI, healthcare, retail, media, Government and others.

Read More