Cisco and NVidia simplify deployment of AI infrastructures

neural network brain of AI
Sheila Zabeu -

June 12, 2024

Cisco has launched, in partnership with NVidia, an AI cluster solution that transforms the way datacenter infrastructure and software are built, managed and optimized. The new Cisco Nexus HyperFabric for AI clusters will simplify the deployment of Generative Artificial Intelligence (AI) applications by providing better visibility and IT analytics capabilities of the entire AI infrastructure stack.

The clusters combine Cisco’s AI-native networking solutions with NVidia’s accelerated computing and AI software, as well as a robust VAST storage system. From a single location, Cisco Nexus HyperFabric for AI helps design, deploy and monitor AI pods and workloads in datacenters. With cloud management capabilities, you can easily deploy and manage large-scale meshes in datacenters, colocation facilities and edge computing sites.

“While the promised benefits of AI are clear, the path forward for many who are starting out is not so obvious. They often face economic and operational challenges in getting an AI stack up and running,” says Jonathan Davidson, executive vice president and general manager of Cisco Networking. “Cisco is committed to simplifying the deployment and operation of AI infrastructures. Together with NVidia, we are offering a simple-to-deploy, cloud-operated AI stack solution that builds on the vision of our Cisco Networking Cloud platform for automation and simplicity.”

“Generative AI requires specific infrastructure and software to securely turn data into fuel for business transformation,” said Kevin Deierling, senior vice president of networking at NVidia. “NVidia and Cisco are offering an enterprise-ready AI platform and control plane to simplify the deployment of accelerated computing, networking and software systems required for Generative AI workloads.”

O pacote Cisco Nexus HyperFabric para IA inclui:

  • Cisco cloud management capabilities to simplify IT operations at every stage of the workflow;
  • Cisco 6000 series spine-leaf switches offering 400G and 800G Ethernet mesh performance;
  • Cisco Optics family of QSFP-DD modules for super-high densities;
  • NVidia AI Enterprise software to accelerate the development and deployment of Generative AI workloads;
  • NVidia NIM inference microservices that accelerate the deployment of basic models and guarantee data security. They are available with NVidia AI Enterprise;
  • NVidia Tensor Core GPUs, starting with NVIDIA H200 NVL, designed to turbocharge Generative AI workloads;
  • DPU NVidia BlueField-3 and SuperNIC BlueField-3 to accelerate AI computing networks, data access and workloads;
  • Enterprise reference design for AI based on NVidia MGX, modular and flexible server architecture;
  • VAST data platform, which offers storage, database and data-oriented function engine developed for AI.

Cisco Nexus HyperFabric for AI will be available to selected customers for early testing in the fourth quarter of 2024, with general availability expected shortly thereafter.

Investments in startups

During the Cisco LIVE 2024 networking and security event, Cisco also announced a $1 billion global investment fund to expand and develop secure and reliable AI solutions. The main focus of the strategic investment are the companies Cohere, Mistral AI and Sale AI, which will promote several critical areas, such as computational infrastructure, model development and training.

The aim is to promote innovation in the sector and help prepare customers for the new wave of technology, as well as supporting Cisco’s strategy of connecting and protecting organizations in a future driven by Artificial Intelligence. To date, Cisco has committed almost 200 million dollars to this fund.

According to Cisco, in recent years the company has made more than 20 acquisitions and investments focused on AI, expanding its Generative AI and machine learning capabilities and integrating AI across Cisco’s portfolio. In addition to the investments, it is also working with AI companies on collaborative initiatives around products that allow Cisco to co-innovate, while remaining a technologically agnostic supplier.

“At Cisco, we believe we are well positioned to be the best strategic partners for our customers in the AI era. In addition to developing essential technologies to connect, protect and promote AI, Cisco is committed to investing in a broader ecosystem to more effectively meet the demands of our customers,” says Mark Patterson, chief strategy officer at Cisco.

“Our $1 billion AI investment fund is a testament to our commitment to the transformative power of Artificial Intelligence and its potential to redefine many industries worldwide. It represents our unwavering commitment to AI and innovation, and to the entrepreneurs and visionaries who are defining the new wave of technology,” said Derek Idemoto, senior vice president of corporate development and investments at Cisco.