Intel Gaudi 3 AI Accelerators Witness First Major Adoption By IBM, Expected To Be Available By Early 2025

Intel Gaudi 3 AI Accelerators Witness First Major Adoption By IBM, Expected To Be Available By Early 2025 1

Intel has announced a major partnership with IBM on the Gaudi 3 AI accelerators, marking the first "formal" adoption of the AI accelerator by a mainstream cloud service provider.

[Press Release]: IBM and Intel have announced a collaboration to deploy IntelGaudi 3 AI accelerators as a service on IBM Cloud. This offering, which is expected to be available in early 2025, aims to help more cost-effectively scale enterprise AI and drive innovation underpinned with security and resiliency. This collaboration will also enable support for Gaudi 3 within IBM's watsonx AI and data platform. IBM Cloud is the first cloud service provider (CSP) to adopt Gaudi 3, and the offering will be available for both hybrid and on-premise environments.

Unlocking the full potential of AI requires an open and collaborative ecosystem that provides customers with choice and accessible solutions. By integrating Gaudi 3 AI Accelerators and Xeon CPUs with IBM Cloud, we are creating new AI capabilities and meeting the demand for affordable, secure, and innovative AI computing solutions

- Justin Hotard, Executive VP and GM, Intel Data Center and AI

Why It Matters: While generative AI has the potential to accelerate transformation, the required compute power needed emphasizes the importance of availability, performance, cost, energy efficiency, and security as top priorities for enterprises. Through this collaboration, Intel and IBM aim to lower the total cost of ownership to leverage and scale AI, while enhancing performance.

Gaudi 3, integrated with 5th Gen Xeon, supports enterprise AI workloads in the cloud and data centers, providing customers with visibility and control over their software stack, simplifying workload and application management. IBM Cloud and Gaudi 3 aim to help customers more cost-effectively scale enterprise AI workloads, while prioritizing performance, security, and resiliency.

For generative AI inferencing workloads, IBM plans to enable support for Gaudi 3 within IBM's watsonx AI and data platform, providing watsonx clients with additional AI infrastructure resources for scaling their AI workloads across hybrid cloud environments, helping to optimize model inferencing price/performance.

How It Works: IBM and Intel are collaborating to help clients across industries, including those that are heavily regulated, leverage IBM Cloud's security and compliance capabilities to provide a Gaudi 3 service and make AI more accessible to enterprises.

Scalability and Flexibility: IBM Cloud and Intel offer scalable and flexible solutions that allow clients to adjust computing resources as needed, which has the potential to lead to cost savings and operational efficiency.

Enhanced Performance and Security: Integrating Gaudi 3 into IBM Cloud Virtual Servers for VPC will help enable x86-based enterprises to run applications faster and more securely than before the integration, enhancing user experiences.

What’s Next: Intel and IBM have a long-standing collaboration, from the development of the IBM PC to the creation of enterprise AI solutions with Gaudi 3. IBM Cloud with Gaudi 3 offerings will be generally available at the beginning of 2025. Stay tuned for more updates from Intel and IBM in the coming months.

[Journalist Note]: Intel's Gaudi 3 AI accelerator hasn't performed in the markets the way they were hyped up by Team Blue, given that the firm faces strict competition from the likes of AMD and NVIDIA, and despite providing attractive pricing, Intel still hasn't seen a massive adoption from the markets up till now. The partnership by IBM might restore the industry's trust in Intel products, but Team Blue has a long way to go from here.