IBM Makes Major Bet on AI Inference, Partnering with Together AI in $240M Cloud Deal

In a significant move to capture the growing enterprise AI market, IBM has entered into a multi-year, $240 million agreement with startup Together AI. The partnership centers on deploying a large-scale AI inference cluster powered by NVIDIA's latest HGX B300 systems on the IBM Cloud platform.

The Infrastructure Play: Building for Next-Gen AI Workloads

The substantial investment is directed towards constructing a high-performance computing environment specifically optimized for AI inference tasks. Slated to become operational in the first quarter of 2027, this cluster is poised to rank among the most powerful AI-dedicated infrastructures within IBM's cloud ecosystem.

Opting for the NVIDIA HGX B300 platform underscores the partners' focus on handling demanding, large-scale AI models. The system is engineered to deliver the computational power necessary for running complex open-source models efficiently.

Strategic Vision: Commercializing Open-Source AI for Businesses

For Together AI, this deal represents a pivotal step in its commercial strategy. The company intends to leverage this robust infrastructure to offer its open-source model inference services directly to enterprise clients.

There's increasing demand from large organizations for flexible, customizable AI solutions that avoid vendor lock-in. By tapping into IBM's established cloud platform and global reach, Together AI gains a powerful channel to deliver its technology to the corporate world.

Implications for the Cloud and AI Landscape

This agreement sends clear signals about industry trends:

  • Enterprise AI Inference as a Battleground: Competition among cloud providers is intensifying around inference, the crucial phase where AI models are put to practical use.
  • Rising Value of Open-Source Ecosystems: Major players are actively investing in and embracing commercial services built on open-source models.
  • Tightening Hardware-Software Integration: The collaboration highlights deepening ties across the stack—from silicon (NVIDIA) to cloud (IBM) to application services (Together AI).

Beyond securing a major client, this deal strengthens IBM's hybrid cloud and AI strategy, helping it differentiate in a crowded market. How this $240 million AI cluster will reshape how enterprises access AI capabilities in the coming years is a development worth watching closely.