IBM and Together AI signed a multi-year, $240 million agreement to deploy a large-scale NVIDIA B300 AI inference cluster.
IBM has signed a multi-year, $240 million agreement with Together AI to deploy a large-scale artificial intelligence inference cluster on IBM Cloud utilizing NVIDIA HGX B300 systems. Scheduled to become available in the first quarter of 2027, the cluster will enable Together AI to deliver open-source model inference to enterprise customers. According to IBM, this deployment marks the first dedicated, large-scale inference cluster on IBM Cloud built with NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking. NVIDIA states that the infrastructure is engineered to deliver up to 30 times more AI factory output than previous generations.
Together AI intends to leverage the new cluster to enhance inference performance and optimize token economics as enterprises transition larger AI workloads into production. Focused on open-source artificial intelligence, the company operates an AI Native Cloud platform that spans inference, training, fine-tuning, and agentic workflows. Recently, Together AI closed an $800 million Series C funding round at an $8.3 billion valuation. The company reports that its inference platform currently processes approximately 400 trillion tokens per month, underscoring rising demand for open-source models in production environments. Together AI selected IBM and NVIDIA as infrastructure partners based on their product roadmaps and capacity to supply the GPU resources necessary to support rapidly expanding AI workloads.
The collaboration aims to provide developers and enterprises with access to large-scale open-source inference through IBM’s enterprise cloud infrastructure. IBM is framing the partnership around surging demand for agentic AI and increasingly compute-intensive enterprise applications. The underlying architecture will integrate IBM Cloud, NVIDIA GPU systems, Spectrum-X networking, and Together AI’s inference software. For IBM, the agreement also deepens its existing relationship with NVIDIA across AI infrastructure and software, building on prior collaborations in GPU-native data analytics, unstructured data extraction, hybrid cloud and on-premises infrastructure, and enterprise AI deployment consulting. Ultimately, the deployment is designed to equip Together AI with infrastructure capable of supporting real-time AI services while expanding its footprint among large enterprises.
“Enterprises want the performance of the best frontier models without the closed-model price tag, and that only works if the infrastructure underneath is fast and reliable at scale. Working alongside IBM with NVIDIA gives us that foundation. This cluster lets us bring production-grade inference to more companies, faster, and it’s a big step in our push to make open-source AI the obvious choice for enterprises.”
“Enterprises are in a race to adopt agentic AI at scale to drive real business outcomes. IBM and NVIDIA are delivering scalable, economical, enterprise-grade AI infrastructure that can help Together AI accelerate innovation for the next generation of AI infrastructure.”
— Alan Peacock, General Manager of IBM Cloud
“AI factories are becoming essential enterprise infrastructure, like electricity and telecommunications, turning compute and data into intelligence. With NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking on IBM Cloud, IBM and Together AI will deliver an accelerated computing platform to help enterprises deploy open-source AI with the performance, efficiency and scale required for real-time AI services.”
— Dion Harris, Senior Director of HPC and AI Infrastructure Solutions at NVIDIA