IBM and Together AI are collaborating on a $240 million agreement to deploy NVIDIA HGX B300 systems on IBM Cloud for lar

IBM and NVIDIA have announced a collaboration with Together AI to deliver AI infrastructure on IBM Cloud. Under a multi-year $240 million agreement, IBM will deploy a large cluster of NVIDIA HGX B300 systems on IBM Cloud with expected availability in Q1 2027. Together AI will use this cluster to provide open-source model inference. This is the first dedicated large-scale inference cluster built on IBM Cloud using HGX B300 systems and NVIDIA Spectrum-X Ethernet networking. According to NVIDIA, the infrastructure is built to deliver 30x more AI factory output compared to prior generations.

Together AI raised an $800 million Series C financing round at an $8.3 billion valuation to expand its AI Native Cloud platform. The company's platform spans capabilities across inference, training, fine tuning, and agentic workflows. Together AI currently serves 400 trillion tokens monthly and reports significant momentum for its inference product.

Together AI selected IBM and NVIDIA for their innovative product roadmaps and ability to deliver GPU capacity at the pace required for rapid AI scaling with the lowest token cost. The collaboration aims to help Together AI expand into the enterprise space while making open-source AI more accessible to developers and enterprises globally.

Vipul Ved Prakash, CEO at Together AI, stated that enterprises want the performance of the best frontier models without the closed-model price tag. He said the cluster will bring production-grade inference to more companies faster and represents a major step in making open-source AI the obvious choice for enterprises.

Alan Peacock, General Manager of IBM Cloud, noted that enterprises are racing to adopt agentic AI at scale to drive business outcomes, and IBM and NVIDIA are delivering scalable, economical enterprise-grade AI infrastructure to support this acceleration.

Dion Harris, Senior Director of HPC and AI Infrastructure Solutions at NVIDIA, emphasized that AI factories are becoming essential enterprise infrastructure. With HGX B300 systems and Spectrum-X Ethernet networking on IBM Cloud combined with Together AI's inference platform, organizations will have a reliable foundation to build, deploy and scale AI systems.

This collaboration follows IBM and NVIDIA's recent announcement of progress in GPU-native data analytics, unstructured data extraction, on-premises and cloud infrastructure, and consulting services designed to help organizations operationalize AI at scale.