Date: August 11, 2026
Main source: Reuters
Link: https://www.reuters.com/business/ibm-together-ai-ink-240-million-deal-nvidia-powered-ai-inference-cluster-2026-08-11/
Additional sources: https://www.together.ai/
Summary
IBM and Together AI signed a multiyear $240 million agreement to build an inference cluster on IBM Cloud based on Nvidia systems. The initial deployment will use about 2,000 Blackwell 300 chips and will be geared toward running open models. Together AI expects the capacity to be reserved before it goes into service, a sign that the bottleneck is shifting from training to inference at scale. The deal also positions IBM as an infrastructure provider for companies that want more control over their models.
Why it matters
As AI moves from pilots to production processes, running millions of queries predictably and cheaply becomes an infrastructure problem. Open models can reduce certain license costs and dependence, but they require capacity, operations and optimization. The appearance of dedicated inference clusters shows that this market is acquiring a supply chain of its own.
Practical implications
- For recurring, high-volume workloads, compare a managed API against dedicated infrastructure or open models.
- Calculate cost per completed task including latency, errors, retries and human oversight.
- Avoid moving workloads to your own infrastructure just to save tokens. The operating complexity can wipe out the savings.
Focus of the day: Competitive advantage in AI is shifting from the standalone model toward control, inference cost, security and the ability to operate at scale.