SambaNova's air-cooled inference racks take on brownfield data centres
Key points
Key takeaways from a theCUBE interview at SC26 with SambaNova Systems VP of core product Anton McGonnell (November 2026):
Decode-phase differentiation. SambaNova, an AI chip and systems company for nine years with five shipped generations, focuses on the memory-bound decoding phase of inference; its fifth-generation SN50 system, announced earlier this year, is architected around data movement to serve the largest models at low latency without sacrificing throughput.
Brownfield first. Because the racks stay air-cooled, lightweight and less dense, they can be deployed in existing fully depreciated data centres — telco sites and colos — that newer GPU systems cannot use without liquid-cooling retrofits involving 18–24 month equipment lead times; McGonnell argues this unlocks net-new inference capacity while the industry waits on new builds.
Post-midterms demand spike. Demand in the two weeks before the interview was the highest the company has seen, as customers rethought strategies around existing sites, distributed compute across more geographies, and redirected plans amid slower US data-centre buildouts; SambaNova had already posted seven consecutive quarters of record growth.
Intel prefill partnership. At SC26 SambaNova announced a partnership with Intel, which built a prefill-focused chip using LPDDR instead of HBM to cut cost and supply-chain risk; Intel's air-cooled rack can be deployed alongside SambaNova's decode systems to cover the full inference workload end to end.
Open-source software pivot. SambaNova has pivoted to the standard open-source stack — vLLM, Nvidia's Dynamo orchestration and Kubernetes — and argues agentic AI is rapidly lowering the barrier to optimising models on alternative architectures, expecting performance tuning on its chips to become as easy as on Nvidia GPUs within 6–12 months.
Sovereign AI momentum. McGonnell cites a summer deal with JPMorgan Chase & Co to bring more inference on-premises, a close partnership with SoftBank on Japan's sovereign AI initiative, and similar efforts in Germany, the UK and Australia — markets where brownfield infrastructure can be used immediately.
Read more: YouTube — SiliconANGLE theCUBE