Exclusive / company strategy

AI Inference Startups Are Quietly Buying Their Own Chips

Inference providers that resell leased compute are starting to buy their own hardware as GPU supply tightens. Fal (which raised $1.65B earlier this month) is buying Nvidia chips for leased data centres, its data-centre lead Raghu Rao said, and has discussed debt financing (Rao declined to comment on debt). Baseten is reportedly looking to buy GPUs. Together already plans 250MW of owned capacity by end-2026. A person familiar says CoreWeave stopped selling compute to Baseten after launching its own inference service; someone close to Baseten disputes this, and CoreWeave says its relationships with inference providers are good. Modal added up to 30 neocloud partners after failing to get Blackwell chips at the prices and volumes it wanted. Fireworks (passed $1B annualised revenue in July; last valued at $17.5B) says hardware is a commodity and has no current plan to buy. Caveat: several points rest on unnamed people familiar with the plans.

Why it matters

A strategic shift that changes the capital intensity and risk of high-valued inference companies (from software-like to more asset-heavy, debt-financed models). It matters for valuing Fal, Baseten, Together, Modal and Fireworks, and adds supplier and competitor links among neoclouds.

Read the full article: The Information

More top stories