Gimlet Labs’ $3 Billion Bet: How Multi-Chip AI Could Break Nvidia Lock-In, Cut Inference Costs and Reshape the Hardware Race Backed by Arm, Microsoft and a16z

A $300 million funding round is putting a bold idea at the center of the AI infrastructure race: the next major winner may not manufacture the most powerful chip, but provide the software that decides which processor should run every part of an AI workload.In this episode of The Daily AI Chat, we explore Gimlet Labs’ Series B financing, which values the startup at $3 billion only six months after its previous $80 million round. Andreessen Horowitz led the investment, with strategic participation from Arm Holdings and M12, Microsoft’s venture fund, alongside other technology and financial investors.Gimlet Labs is building what it calls a multisilicon cloud for artificial-intelligence inference. Training creates a model; inference is the ongoing work performed every time that model answers a prompt, generates an image, writes code or runs inside an enterprise application. As inference becomes the dominant recurring AI workload, its electricity use, latency, memory requirements and chip costs are becoming central business problems.Most AI infrastructure relies on large fleets of similar GPUs. Gimlet’s alternative is to divide a model’s workload into phases and route each phase to the processor best suited for it. That could mean GPUs for some operations, CPUs for others, and specialized accelerators or near-memory processors where they offer better speed or efficiency. The company says its approach can produce three-to-ten-times faster performance for frontier workloads, or five-to-ten-times speedups at a comparable power footprint. Those figures are company claims that still need independent validation.Why are Arm and Microsoft investing? Arm benefits from a future in which inference spreads across more processor architectures instead of remaining concentrated in one GPU ecosystem. Microsoft operates Azure, is developing its own Maia AI silicon and has powerful reasons to reduce dependence on any single chip supplier. Their participation suggests Gimlet could become a strategic layer in the effort to loosen Nvidia’s grip on advanced computing.We examine Nvidia’s real advantage: not only its chips, but CUDA, the mature software ecosystem developers already know and trust. A chip-neutral orchestration platform must overcome that deeply embedded advantage while proving it can split workloads across radically different processors without adding unacceptable latency, complexity or reliability risks.The episode also examines Gimlet’s extraordinary valuation. The company says it has accumulated billions of dollars in contracted revenue, built a gigawatt-scale data-center pipeline and is moving toward hundreds of megawatts in managed capacity. Those statements indicate intense demand, but they are not audited disclosures. A $3 billion valuation is an investor wager on multi-chip inference, not proof the technical and commercial thesis has already succeeded.Key questions include whether hyperscale clouds will buy Gimlet’s platform or build competing orchestration internally; whether hardware vendors will cooperate with a neutral intermediary; whether efficiency gains survive real-world production conditions; and whether the AI infrastructure boom is creating sustainable businesses or accelerating valuations faster than products can mature.The larger shift is unmistakable. The first AI boom rewarded suppliers of enormous computing power for training. The next phase may be defined by inference efficiency: delivering billions of daily model responses faster, more cheaply and with less electricity. If Gimlet’s bet works, the most valuable layer could be the intelligent traffic controller sitting above a diverse collection of chips.Source: AI Weekly, September 4, 2026, linking the underlying Bloomberg News report. Reporting by Dina Bass. Additional first-party context from Gimlet Labs’ September 4 Series B announcement by Zain Asgar, Michelle Nguyen, Omid Azizi, James Bartlett and Natalie Serrino.