Article · October 2026
Damian Maggio: Why Compute Has Become the Biggest Line Item in AI
By Damian Maggio
Ask what limits progress in artificial intelligence today and the answer is often not talent or ideas. It is compute: the chips, servers, power and data centers needed to train and run models.
That shift changes how I look at AI companies.
Compute is a capital question. Training a frontier model can require thousands of specialized chips running for months. Running that model for millions of users requires even more over time. Companies have to secure that capacity in advance, often through long-term contracts with cloud providers or chip makers.
Compute shapes margins. For an AI company, the cost of serving each user is tied directly to the hardware it runs on. Revenue growth means little if every new dollar costs nearly a dollar of compute. Watching how efficiently a company turns compute into revenue is one of the clearest signals of whether its business can scale.
Compute drives an ecosystem. The demand for AI hardware has pulled forward investment across chips, networking, cooling, power generation and real estate. Companies in each of those layers are attracting private capital in their own right.
Compute is getting more efficient. New chip designs, better software and smarter model architectures keep lowering the cost of each task. That efficiency can open new uses that were too expensive a year earlier.
For private-market investors, this means looking past the model itself. The questions I ask: how does the company secure capacity, what does it pay for it, and how fast is the cost of serving a customer coming down?
AI is often described as a software story. Underneath, it is also an infrastructure story, and that is where much of the capital is going.
Damian Maggio writes about private markets and technology. More at damianmaggio.com.
This article is for informational purposes only, reflects the author's views as of the date written, and is not an offer to sell or a solicitation of an offer to buy any security, or investment advice. Investments in private companies are speculative and illiquid and can result in the loss of the entire investment.